2023-07-12T01:34:10.311 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-12T01:34:10.312 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/{0-client 1-tests/fscrypt-common}} --verbose --archive /home/teuthworker/archive/pdonnell-2023-07-12_01:23:58-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7334513 --owner scheduled_pdonnell@teuthology --name pdonnell-2023-07-12_01:23:58-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi -- /home/teuthworker/archive/pdonnell-2023-07-12_01:23:58-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7334513/orig.config.yaml 2023-07-12T01:34:10.358 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T01:34:10.450 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2023-07-12_01:23:58-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7334513 branch: wip-pdonnell-testing-20230710.195410 description: fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/{0-client 1-tests/fscrypt-common}} email: pdonnell@redhat.com first_in_suite: false job_id: '7334513' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2023-07-12_01:23:58-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-pdonnell-testing-20230710.195410 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: b5891ed62e7aba6227aed8ab09a4dd0853a1caf2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: b5891ed62e7aba6227aed8ab09a4dd0853a1caf2 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20230710.195410 sha1: 6a59b159e6baf6cc2ce7ca365bda9e61847ec2a4 owner: scheduled_pdonnell@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 seed: 948 sha1: b5891ed62e7aba6227aed8ab09a4dd0853a1caf2 sleep_before_teardown: 0 subset: 199/512 suite: fs suite_branch: wip-pdonnell-testing-20230710.195410 suite_path: /home/teuthworker/src/github.com_batrick_ceph_6a59b159e6baf6cc2ce7ca365bda9e61847ec2a4/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph.git suite_sha1: 6a59b159e6baf6cc2ce7ca365bda9e61847ec2a4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi060.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDi0gW8fKNAmfO+Czc2MKPviQypxSRgt8xo4Cf1byQ076IU2aJi9Y2x+cQvjy5NVGipT4KmiHlS5dZekXpriL6sxvyCQp3FvHixH8YvtYL106ID8eWABhf2VZjaDtnRN6F8QYWMtrZm6sDElHHdn6MgmEg3OqwDDfR/2nu2oTF5Clh/hVwbaBs4V8R2A0F8FSIQX7xYU9RVUBvc5mns7tGmy5T96QlsUv+LR4VIyZ+G97cPQA4c/czn8AUEilp/4994shrby+nq8vZ8FP4hKSbX26YxPrijXaYmeT2ogZh0zn6P1K+fc/3hRxT0UmuHsRglY+69Hkm6SBHFHsFlWkVuFt3hOYbDXBbYRFccW5JH1GmTF1Z7L/WzEttp279B5tcxj1H4/iBWb0UhmuBh9PTbHG0+CCc803Ou5TOk8sHEwSgJa+aij33oldLAS7lOsT++DB1whb7Yiovb35xRzYCSNCWmEc/o0G9V5kcoAnMZPH9TpwUdu4BgpyP5Op7Qjws= smithi079.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBYfcqXGTix8QIOpQtWZvohRlu8E6L5qdq8i2SPaD7y1R4bFLRDex36I+V761l7e8eo/EsWioP3bfNX+zNF5xAwES6eCA58nhraj68RXGvC6E+VfAZ93mgF43/Zdg+OBd+v7TRofbr9k5C+/o5meuU7pHUoOm6y08ATK1sqE9fKEuYjgkmKzThfWI/7BMzmCCOvRhaVpk0nA0mOrutwsz0NkX8KddCeuS1x5TB9H03V1zlNWI1WGqg7ZaBrOXSQo86HyW94+NFG7OdVvqmULRcao3CXYw5OIGgTDqtYsibEqxvrsZSTs7A6KMly0aif4cZ1r+b6CkTfwl4d/UD+ba/4UawsSQe6RQ+KRg/HUmhM+uf3c1TJqSJm5h8X4zHSdg+8J71MntFHPsfDcnepOx6c9s9TPKD5R62cdmgu+rq8nwvlHZyhF1GwHTvPvcIYMzc8hbZjGbx95F9SD1NMB9wR8DgZugH+nsTg3c4OYt81LYc9RiN2hwLKeP/OeauYbM= smithi174.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzej4BpwgudJfKlAIH0ciWIQRXO5umxqHSYk7zwtChJczy6QCZVBO8QR1TruR1wEidvdfwjNgKPZHCQXGgBvXFLMxFQw638x8mNfEZq427q39/hKePGMlVbngywH4pRRPMuFnwwJhFiufswdAfOYTTvaQoZV1VyQYcOf3DOEvkqVAlbuEpWzmFgDvO4tZaUpHKeQBC0W2Y65mVwm8QorJSdeFlPTptFQfg7kCT1NQHXq3480mpaKeUW7NaxzgPCTlybGGGkGaMqGyt5qT9K4cfbXay/KNa85xAOV5Uwie7/3sctvZlXbz7YAbbNUnh/ALin+aBQOi7DOpqevTMNu1PIhZUCmeKfZbeNSqGH9N6tEB/mDL+B4DtQku8UtOUV89tp/Ps2vVTBK7xSDTyYHMteLvgVIhj2OFU4DVjCfJ3ptKVXykotpL1UnnINLFsAGxJPRALYEUdYJ43CVDL0uv0CqNM+aR/lkC126r6LlSu5Ai6BfJX+PrSDDTMtAbMkhk= task: null tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_fscrypt teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end - if not is_kupstream() then reject() end teuthology_branch: main teuthology_sha1: b53f236c1077f1d295baafb9e0ca9a4b447019d7 timestamp: 2023-07-12_01:23:58 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-07-12T01:34:10.451 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_6a59b159e6baf6cc2ce7ca365bda9e61847ec2a4/qa; will attempt to use it 2023-07-12T01:34:10.451 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_6a59b159e6baf6cc2ce7ca365bda9e61847ec2a4/qa/tasks 2023-07-12T01:34:10.452 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-07-12T01:34:10.453 INFO:teuthology.task.internal:Checking packages... 2023-07-12T01:34:10.480 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b5891ed62e7aba6227aed8ab09a4dd0853a1caf2' 2023-07-12T01:34:10.481 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-07-12T01:34:10.481 INFO:teuthology.packaging:ref: None 2023-07-12T01:34:10.481 INFO:teuthology.packaging:tag: None 2023-07-12T01:34:10.482 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20230710.195410 2023-07-12T01:34:10.482 INFO:teuthology.packaging:sha1: b5891ed62e7aba6227aed8ab09a4dd0853a1caf2 2023-07-12T01:34:10.482 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-pdonnell-testing-20230710.195410 2023-07-12T01:34:10.623 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-4828.gb5891ed6 2023-07-12T01:34:10.624 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-07-12T01:34:10.632 INFO:teuthology.task.internal:no buildpackages task found 2023-07-12T01:34:10.632 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-07-12T01:34:10.649 INFO:teuthology.task.internal:Saving configuration 2023-07-12T01:34:10.666 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-07-12T01:34:10.675 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-12T01:34:10.703 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi060.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-12_01:23:58-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7334513', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-12 01:24:59.089504', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFmUB3aqnI8v7NBix1JHI4U3h640UqGtGFYoFz3XAg0lGxAun1e/Nm3rFip6qMJoAx6bVwHFKoU6NCJV4Llwj+c='} 2023-07-12T01:34:10.730 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-12_01:23:58-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7334513', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-12 01:24:59.090953', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIihJMRguFGShGOmiPQgXke1V+lfXl42PZDn1sxLh/f/u/5x2JS+r7tjZn/U7gPM1w7mOtodGbM9r08gzR7JHJs='} 2023-07-12T01:34:10.756 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi174.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-12_01:23:58-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7334513', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-12 01:24:59.088049', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBCJIjqvJA4qo6dVGuoI2XG/snJ1pfh10WxCxHSKVCAiYO7RTf0oqrBTODppp6oba5ktCFuhy5SsE5BXNFvB/PU='} 2023-07-12T01:34:10.756 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-07-12T01:34:10.764 INFO:teuthology.task.internal:roles: ubuntu@smithi060.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2023-07-12T01:34:10.765 INFO:teuthology.task.internal:roles: ubuntu@smithi079.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-07-12T01:34:10.765 INFO:teuthology.task.internal:roles: ubuntu@smithi174.front.sepia.ceph.com - ['client.0'] 2023-07-12T01:34:10.765 INFO:teuthology.run_tasks:Running task console_log... 2023-07-12T01:34:10.903 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8212834160>, signals=[15]) 2023-07-12T01:34:10.905 INFO:teuthology.run_tasks:Running task internal.connect... 2023-07-12T01:34:10.916 INFO:teuthology.task.internal:Opening connections... 2023-07-12T01:34:10.917 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi060.front.sepia.ceph.com 2023-07-12T01:34:10.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:34:10.994 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi079.front.sepia.ceph.com 2023-07-12T01:34:10.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:34:11.062 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi174.front.sepia.ceph.com 2023-07-12T01:34:11.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:34:11.131 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-07-12T01:34:11.140 DEBUG:teuthology.orchestra.run.smithi060:> uname -m 2023-07-12T01:34:11.164 INFO:teuthology.orchestra.run.smithi060.stdout:x86_64 2023-07-12T01:34:11.164 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release 2023-07-12T01:34:11.227 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="CentOS Stream" 2023-07-12T01:34:11.227 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="8" 2023-07-12T01:34:11.227 INFO:teuthology.orchestra.run.smithi060.stdout:ID="centos" 2023-07-12T01:34:11.228 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="rhel fedora" 2023-07-12T01:34:11.228 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="8" 2023-07-12T01:34:11.228 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el8" 2023-07-12T01:34:11.229 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-12T01:34:11.229 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31" 2023-07-12T01:34:11.229 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-12T01:34:11.230 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://centos.org/" 2023-07-12T01:34:11.230 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-12T01:34:11.230 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-12T01:34:11.231 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-12T01:34:11.232 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2023-07-12T01:34:11.257 DEBUG:teuthology.orchestra.run.smithi079:> uname -m 2023-07-12T01:34:11.280 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2023-07-12T01:34:11.281 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2023-07-12T01:34:11.341 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Stream" 2023-07-12T01:34:11.341 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="8" 2023-07-12T01:34:11.342 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos" 2023-07-12T01:34:11.342 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora" 2023-07-12T01:34:11.342 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="8" 2023-07-12T01:34:11.342 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el8" 2023-07-12T01:34:11.342 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-12T01:34:11.342 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2023-07-12T01:34:11.343 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-12T01:34:11.343 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://centos.org/" 2023-07-12T01:34:11.343 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-12T01:34:11.343 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-12T01:34:11.343 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-12T01:34:11.344 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2023-07-12T01:34:11.365 DEBUG:teuthology.orchestra.run.smithi174:> uname -m 2023-07-12T01:34:11.387 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64 2023-07-12T01:34:11.388 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2023-07-12T01:34:11.448 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="CentOS Stream" 2023-07-12T01:34:11.449 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="8" 2023-07-12T01:34:11.449 INFO:teuthology.orchestra.run.smithi174.stdout:ID="centos" 2023-07-12T01:34:11.449 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="rhel fedora" 2023-07-12T01:34:11.449 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="8" 2023-07-12T01:34:11.449 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el8" 2023-07-12T01:34:11.449 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-12T01:34:11.449 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2023-07-12T01:34:11.450 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-12T01:34:11.450 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://centos.org/" 2023-07-12T01:34:11.450 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-12T01:34:11.450 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-12T01:34:11.450 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-12T01:34:11.450 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2023-07-12T01:34:11.473 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-07-12T01:34:11.485 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-07-12T01:34:11.512 INFO:teuthology.task.internal:Checking for old test directory... 2023-07-12T01:34:11.513 DEBUG:teuthology.orchestra.run.smithi060:> test '!' -e /home/ubuntu/cephtest 2023-07-12T01:34:11.516 DEBUG:teuthology.orchestra.run.smithi079:> test '!' -e /home/ubuntu/cephtest 2023-07-12T01:34:11.519 DEBUG:teuthology.orchestra.run.smithi174:> test '!' -e /home/ubuntu/cephtest 2023-07-12T01:34:11.539 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-07-12T01:34:11.550 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-07-12T01:34:11.551 DEBUG:teuthology.orchestra.run.smithi060:> test -z $(ls -A /var/lib/ceph) 2023-07-12T01:34:11.577 DEBUG:teuthology.orchestra.run.smithi079:> test -z $(ls -A /var/lib/ceph) 2023-07-12T01:34:11.579 DEBUG:teuthology.orchestra.run.smithi174:> test -z $(ls -A /var/lib/ceph) 2023-07-12T01:34:11.609 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-07-12T01:34:11.694 INFO:teuthology.run_tasks:Running task kernel... 2023-07-12T01:34:11.711 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-07-12T01:34:11.712 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2023-07-12T01:34:11.712 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2023-07-12T01:34:11.713 DEBUG:teuthology.orchestra.run.smithi174:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-12T01:34:11.734 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-12T01:34:11.735 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-07-12T01:34:12.052 DEBUG:teuthology.task.kernel:sha1 for client.0 is 84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-12T01:34:12.053 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "84139c18d56f518615369e8310ae4ecf07a36dcd"... 2023-07-12T01:34:12.053 DEBUG:teuthology.orchestra.run.smithi174:> uname -r 2023-07-12T01:34:12.074 INFO:teuthology.orchestra.run.smithi174.stdout:4.18.0-489.el8.x86_64 2023-07-12T01:34:12.074 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-12T01:34:12.075 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-07-12T01:34:12.075 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum upgrade -y linux-firmware 2023-07-12T01:36:50.745 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 8 - AppStream 201 kB/s | 31 MB 02:36 2023-07-12T01:36:59.454 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 8 - BaseOS 13 MB/s | 41 MB 00:03 2023-07-12T01:37:05.804 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 8 - Extras 48 kB/s | 18 kB 00:00 2023-07-12T01:37:06.580 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 8 - Extras common packages 11 kB/s | 6.6 kB 00:00 2023-07-12T01:37:09.423 INFO:teuthology.orchestra.run.smithi174.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-07-12T01:37:11.831 INFO:teuthology.orchestra.run.smithi174.stdout:Extra Packages for Enterprise Linux 6.9 MB/s | 16 MB 00:02 2023-07-12T01:37:15.631 INFO:teuthology.orchestra.run.smithi174.stdout:lab-extras 370 kB/s | 24 kB 00:00 2023-07-12T01:37:19.051 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2023-07-12T01:37:19.051 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2023-07-12T01:37:19.052 INFO:teuthology.orchestra.run.smithi174.stdout: Package Arch Version Repo Size 2023-07-12T01:37:19.052 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2023-07-12T01:37:19.052 INFO:teuthology.orchestra.run.smithi174.stdout:Upgrading: 2023-07-12T01:37:19.052 INFO:teuthology.orchestra.run.smithi174.stdout: linux-firmware noarch 20230515-115.gitd1962891.el8 baseos 266 M 2023-07-12T01:37:19.052 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T01:37:19.052 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2023-07-12T01:37:19.053 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2023-07-12T01:37:19.053 INFO:teuthology.orchestra.run.smithi174.stdout:Upgrade 1 Package 2023-07-12T01:37:19.053 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T01:37:19.053 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 266 M 2023-07-12T01:37:19.053 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading Packages: 2023-07-12T01:37:50.979 INFO:teuthology.orchestra.run.smithi174.stdout:linux-firmware-20230515-115.gitd1962891.el8.noa 8.3 MB/s | 266 MB 00:31 2023-07-12T01:37:50.980 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2023-07-12T01:37:50.980 INFO:teuthology.orchestra.run.smithi174.stdout:Total 8.3 MB/s | 266 MB 00:31 2023-07-12T01:37:52.564 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2023-07-12T01:37:52.643 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction check succeeded. 2023-07-12T01:37:52.643 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2023-07-12T01:37:54.310 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded. 2023-07-12T01:37:54.338 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2023-07-12T01:38:11.983 INFO:teuthology.orchestra.run.smithi174.stdout: Preparing : 1/1 2023-07-12T01:38:12.345 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-07-12T01:38:12.555 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-12T01:38:12.790 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-12T01:38:12.790 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-07-12T01:38:13.433 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-12T01:38:13.433 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T01:38:13.433 INFO:teuthology.orchestra.run.smithi174.stdout:Upgraded: 2023-07-12T01:38:13.434 INFO:teuthology.orchestra.run.smithi174.stdout: linux-firmware-20230515-115.gitd1962891.el8.noarch 2023-07-12T01:38:13.434 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T01:38:13.434 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2023-07-12T01:38:13.591 INFO:teuthology.task.kernel:Downloading kernel 84139c18d56f518615369e8310ae4ecf07a36dcd on client.0... 2023-07-12T01:38:13.592 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-12T01:38:13.743 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/centos/8/flavors/default/x86_64/ 2023-07-12T01:38:13.744 DEBUG:teuthology.orchestra.run.smithi174:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.4.0_g84139c18d56f-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/centos/8/flavors/default/x86_64/ --input-file=- 2023-07-12T01:38:13.747 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi174.front.sepia.ceph.com to complete... 2023-07-12T01:38:26.832 INFO:teuthology.orchestra.run.smithi174.stderr:2023-07-12 01:38:26 URL:https://2.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/centos/8/flavors/default/x86_64/kernel-6.4.0_g84139c18d56f-1.x86_64.rpm [379858600/379858600] -> "/tmp/kernel.x86_64.rpm" [1] 2023-07-12T01:38:26.832 INFO:teuthology.orchestra.run.smithi174.stderr:FINISHED --2023-07-12 01:38:26-- 2023-07-12T01:38:26.832 INFO:teuthology.orchestra.run.smithi174.stderr:Total wall clock time: 13s 2023-07-12T01:38:26.832 INFO:teuthology.orchestra.run.smithi174.stderr:Downloaded: 1 files, 362M in 13s (28.5 MB/s) 2023-07-12T01:38:26.833 INFO:teuthology.task.kernel:Installing kernel 84139c18d56f518615369e8310ae4ecf07a36dcd on client.0... 2023-07-12T01:38:26.834 DEBUG:teuthology.orchestra.run.smithi174:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-07-12T01:38:28.528 INFO:teuthology.orchestra.run.smithi174.stdout:Verifying... ######################################## 2023-07-12T01:38:28.572 INFO:teuthology.orchestra.run.smithi174.stdout:Preparing... ######################################## 2023-07-12T01:38:28.681 INFO:teuthology.orchestra.run.smithi174.stdout:Updating / installing... 2023-07-12T01:39:06.502 INFO:teuthology.orchestra.run.smithi174.stdout:kernel-6.4.0_g84139c18d56f-1 ######################################## 2023-07-12T01:39:29.711 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi174.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-07-12T01:39:29.711 DEBUG:teuthology.orchestra.run.smithi174:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-07-12T01:39:29.762 INFO:teuthology.orchestra.run.smithi174.stdout:/boot/System.map-6.4.0-g84139c18d56f 2023-07-12T01:39:29.762 INFO:teuthology.orchestra.run.smithi174.stdout:/boot/config-6.4.0-g84139c18d56f 2023-07-12T01:39:29.762 INFO:teuthology.orchestra.run.smithi174.stdout:/boot/vmlinuz-6.4.0-g84139c18d56f 2023-07-12T01:39:29.762 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f 2023-07-12T01:39:29.762 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel 2023-07-12T01:39:29.763 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch 2023-07-12T01:39:29.763 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86 2023-07-12T01:39:29.763 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto 2023-07-12T01:39:29.763 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-07-12T01:39:29.763 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-07-12T01:39:29.763 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-07-12T01:39:29.763 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-07-12T01:39:29.764 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-07-12T01:39:29.764 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-07-12T01:39:29.764 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-07-12T01:39:29.764 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/crc32c-intel.ko 2023-07-12T01:39:29.764 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-07-12T01:39:29.764 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-07-12T01:39:29.764 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-07-12T01:39:29.765 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-07-12T01:39:29.765 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-avx2.ko 2023-07-12T01:39:29.765 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-07-12T01:39:29.765 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-07-12T01:39:29.765 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-07-12T01:39:29.765 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-07-12T01:39:29.765 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-07-12T01:39:29.766 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-07-12T01:39:29.766 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-07-12T01:39:29.766 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel 2023-07-12T01:39:29.766 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu 2023-07-12T01:39:29.767 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu/mce 2023-07-12T01:39:29.767 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-07-12T01:39:29.767 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm 2023-07-12T01:39:29.767 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm-amd.ko 2023-07-12T01:39:29.767 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm-intel.ko 2023-07-12T01:39:29.767 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm.ko 2023-07-12T01:39:29.767 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto 2023-07-12T01:39:29.768 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/ansi_cprng.ko 2023-07-12T01:39:29.768 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/anubis.ko 2023-07-12T01:39:29.768 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/arc4.ko 2023-07-12T01:39:29.768 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx 2023-07-12T01:39:29.768 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_memcpy.ko 2023-07-12T01:39:29.768 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_pq.ko 2023-07-12T01:39:29.768 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_raid6_recov.ko 2023-07-12T01:39:29.769 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_tx.ko 2023-07-12T01:39:29.769 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_xor.ko 2023-07-12T01:39:29.769 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/raid6test.ko 2023-07-12T01:39:29.769 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/authenc.ko 2023-07-12T01:39:29.769 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/authencesn.ko 2023-07-12T01:39:29.769 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blake2b_generic.ko 2023-07-12T01:39:29.769 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blowfish_common.ko 2023-07-12T01:39:29.769 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blowfish_generic.ko 2023-07-12T01:39:29.770 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/camellia_generic.ko 2023-07-12T01:39:29.770 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast5_generic.ko 2023-07-12T01:39:29.770 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast6_generic.ko 2023-07-12T01:39:29.770 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast_common.ko 2023-07-12T01:39:29.770 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/ccm.ko 2023-07-12T01:39:29.770 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cmac.ko 2023-07-12T01:39:29.770 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crc32_generic.ko 2023-07-12T01:39:29.771 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crypto_engine.ko 2023-07-12T01:39:29.771 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crypto_user.ko 2023-07-12T01:39:29.771 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cts.ko 2023-07-12T01:39:29.771 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/des_generic.ko 2023-07-12T01:39:29.771 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/dh_generic.ko 2023-07-12T01:39:29.771 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/echainiv.ko 2023-07-12T01:39:29.771 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/essiv.ko 2023-07-12T01:39:29.771 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/fcrypt.ko 2023-07-12T01:39:29.772 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/khazad.ko 2023-07-12T01:39:29.772 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/lz4.ko 2023-07-12T01:39:29.772 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/lz4hc.ko 2023-07-12T01:39:29.772 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/md4.ko 2023-07-12T01:39:29.772 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/michael_mic.ko 2023-07-12T01:39:29.772 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/pcbc.ko 2023-07-12T01:39:29.772 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/pcrypt.ko 2023-07-12T01:39:29.772 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/rmd160.ko 2023-07-12T01:39:29.773 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/seed.ko 2023-07-12T01:39:29.773 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/serpent_generic.ko 2023-07-12T01:39:29.773 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/tcrypt.ko 2023-07-12T01:39:29.773 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/tea.ko 2023-07-12T01:39:29.773 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/twofish_common.ko 2023-07-12T01:39:29.773 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/twofish_generic.ko 2023-07-12T01:39:29.773 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/vmac.ko 2023-07-12T01:39:29.774 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/wp512.ko 2023-07-12T01:39:29.774 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xcbc.ko 2023-07-12T01:39:29.774 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xor.ko 2023-07-12T01:39:29.774 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xxhash_generic.ko 2023-07-12T01:39:29.774 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers 2023-07-12T01:39:29.774 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi 2023-07-12T01:39:29.774 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/acpi_ipmi.ko 2023-07-12T01:39:29.774 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/acpi_pad.ko 2023-07-12T01:39:29.775 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/custom_method.ko 2023-07-12T01:39:29.775 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/ec_sys.ko 2023-07-12T01:39:29.775 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/platform_profile.ko 2023-07-12T01:39:29.775 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/sbs.ko 2023-07-12T01:39:29.775 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/sbshc.ko 2023-07-12T01:39:29.775 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/video.ko 2023-07-12T01:39:29.776 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata 2023-07-12T01:39:29.776 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/acard-ahci.ko 2023-07-12T01:39:29.776 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/ahci_platform.ko 2023-07-12T01:39:29.776 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/ata_generic.ko 2023-07-12T01:39:29.776 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/libahci_platform.ko 2023-07-12T01:39:29.777 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_acpi.ko 2023-07-12T01:39:29.777 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ali.ko 2023-07-12T01:39:29.777 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_amd.ko 2023-07-12T01:39:29.777 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_artop.ko 2023-07-12T01:39:29.777 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_atiixp.ko 2023-07-12T01:39:29.778 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_atp867x.ko 2023-07-12T01:39:29.778 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cmd640.ko 2023-07-12T01:39:29.778 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cmd64x.ko 2023-07-12T01:39:29.778 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cypress.ko 2023-07-12T01:39:29.778 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_efar.ko 2023-07-12T01:39:29.778 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt366.ko 2023-07-12T01:39:29.778 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt37x.ko 2023-07-12T01:39:29.778 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt3x2n.ko 2023-07-12T01:39:29.779 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt3x3.ko 2023-07-12T01:39:29.779 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_it8213.ko 2023-07-12T01:39:29.779 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_it821x.ko 2023-07-12T01:39:29.779 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_jmicron.ko 2023-07-12T01:39:29.779 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_marvell.ko 2023-07-12T01:39:29.779 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_mpiix.ko 2023-07-12T01:39:29.779 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_netcell.ko 2023-07-12T01:39:29.780 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ninja32.ko 2023-07-12T01:39:29.780 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ns87410.ko 2023-07-12T01:39:29.780 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ns87415.ko 2023-07-12T01:39:29.780 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_oldpiix.ko 2023-07-12T01:39:29.780 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_opti.ko 2023-07-12T01:39:29.780 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_optidma.ko 2023-07-12T01:39:29.780 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pcmcia.ko 2023-07-12T01:39:29.780 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pdc2027x.ko 2023-07-12T01:39:29.781 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-07-12T01:39:29.781 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_piccolo.ko 2023-07-12T01:39:29.781 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_rdc.ko 2023-07-12T01:39:29.781 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sch.ko 2023-07-12T01:39:29.781 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_serverworks.ko 2023-07-12T01:39:29.781 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sil680.ko 2023-07-12T01:39:29.781 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sis.ko 2023-07-12T01:39:29.782 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sl82c105.ko 2023-07-12T01:39:29.782 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_triflex.ko 2023-07-12T01:39:29.782 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_via.ko 2023-07-12T01:39:29.782 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pdc_adma.ko 2023-07-12T01:39:29.782 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_inic162x.ko 2023-07-12T01:39:29.782 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_mv.ko 2023-07-12T01:39:29.782 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_nv.ko 2023-07-12T01:39:29.782 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_promise.ko 2023-07-12T01:39:29.783 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_qstor.ko 2023-07-12T01:39:29.783 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sil.ko 2023-07-12T01:39:29.783 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sil24.ko 2023-07-12T01:39:29.783 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sis.ko 2023-07-12T01:39:29.783 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_svw.ko 2023-07-12T01:39:29.783 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sx4.ko 2023-07-12T01:39:29.783 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_uli.ko 2023-07-12T01:39:29.784 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_via.ko 2023-07-12T01:39:29.784 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_vsc.ko 2023-07-12T01:39:29.784 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/auxdisplay 2023-07-12T01:39:29.784 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/auxdisplay/ks0108.ko 2023-07-12T01:39:29.784 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/base 2023-07-12T01:39:29.784 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/base/regmap 2023-07-12T01:39:29.784 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/base/regmap/regmap-i2c.ko 2023-07-12T01:39:29.784 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/bcma 2023-07-12T01:39:29.785 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/bcma/bcma.ko 2023-07-12T01:39:29.785 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block 2023-07-12T01:39:29.785 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/aoe 2023-07-12T01:39:29.785 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/aoe/aoe.ko 2023-07-12T01:39:29.785 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/brd.ko 2023-07-12T01:39:29.785 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/drbd 2023-07-12T01:39:29.785 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/drbd/drbd.ko 2023-07-12T01:39:29.786 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/floppy.ko 2023-07-12T01:39:29.786 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/loop.ko 2023-07-12T01:39:29.786 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/mtip32xx 2023-07-12T01:39:29.786 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-07-12T01:39:29.786 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/nbd.ko 2023-07-12T01:39:29.786 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/null_blk 2023-07-12T01:39:29.786 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/null_blk/null_blk.ko 2023-07-12T01:39:29.786 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/pktcdvd.ko 2023-07-12T01:39:29.787 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/rbd.ko 2023-07-12T01:39:29.787 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/virtio_blk.ko 2023-07-12T01:39:29.787 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/xen-blkback 2023-07-12T01:39:29.787 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-07-12T01:39:29.788 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/xen-blkfront.ko 2023-07-12T01:39:29.788 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/zram 2023-07-12T01:39:29.788 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/zram/zram.ko 2023-07-12T01:39:29.788 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char 2023-07-12T01:39:29.788 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hangcheck-timer.ko 2023-07-12T01:39:29.788 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random 2023-07-12T01:39:29.788 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/amd-rng.ko 2023-07-12T01:39:29.789 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/intel-rng.ko 2023-07-12T01:39:29.789 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-07-12T01:39:29.789 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/via-rng.ko 2023-07-12T01:39:29.789 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/virtio-rng.ko 2023-07-12T01:39:29.789 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi 2023-07-12T01:39:29.789 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-07-12T01:39:29.789 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-07-12T01:39:29.789 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-07-12T01:39:29.790 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_si.ko 2023-07-12T01:39:29.790 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-07-12T01:39:29.790 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-07-12T01:39:29.790 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/lp.ko 2023-07-12T01:39:29.790 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/mwave 2023-07-12T01:39:29.790 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/mwave/mwave.ko 2023-07-12T01:39:29.790 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ppdev.ko 2023-07-12T01:39:29.791 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tlclk.ko 2023-07-12T01:39:29.791 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm 2023-07-12T01:39:29.791 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm.ko 2023-07-12T01:39:29.791 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_atmel.ko 2023-07-12T01:39:29.791 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_infineon.ko 2023-07-12T01:39:29.791 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_nsc.ko 2023-07-12T01:39:29.791 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_tis.ko 2023-07-12T01:39:29.791 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-07-12T01:39:29.792 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/uv_mmtimer.ko 2023-07-12T01:39:29.792 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/virtio_console.ko 2023-07-12T01:39:29.792 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq 2023-07-12T01:39:29.792 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-07-12T01:39:29.792 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-07-12T01:39:29.792 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/p4-clockmod.ko 2023-07-12T01:39:29.792 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-07-12T01:39:29.792 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/powernow-k8.ko 2023-07-12T01:39:29.793 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/speedstep-lib.ko 2023-07-12T01:39:29.793 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto 2023-07-12T01:39:29.793 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp 2023-07-12T01:39:29.793 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-07-12T01:39:29.793 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp/ccp.ko 2023-07-12T01:39:29.793 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel 2023-07-12T01:39:29.793 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat 2023-07-12T01:39:29.794 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_common 2023-07-12T01:39:29.794 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-07-12T01:39:29.794 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-07-12T01:39:29.794 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-07-12T01:39:29.794 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/padlock-aes.ko 2023-07-12T01:39:29.794 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/padlock-sha.ko 2023-07-12T01:39:29.794 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/virtio 2023-07-12T01:39:29.794 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-07-12T01:39:29.795 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dca 2023-07-12T01:39:29.795 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dca/dca.ko 2023-07-12T01:39:29.795 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/devfreq 2023-07-12T01:39:29.795 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-07-12T01:39:29.795 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma 2023-07-12T01:39:29.795 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/dw 2023-07-12T01:39:29.795 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/dw/dw_dmac.ko 2023-07-12T01:39:29.795 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/ioat 2023-07-12T01:39:29.796 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/ioat/ioatdma.ko 2023-07-12T01:39:29.796 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac 2023-07-12T01:39:29.796 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/amd64_edac.ko 2023-07-12T01:39:29.796 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/e752x_edac.ko 2023-07-12T01:39:29.796 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/edac_mce_amd.ko 2023-07-12T01:39:29.796 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i3000_edac.ko 2023-07-12T01:39:29.796 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i3200_edac.ko 2023-07-12T01:39:29.797 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i5100_edac.ko 2023-07-12T01:39:29.797 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i5400_edac.ko 2023-07-12T01:39:29.797 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i7300_edac.ko 2023-07-12T01:39:29.797 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i7core_edac.ko 2023-07-12T01:39:29.797 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i82975x_edac.ko 2023-07-12T01:39:29.798 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/ie31200_edac.ko 2023-07-12T01:39:29.798 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/sb_edac.ko 2023-07-12T01:39:29.798 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/x38_edac.ko 2023-07-12T01:39:29.798 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware 2023-07-12T01:39:29.798 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/edd.ko 2023-07-12T01:39:29.798 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/iscsi_ibft.ko 2023-07-12T01:39:29.799 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio 2023-07-12T01:39:29.799 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-ich.ko 2023-07-12T01:39:29.799 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-viperboard.ko 2023-07-12T01:39:29.799 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid 2023-07-12T01:39:29.799 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-appleir.ko 2023-07-12T01:39:29.799 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-aureal.ko 2023-07-12T01:39:29.799 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-axff.ko 2023-07-12T01:39:29.799 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-dr.ko 2023-07-12T01:39:29.800 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-elecom.ko 2023-07-12T01:39:29.800 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-elo.ko 2023-07-12T01:39:29.800 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-emsff.ko 2023-07-12T01:39:29.800 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gaff.ko 2023-07-12T01:39:29.800 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gt683r.ko 2023-07-12T01:39:29.800 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gyration.ko 2023-07-12T01:39:29.800 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtek-kbd.ko 2023-07-12T01:39:29.800 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtek-mouse.ko 2023-07-12T01:39:29.801 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtekff.ko 2023-07-12T01:39:29.801 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-hyperv.ko 2023-07-12T01:39:29.801 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-icade.ko 2023-07-12T01:39:29.801 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-keytouch.ko 2023-07-12T01:39:29.801 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-kye.ko 2023-07-12T01:39:29.801 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-lcpower.ko 2023-07-12T01:39:29.801 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-led.ko 2023-07-12T01:39:29.802 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-lenovo.ko 2023-07-12T01:39:29.802 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-logitech-dj.ko 2023-07-12T01:39:29.802 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-07-12T01:39:29.802 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-multitouch.ko 2023-07-12T01:39:29.802 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-ortek.ko 2023-07-12T01:39:29.802 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-penmount.ko 2023-07-12T01:39:29.802 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-petalynx.ko 2023-07-12T01:39:29.802 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-picolcd.ko 2023-07-12T01:39:29.803 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-pl.ko 2023-07-12T01:39:29.803 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-plantronics.ko 2023-07-12T01:39:29.803 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-primax.ko 2023-07-12T01:39:29.803 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-rmi.ko 2023-07-12T01:39:29.803 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-arvo.ko 2023-07-12T01:39:29.803 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-common.ko 2023-07-12T01:39:29.803 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-isku.ko 2023-07-12T01:39:29.803 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-kone.ko 2023-07-12T01:39:29.804 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-07-12T01:39:29.804 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-konepure.ko 2023-07-12T01:39:29.804 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-07-12T01:39:29.804 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-lua.ko 2023-07-12T01:39:29.804 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-pyra.ko 2023-07-12T01:39:29.804 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-ryos.ko 2023-07-12T01:39:29.804 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-savu.ko 2023-07-12T01:39:29.805 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat.ko 2023-07-12T01:39:29.805 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-saitek.ko 2023-07-12T01:39:29.805 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-samsung.ko 2023-07-12T01:39:29.805 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sensor-hub.ko 2023-07-12T01:39:29.805 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sjoy.ko 2023-07-12T01:39:29.805 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sony.ko 2023-07-12T01:39:29.805 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-speedlink.ko 2023-07-12T01:39:29.805 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-steelseries.ko 2023-07-12T01:39:29.806 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sunplus.ko 2023-07-12T01:39:29.806 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-thrustmaster.ko 2023-07-12T01:39:29.806 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-tivo.ko 2023-07-12T01:39:29.806 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-tmff.ko 2023-07-12T01:39:29.806 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-topseed.ko 2023-07-12T01:39:29.806 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-twinhan.ko 2023-07-12T01:39:29.806 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-uclogic.ko 2023-07-12T01:39:29.806 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-waltop.ko 2023-07-12T01:39:29.807 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-wiimote.ko 2023-07-12T01:39:29.807 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-xinmo.ko 2023-07-12T01:39:29.807 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-zpff.ko 2023-07-12T01:39:29.807 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-zydacron.ko 2023-07-12T01:39:29.807 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/uhid.ko 2023-07-12T01:39:29.807 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/wacom.ko 2023-07-12T01:39:29.807 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv 2023-07-12T01:39:29.807 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_balloon.ko 2023-07-12T01:39:29.808 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_utils.ko 2023-07-12T01:39:29.808 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_vmbus.ko 2023-07-12T01:39:29.808 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon 2023-07-12T01:39:29.808 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/abituguru.ko 2023-07-12T01:39:29.808 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/abituguru3.ko 2023-07-12T01:39:29.808 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/acpi_power_meter.ko 2023-07-12T01:39:29.808 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ad7414.ko 2023-07-12T01:39:29.809 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ad7418.ko 2023-07-12T01:39:29.809 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adc128d818.ko 2023-07-12T01:39:29.809 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1025.ko 2023-07-12T01:39:29.809 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1026.ko 2023-07-12T01:39:29.809 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1029.ko 2023-07-12T01:39:29.809 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1031.ko 2023-07-12T01:39:29.809 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm9240.ko 2023-07-12T01:39:29.809 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ads7828.ko 2023-07-12T01:39:29.810 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7410.ko 2023-07-12T01:39:29.810 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7411.ko 2023-07-12T01:39:29.810 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7462.ko 2023-07-12T01:39:29.810 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7470.ko 2023-07-12T01:39:29.810 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7475.ko 2023-07-12T01:39:29.810 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7x10.ko 2023-07-12T01:39:29.810 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/amc6821.ko 2023-07-12T01:39:29.811 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/applesmc.ko 2023-07-12T01:39:29.811 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asb100.ko 2023-07-12T01:39:29.811 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asc7621.ko 2023-07-12T01:39:29.811 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asus_atk0110.ko 2023-07-12T01:39:29.811 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/atxp1.ko 2023-07-12T01:39:29.811 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/coretemp.ko 2023-07-12T01:39:29.811 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-07-12T01:39:29.811 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/dme1737.ko 2023-07-12T01:39:29.812 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ds1621.ko 2023-07-12T01:39:29.812 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ds620.ko 2023-07-12T01:39:29.812 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/emc1403.ko 2023-07-12T01:39:29.812 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/emc6w201.ko 2023-07-12T01:39:29.812 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f71805f.ko 2023-07-12T01:39:29.812 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f71882fg.ko 2023-07-12T01:39:29.812 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f75375s.ko 2023-07-12T01:39:29.812 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/fam15h_power.ko 2023-07-12T01:39:29.813 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/fschmd.ko 2023-07-12T01:39:29.813 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/g760a.ko 2023-07-12T01:39:29.813 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/g762.ko 2023-07-12T01:39:29.813 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/gl518sm.ko 2023-07-12T01:39:29.813 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/gl520sm.ko 2023-07-12T01:39:29.813 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/hwmon-vid.ko 2023-07-12T01:39:29.813 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/i5500_temp.ko 2023-07-12T01:39:29.813 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/i5k_amb.ko 2023-07-12T01:39:29.814 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ibmaem.ko 2023-07-12T01:39:29.814 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ibmpex.ko 2023-07-12T01:39:29.814 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ina209.ko 2023-07-12T01:39:29.814 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ina2xx.ko 2023-07-12T01:39:29.814 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/it87.ko 2023-07-12T01:39:29.814 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/k10temp.ko 2023-07-12T01:39:29.814 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/k8temp.ko 2023-07-12T01:39:29.815 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lineage-pem.ko 2023-07-12T01:39:29.815 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm63.ko 2023-07-12T01:39:29.815 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm73.ko 2023-07-12T01:39:29.815 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm75.ko 2023-07-12T01:39:29.815 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm77.ko 2023-07-12T01:39:29.815 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm78.ko 2023-07-12T01:39:29.815 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm80.ko 2023-07-12T01:39:29.815 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm83.ko 2023-07-12T01:39:29.816 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm85.ko 2023-07-12T01:39:29.816 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm87.ko 2023-07-12T01:39:29.816 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm90.ko 2023-07-12T01:39:29.816 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm92.ko 2023-07-12T01:39:29.816 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm93.ko 2023-07-12T01:39:29.816 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95234.ko 2023-07-12T01:39:29.816 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95241.ko 2023-07-12T01:39:29.817 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95245.ko 2023-07-12T01:39:29.817 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc2945.ko 2023-07-12T01:39:29.817 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4151.ko 2023-07-12T01:39:29.817 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4215.ko 2023-07-12T01:39:29.817 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4222.ko 2023-07-12T01:39:29.817 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4245.ko 2023-07-12T01:39:29.817 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4260.ko 2023-07-12T01:39:29.817 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4261.ko 2023-07-12T01:39:29.818 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max16065.ko 2023-07-12T01:39:29.818 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max1619.ko 2023-07-12T01:39:29.818 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max1668.ko 2023-07-12T01:39:29.818 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max197.ko 2023-07-12T01:39:29.818 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6639.ko 2023-07-12T01:39:29.818 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6650.ko 2023-07-12T01:39:29.818 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6697.ko 2023-07-12T01:39:29.818 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/mcp3021.ko 2023-07-12T01:39:29.819 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6683.ko 2023-07-12T01:39:29.819 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6775-core.ko 2023-07-12T01:39:29.819 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6775.ko 2023-07-12T01:39:29.819 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct7802.ko 2023-07-12T01:39:29.819 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pc87360.ko 2023-07-12T01:39:29.819 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pc87427.ko 2023-07-12T01:39:29.819 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pcf8591.ko 2023-07-12T01:39:29.819 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus 2023-07-12T01:39:29.820 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-07-12T01:39:29.820 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-07-12T01:39:29.820 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-07-12T01:39:29.820 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max16064.ko 2023-07-12T01:39:29.820 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max34440.ko 2023-07-12T01:39:29.820 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max8688.ko 2023-07-12T01:39:29.820 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-07-12T01:39:29.821 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-07-12T01:39:29.821 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-07-12T01:39:29.821 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-07-12T01:39:29.821 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-07-12T01:39:29.821 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-07-12T01:39:29.821 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/powr1220.ko 2023-07-12T01:39:29.821 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch5627.ko 2023-07-12T01:39:29.821 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch5636.ko 2023-07-12T01:39:29.822 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch56xx-common.ko 2023-07-12T01:39:29.822 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sht15.ko 2023-07-12T01:39:29.822 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sht21.ko 2023-07-12T01:39:29.822 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/shtc1.ko 2023-07-12T01:39:29.822 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sis5595.ko 2023-07-12T01:39:29.822 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47b397.ko 2023-07-12T01:39:29.822 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47m1.ko 2023-07-12T01:39:29.822 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47m192.ko 2023-07-12T01:39:29.823 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/thmc50.ko 2023-07-12T01:39:29.823 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp102.ko 2023-07-12T01:39:29.823 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp103.ko 2023-07-12T01:39:29.823 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp401.ko 2023-07-12T01:39:29.823 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp421.ko 2023-07-12T01:39:29.823 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/via-cputemp.ko 2023-07-12T01:39:29.823 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/via686a.ko 2023-07-12T01:39:29.823 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/vt1211.ko 2023-07-12T01:39:29.824 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/vt8231.ko 2023-07-12T01:39:29.824 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83627ehf.ko 2023-07-12T01:39:29.824 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83627hf.ko 2023-07-12T01:39:29.824 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83781d.ko 2023-07-12T01:39:29.824 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83791d.ko 2023-07-12T01:39:29.824 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83792d.ko 2023-07-12T01:39:29.824 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83793.ko 2023-07-12T01:39:29.825 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83795.ko 2023-07-12T01:39:29.825 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83l785ts.ko 2023-07-12T01:39:29.825 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83l786ng.ko 2023-07-12T01:39:29.825 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c 2023-07-12T01:39:29.825 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos 2023-07-12T01:39:29.825 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-07-12T01:39:29.825 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-07-12T01:39:29.825 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses 2023-07-12T01:39:29.826 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-07-12T01:39:29.826 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-07-12T01:39:29.826 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-07-12T01:39:29.826 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-07-12T01:39:29.826 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-07-12T01:39:29.826 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-07-12T01:39:29.826 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-07-12T01:39:29.826 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-07-12T01:39:29.827 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-i801.ko 2023-07-12T01:39:29.827 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-isch.ko 2023-07-12T01:39:29.827 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-07-12T01:39:29.827 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-07-12T01:39:29.827 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-07-12T01:39:29.827 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-parport.ko 2023-07-12T01:39:29.827 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-07-12T01:39:29.828 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-07-12T01:39:29.828 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-07-12T01:39:29.828 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-07-12T01:39:29.828 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-07-12T01:39:29.828 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-07-12T01:39:29.828 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-via.ko 2023-07-12T01:39:29.828 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-07-12T01:39:29.828 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-07-12T01:39:29.829 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-dev.ko 2023-07-12T01:39:29.829 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-mux.ko 2023-07-12T01:39:29.829 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-07-12T01:39:29.829 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-smbus.ko 2023-07-12T01:39:29.829 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-stub.ko 2023-07-12T01:39:29.829 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband 2023-07-12T01:39:29.829 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core 2023-07-12T01:39:29.829 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_cm.ko 2023-07-12T01:39:29.830 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_core.ko 2023-07-12T01:39:29.830 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_umad.ko 2023-07-12T01:39:29.830 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-07-12T01:39:29.830 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/iw_cm.ko 2023-07-12T01:39:29.830 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/rdma_cm.ko 2023-07-12T01:39:29.830 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-07-12T01:39:29.830 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw 2023-07-12T01:39:29.831 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/cxgb4 2023-07-12T01:39:29.831 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-07-12T01:39:29.831 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx4 2023-07-12T01:39:29.831 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-07-12T01:39:29.831 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx5 2023-07-12T01:39:29.831 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-07-12T01:39:29.831 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mthca 2023-07-12T01:39:29.832 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-07-12T01:39:29.832 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp 2023-07-12T01:39:29.832 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/ipoib 2023-07-12T01:39:29.832 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-07-12T01:39:29.832 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/iser 2023-07-12T01:39:29.832 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-07-12T01:39:29.832 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/isert 2023-07-12T01:39:29.832 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-07-12T01:39:29.833 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srp 2023-07-12T01:39:29.833 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-07-12T01:39:29.833 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srpt 2023-07-12T01:39:29.833 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-07-12T01:39:29.833 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input 2023-07-12T01:39:29.833 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport 2023-07-12T01:39:29.833 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-07-12T01:39:29.833 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/fm801-gp.ko 2023-07-12T01:39:29.834 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/gameport.ko 2023-07-12T01:39:29.834 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/lightning.ko 2023-07-12T01:39:29.834 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/ns558.ko 2023-07-12T01:39:29.834 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/joydev.ko 2023-07-12T01:39:29.834 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard 2023-07-12T01:39:29.834 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/gpio_keys.ko 2023-07-12T01:39:29.834 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse 2023-07-12T01:39:29.835 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/appletouch.ko 2023-07-12T01:39:29.835 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/bcm5974.ko 2023-07-12T01:39:29.835 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/cyapatp.ko 2023-07-12T01:39:29.835 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/elan_i2c.ko 2023-07-12T01:39:29.835 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/sermouse.ko 2023-07-12T01:39:29.835 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-07-12T01:39:29.835 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/synaptics_usb.ko 2023-07-12T01:39:29.835 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/vsxxxaa.ko 2023-07-12T01:39:29.836 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/rmi4 2023-07-12T01:39:29.836 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/rmi4/rmi_core.ko 2023-07-12T01:39:29.836 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio 2023-07-12T01:39:29.836 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/altera_ps2.ko 2023-07-12T01:39:29.836 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/arc_ps2.ko 2023-07-12T01:39:29.836 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-07-12T01:39:29.836 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/serio_raw.ko 2023-07-12T01:39:29.836 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/sparse-keymap.ko 2023-07-12T01:39:29.837 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu 2023-07-12T01:39:29.837 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu/amd 2023-07-12T01:39:29.837 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu/amd/iommu_v2.ko 2023-07-12T01:39:29.837 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds 2023-07-12T01:39:29.837 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-blinkm.ko 2023-07-12T01:39:29.837 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lm3530.ko 2023-07-12T01:39:29.837 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lp3944.ko 2023-07-12T01:39:29.838 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-ss4200.ko 2023-07-12T01:39:29.838 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger 2023-07-12T01:39:29.838 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-07-12T01:39:29.838 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-07-12T01:39:29.838 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-07-12T01:39:29.838 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-07-12T01:39:29.838 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-07-12T01:39:29.838 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-07-12T01:39:29.839 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-07-12T01:39:29.839 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-07-12T01:39:29.839 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md 2023-07-12T01:39:29.839 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/bcache 2023-07-12T01:39:29.839 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/bcache/bcache.ko 2023-07-12T01:39:29.839 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-bio-prison.ko 2023-07-12T01:39:29.839 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-cache-smq.ko 2023-07-12T01:39:29.839 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-cache.ko 2023-07-12T01:39:29.840 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-crypt.ko 2023-07-12T01:39:29.840 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-delay.ko 2023-07-12T01:39:29.840 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-flakey.ko 2023-07-12T01:39:29.840 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-log-userspace.ko 2023-07-12T01:39:29.840 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-multipath.ko 2023-07-12T01:39:29.840 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-queue-length.ko 2023-07-12T01:39:29.840 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-raid.ko 2023-07-12T01:39:29.841 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-round-robin.ko 2023-07-12T01:39:29.841 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-service-time.ko 2023-07-12T01:39:29.841 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-switch.ko 2023-07-12T01:39:29.841 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-thin-pool.ko 2023-07-12T01:39:29.841 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-verity.ko 2023-07-12T01:39:29.841 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/faulty.ko 2023-07-12T01:39:29.841 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/linear.ko 2023-07-12T01:39:29.841 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/multipath.ko 2023-07-12T01:39:29.842 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/persistent-data 2023-07-12T01:39:29.842 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-07-12T01:39:29.842 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid0.ko 2023-07-12T01:39:29.842 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid1.ko 2023-07-12T01:39:29.842 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid10.ko 2023-07-12T01:39:29.842 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid456.ko 2023-07-12T01:39:29.842 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message 2023-07-12T01:39:29.842 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion 2023-07-12T01:39:29.843 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptbase.ko 2023-07-12T01:39:29.843 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptctl.ko 2023-07-12T01:39:29.843 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptfc.ko 2023-07-12T01:39:29.843 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptlan.ko 2023-07-12T01:39:29.843 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptsas.ko 2023-07-12T01:39:29.843 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptscsih.ko 2023-07-12T01:39:29.843 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptspi.ko 2023-07-12T01:39:29.844 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd 2023-07-12T01:39:29.844 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lpc_ich.ko 2023-07-12T01:39:29.844 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lpc_sch.ko 2023-07-12T01:39:29.844 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/mfd-core.ko 2023-07-12T01:39:29.844 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/sm501.ko 2023-07-12T01:39:29.844 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/viperboard.ko 2023-07-12T01:39:29.844 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/vx855.ko 2023-07-12T01:39:29.844 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/wl1273-core.ko 2023-07-12T01:39:29.845 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc 2023-07-12T01:39:29.845 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/altera-stapl 2023-07-12T01:39:29.845 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-07-12T01:39:29.845 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/apds9802als.ko 2023-07-12T01:39:29.845 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/apds990x.ko 2023-07-12T01:39:29.845 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/bh1770glc.ko 2023-07-12T01:39:29.845 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/cb710 2023-07-12T01:39:29.846 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/cb710/cb710.ko 2023-07-12T01:39:29.846 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom 2023-07-12T01:39:29.846 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/at24.ko 2023-07-12T01:39:29.846 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/eeprom.ko 2023-07-12T01:39:29.846 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-07-12T01:39:29.846 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/max6875.ko 2023-07-12T01:39:29.846 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/enclosure.ko 2023-07-12T01:39:29.846 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/hpilo.ko 2023-07-12T01:39:29.847 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/isl29003.ko 2023-07-12T01:39:29.847 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/isl29020.ko 2023-07-12T01:39:29.847 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d 2023-07-12T01:39:29.847 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-07-12T01:39:29.847 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-07-12T01:39:29.847 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei 2023-07-12T01:39:29.847 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei-me.ko 2023-07-12T01:39:29.848 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei-txe.ko 2023-07-12T01:39:29.848 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei.ko 2023-07-12T01:39:29.848 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-gru 2023-07-12T01:39:29.848 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-gru/gru.ko 2023-07-12T01:39:29.848 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-xp 2023-07-12T01:39:29.848 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-xp/xp.ko 2023-07-12T01:39:29.848 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-xp/xpc.ko 2023-07-12T01:39:29.848 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-07-12T01:39:29.849 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tifm_7xx1.ko 2023-07-12T01:39:29.849 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tifm_core.ko 2023-07-12T01:39:29.849 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tsl2550.ko 2023-07-12T01:39:29.849 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_balloon.ko 2023-07-12T01:39:29.849 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_vmci 2023-07-12T01:39:29.849 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-07-12T01:39:29.849 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net 2023-07-12T01:39:29.849 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/bonding 2023-07-12T01:39:29.850 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/bonding/bonding.ko 2023-07-12T01:39:29.850 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa 2023-07-12T01:39:29.850 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/b53 2023-07-12T01:39:29.850 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/b53/b53_common.ko 2023-07-12T01:39:29.850 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/bcm-sf2.ko 2023-07-12T01:39:29.850 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6060.ko 2023-07-12T01:39:29.850 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6xxx 2023-07-12T01:39:29.851 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-07-12T01:39:29.851 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dummy.ko 2023-07-12T01:39:29.851 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/eql.ko 2023-07-12T01:39:29.851 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet 2023-07-12T01:39:29.851 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com 2023-07-12T01:39:29.851 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-07-12T01:39:29.851 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-07-12T01:39:29.851 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-07-12T01:39:29.852 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-07-12T01:39:29.852 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390 2023-07-12T01:39:29.852 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/8390.ko 2023-07-12T01:39:29.852 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-07-12T01:39:29.852 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-07-12T01:39:29.852 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-07-12T01:39:29.852 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/adaptec 2023-07-12T01:39:29.853 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-07-12T01:39:29.853 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/agere 2023-07-12T01:39:29.853 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/agere/et131x.ko 2023-07-12T01:39:29.853 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/alteon 2023-07-12T01:39:29.853 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-07-12T01:39:29.853 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/altera 2023-07-12T01:39:29.853 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-07-12T01:39:29.853 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd 2023-07-12T01:39:29.854 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-07-12T01:39:29.854 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-07-12T01:39:29.854 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-07-12T01:39:29.854 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros 2023-07-12T01:39:29.854 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/alx 2023-07-12T01:39:29.854 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-07-12T01:39:29.854 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1c 2023-07-12T01:39:29.854 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-07-12T01:39:29.855 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1e 2023-07-12T01:39:29.855 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-07-12T01:39:29.855 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx 2023-07-12T01:39:29.855 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-07-12T01:39:29.855 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-07-12T01:39:29.856 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom 2023-07-12T01:39:29.856 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-07-12T01:39:29.856 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-07-12T01:39:29.856 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-07-12T01:39:29.856 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-07-12T01:39:29.856 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-07-12T01:39:29.856 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/genet 2023-07-12T01:39:29.857 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-07-12T01:39:29.857 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-07-12T01:39:29.857 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade 2023-07-12T01:39:29.857 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade/bna 2023-07-12T01:39:29.857 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-07-12T01:39:29.857 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio 2023-07-12T01:39:29.857 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb 2023-07-12T01:39:29.857 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-07-12T01:39:29.858 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-07-12T01:39:29.858 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-07-12T01:39:29.858 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-07-12T01:39:29.858 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-07-12T01:39:29.858 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-07-12T01:39:29.858 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-07-12T01:39:29.858 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-07-12T01:39:29.859 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-07-12T01:39:29.859 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco 2023-07-12T01:39:29.859 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco/enic 2023-07-12T01:39:29.859 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-07-12T01:39:29.859 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec 2023-07-12T01:39:29.859 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip 2023-07-12T01:39:29.859 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-07-12T01:39:29.859 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-07-12T01:39:29.860 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-07-12T01:39:29.860 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-07-12T01:39:29.860 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-07-12T01:39:29.860 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-07-12T01:39:29.860 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink 2023-07-12T01:39:29.860 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-07-12T01:39:29.860 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-07-12T01:39:29.860 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dnet.ko 2023-07-12T01:39:29.861 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex 2023-07-12T01:39:29.861 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex/benet 2023-07-12T01:39:29.861 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-07-12T01:39:29.861 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ethoc.ko 2023-07-12T01:39:29.861 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/fealnx.ko 2023-07-12T01:39:29.861 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel 2023-07-12T01:39:29.861 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e100.ko 2023-07-12T01:39:29.862 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000 2023-07-12T01:39:29.862 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-07-12T01:39:29.862 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000e 2023-07-12T01:39:29.862 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-07-12T01:39:29.862 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/fm10k 2023-07-12T01:39:29.862 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-07-12T01:39:29.862 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/i40e 2023-07-12T01:39:29.862 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-07-12T01:39:29.863 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/iavf 2023-07-12T01:39:29.863 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-07-12T01:39:29.863 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igb 2023-07-12T01:39:29.863 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-07-12T01:39:29.863 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igbvf 2023-07-12T01:39:29.863 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-07-12T01:39:29.863 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbe 2023-07-12T01:39:29.864 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-07-12T01:39:29.864 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbevf 2023-07-12T01:39:29.864 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-07-12T01:39:29.864 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/jme.ko 2023-07-12T01:39:29.864 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell 2023-07-12T01:39:29.864 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-07-12T01:39:29.864 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/skge.ko 2023-07-12T01:39:29.864 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-07-12T01:39:29.865 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox 2023-07-12T01:39:29.865 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4 2023-07-12T01:39:29.865 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-07-12T01:39:29.865 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-07-12T01:39:29.865 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5 2023-07-12T01:39:29.865 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-07-12T01:39:29.865 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-07-12T01:39:29.865 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel 2023-07-12T01:39:29.866 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-07-12T01:39:29.866 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom 2023-07-12T01:39:29.866 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom/myri10ge 2023-07-12T01:39:29.866 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-07-12T01:39:29.866 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi 2023-07-12T01:39:29.866 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-07-12T01:39:29.866 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-07-12T01:39:29.867 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/neterion 2023-07-12T01:39:29.867 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-07-12T01:39:29.867 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/nvidia 2023-07-12T01:39:29.867 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-07-12T01:39:29.867 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines 2023-07-12T01:39:29.867 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-07-12T01:39:29.867 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-07-12T01:39:29.867 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic 2023-07-12T01:39:29.868 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/netxen 2023-07-12T01:39:29.868 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-07-12T01:39:29.868 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-07-12T01:39:29.868 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-07-12T01:39:29.868 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-07-12T01:39:29.868 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rdc 2023-07-12T01:39:29.868 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-07-12T01:39:29.868 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek 2023-07-12T01:39:29.869 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-07-12T01:39:29.869 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-07-12T01:39:29.869 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/atp.ko 2023-07-12T01:39:29.869 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-07-12T01:39:29.869 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rocker 2023-07-12T01:39:29.869 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-07-12T01:39:29.869 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sfc 2023-07-12T01:39:29.870 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-07-12T01:39:29.870 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/silan 2023-07-12T01:39:29.870 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-07-12T01:39:29.870 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis 2023-07-12T01:39:29.870 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis/sis190.ko 2023-07-12T01:39:29.870 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis/sis900.ko 2023-07-12T01:39:29.870 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc 2023-07-12T01:39:29.870 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-07-12T01:39:29.871 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-07-12T01:39:29.871 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-07-12T01:39:29.871 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-07-12T01:39:29.871 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro 2023-07-12T01:39:29.871 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac 2023-07-12T01:39:29.871 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-07-12T01:39:29.871 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-07-12T01:39:29.871 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun 2023-07-12T01:39:29.872 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/cassini.ko 2023-07-12T01:39:29.872 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/niu.ko 2023-07-12T01:39:29.872 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/sungem.ko 2023-07-12T01:39:29.872 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-07-12T01:39:29.872 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/tehuti 2023-07-12T01:39:29.872 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-07-12T01:39:29.872 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ti 2023-07-12T01:39:29.873 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ti/tlan.ko 2023-07-12T01:39:29.873 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via 2023-07-12T01:39:29.873 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-07-12T01:39:29.873 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-07-12T01:39:29.873 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet 2023-07-12T01:39:29.873 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-07-12T01:39:29.873 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-07-12T01:39:29.873 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/xircom 2023-07-12T01:39:29.874 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-07-12T01:39:29.874 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/geneve.ko 2023-07-12T01:39:29.874 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/hyperv 2023-07-12T01:39:29.874 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-07-12T01:39:29.874 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ieee802154 2023-07-12T01:39:29.874 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ieee802154/fakelb.ko 2023-07-12T01:39:29.874 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ifb.ko 2023-07-12T01:39:29.874 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ipvlan 2023-07-12T01:39:29.875 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ipvlan/ipvlan.ko 2023-07-12T01:39:29.875 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/macvlan.ko 2023-07-12T01:39:29.875 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/macvtap.ko 2023-07-12T01:39:29.875 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio 2023-07-12T01:39:29.875 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio.ko 2023-07-12T01:39:29.875 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-07-12T01:39:29.875 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-07-12T01:39:29.876 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mii.ko 2023-07-12T01:39:29.876 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/net_failover.ko 2023-07-12T01:39:29.876 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/netconsole.ko 2023-07-12T01:39:29.876 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/nlmon.ko 2023-07-12T01:39:29.876 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs 2023-07-12T01:39:29.877 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-07-12T01:39:29.877 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-07-12T01:39:29.877 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy 2023-07-12T01:39:29.877 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/amd.ko 2023-07-12T01:39:29.877 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-07-12T01:39:29.877 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-07-12T01:39:29.877 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm7xxx.ko 2023-07-12T01:39:29.877 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm87xx.ko 2023-07-12T01:39:29.878 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/broadcom.ko 2023-07-12T01:39:29.878 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/cicada.ko 2023-07-12T01:39:29.878 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/davicom.ko 2023-07-12T01:39:29.878 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/dp83640.ko 2023-07-12T01:39:29.878 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/et1011c.ko 2023-07-12T01:39:29.878 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/icplus.ko 2023-07-12T01:39:29.878 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/lxt.ko 2023-07-12T01:39:29.879 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/marvell.ko 2023-07-12T01:39:29.879 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/micrel.ko 2023-07-12T01:39:29.879 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/national.ko 2023-07-12T01:39:29.879 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/phylink.ko 2023-07-12T01:39:29.879 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/qsemi.ko 2023-07-12T01:39:29.879 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/realtek.ko 2023-07-12T01:39:29.879 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/smsc.ko 2023-07-12T01:39:29.879 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/ste10Xp.ko 2023-07-12T01:39:29.880 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/vitesse.ko 2023-07-12T01:39:29.880 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp 2023-07-12T01:39:29.880 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/bsd_comp.ko 2023-07-12T01:39:29.880 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_async.ko 2023-07-12T01:39:29.880 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_deflate.ko 2023-07-12T01:39:29.880 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_generic.ko 2023-07-12T01:39:29.880 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_mppe.ko 2023-07-12T01:39:29.880 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_synctty.ko 2023-07-12T01:39:29.881 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pppoe.ko 2023-07-12T01:39:29.881 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pppox.ko 2023-07-12T01:39:29.881 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pptp.ko 2023-07-12T01:39:29.881 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/slip 2023-07-12T01:39:29.881 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/slip/slhc.ko 2023-07-12T01:39:29.881 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/slip/slip.ko 2023-07-12T01:39:29.881 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/sungem_phy.ko 2023-07-12T01:39:29.881 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/tap.ko 2023-07-12T01:39:29.882 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team 2023-07-12T01:39:29.882 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team.ko 2023-07-12T01:39:29.882 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_activebackup.ko 2023-07-12T01:39:29.882 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_broadcast.ko 2023-07-12T01:39:29.882 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-07-12T01:39:29.882 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_random.ko 2023-07-12T01:39:29.882 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-07-12T01:39:29.883 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/tun.ko 2023-07-12T01:39:29.883 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/veth.ko 2023-07-12T01:39:29.883 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/virtio_net.ko 2023-07-12T01:39:29.883 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vmxnet3 2023-07-12T01:39:29.883 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-07-12T01:39:29.883 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vxlan 2023-07-12T01:39:29.883 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vxlan/vxlan.ko 2023-07-12T01:39:29.883 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/xen-netback 2023-07-12T01:39:29.884 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/xen-netback/xen-netback.ko 2023-07-12T01:39:29.884 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/xen-netfront.ko 2023-07-12T01:39:29.884 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ntb 2023-07-12T01:39:29.884 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ntb/ntb.ko 2023-07-12T01:39:29.884 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme 2023-07-12T01:39:29.884 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host 2023-07-12T01:39:29.884 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host/nvme-core.ko 2023-07-12T01:39:29.885 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host/nvme.ko 2023-07-12T01:39:29.885 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport 2023-07-12T01:39:29.885 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport.ko 2023-07-12T01:39:29.885 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_cs.ko 2023-07-12T01:39:29.885 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_pc.ko 2023-07-12T01:39:29.885 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_serial.ko 2023-07-12T01:39:29.885 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci 2023-07-12T01:39:29.885 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/hotplug 2023-07-12T01:39:29.886 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-07-12T01:39:29.886 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/pcie 2023-07-12T01:39:29.886 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/pcie/aer_inject.ko 2023-07-12T01:39:29.886 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/xen-pcifront.ko 2023-07-12T01:39:29.886 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia 2023-07-12T01:39:29.886 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/i82092.ko 2023-07-12T01:39:29.886 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/pd6729.ko 2023-07-12T01:39:29.886 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/yenta_socket.ko 2023-07-12T01:39:29.887 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl 2023-07-12T01:39:29.887 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl/intel 2023-07-12T01:39:29.887 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-07-12T01:39:29.887 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform 2023-07-12T01:39:29.887 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86 2023-07-12T01:39:29.887 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/acer-wmi.ko 2023-07-12T01:39:29.887 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/acerhdf.ko 2023-07-12T01:39:29.887 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/apple-gmux.ko 2023-07-12T01:39:29.888 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-laptop.ko 2023-07-12T01:39:29.888 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-07-12T01:39:29.888 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-wmi.ko 2023-07-12T01:39:29.888 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/classmate-laptop.ko 2023-07-12T01:39:29.888 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-07-12T01:39:29.888 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-07-12T01:39:29.888 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-07-12T01:39:29.889 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-07-12T01:39:29.889 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/hdaps.ko 2023-07-12T01:39:29.889 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel 2023-07-12T01:39:29.889 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-07-12T01:39:29.889 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel_ips.ko 2023-07-12T01:39:29.889 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/msi-wmi.ko 2023-07-12T01:39:29.889 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/mxm-wmi.ko 2023-07-12T01:39:29.889 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-07-12T01:39:29.890 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/samsung-laptop.ko 2023-07-12T01:39:29.890 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/samsung-q10.ko 2023-07-12T01:39:29.890 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/topstar-laptop.ko 2023-07-12T01:39:29.890 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-07-12T01:39:29.890 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/toshiba_haps.ko 2023-07-12T01:39:29.890 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/wmi-bmof.ko 2023-07-12T01:39:29.890 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/wmi.ko 2023-07-12T01:39:29.890 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap 2023-07-12T01:39:29.891 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap/intel_rapl_common.ko 2023-07-12T01:39:29.891 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap/intel_rapl_msr.ko 2023-07-12T01:39:29.891 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps 2023-07-12T01:39:29.891 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients 2023-07-12T01:39:29.891 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps-gpio.ko 2023-07-12T01:39:29.891 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps-ldisc.ko 2023-07-12T01:39:29.891 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps_parport.ko 2023-07-12T01:39:29.892 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/pps_core.ko 2023-07-12T01:39:29.892 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp 2023-07-12T01:39:29.892 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp/ptp.ko 2023-07-12T01:39:29.892 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp/ptp_kvm.ko 2023-07-12T01:39:29.892 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc 2023-07-12T01:39:29.892 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-bq32k.ko 2023-07-12T01:39:29.892 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-bq4802.ko 2023-07-12T01:39:29.892 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1286.ko 2023-07-12T01:39:29.893 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1307.ko 2023-07-12T01:39:29.893 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1374.ko 2023-07-12T01:39:29.893 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1511.ko 2023-07-12T01:39:29.893 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1553.ko 2023-07-12T01:39:29.893 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1672.ko 2023-07-12T01:39:29.893 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1742.ko 2023-07-12T01:39:29.893 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds2404.ko 2023-07-12T01:39:29.893 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds3232.ko 2023-07-12T01:39:29.894 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-em3027.ko 2023-07-12T01:39:29.894 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-fm3130.ko 2023-07-12T01:39:29.894 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-isl12022.ko 2023-07-12T01:39:29.894 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-isl1208.ko 2023-07-12T01:39:29.894 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m41t80.ko 2023-07-12T01:39:29.894 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m48t35.ko 2023-07-12T01:39:29.894 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m48t59.ko 2023-07-12T01:39:29.894 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-max6900.ko 2023-07-12T01:39:29.895 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-msm6242.ko 2023-07-12T01:39:29.895 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf2127.ko 2023-07-12T01:39:29.895 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf85063.ko 2023-07-12T01:39:29.895 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8523.ko 2023-07-12T01:39:29.895 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8563.ko 2023-07-12T01:39:29.895 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8583.ko 2023-07-12T01:39:29.895 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rp5c01.ko 2023-07-12T01:39:29.896 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rs5c372.ko 2023-07-12T01:39:29.896 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-07-12T01:39:29.896 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rx8025.ko 2023-07-12T01:39:29.896 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rx8581.ko 2023-07-12T01:39:29.896 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-07-12T01:39:29.896 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-x1205.ko 2023-07-12T01:39:29.896 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi 2023-07-12T01:39:29.896 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-9xxx.ko 2023-07-12T01:39:29.897 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-sas.ko 2023-07-12T01:39:29.897 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-xxxx.ko 2023-07-12T01:39:29.897 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/BusLogic.ko 2023-07-12T01:39:29.897 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/a100u2w.ko 2023-07-12T01:39:29.897 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aacraid 2023-07-12T01:39:29.897 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aacraid/aacraid.ko 2023-07-12T01:39:29.897 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/advansys.ko 2023-07-12T01:39:29.897 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx 2023-07-12T01:39:29.898 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-07-12T01:39:29.898 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-07-12T01:39:29.898 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/am53c974.ko 2023-07-12T01:39:29.898 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/arcmsr 2023-07-12T01:39:29.898 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-07-12T01:39:29.898 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/atp870u.ko 2023-07-12T01:39:29.898 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/be2iscsi 2023-07-12T01:39:29.898 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-07-12T01:39:29.899 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bfa 2023-07-12T01:39:29.899 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bfa/bfa.ko 2023-07-12T01:39:29.899 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2fc 2023-07-12T01:39:29.899 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-07-12T01:39:29.899 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2i 2023-07-12T01:39:29.899 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-07-12T01:39:29.899 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ch.ko 2023-07-12T01:39:29.899 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/csiostor 2023-07-12T01:39:29.900 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/csiostor/csiostor.ko 2023-07-12T01:39:29.900 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi 2023-07-12T01:39:29.900 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb3i 2023-07-12T01:39:29.900 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-07-12T01:39:29.900 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb4i 2023-07-12T01:39:29.900 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-07-12T01:39:29.900 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-07-12T01:39:29.901 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/dc395x.ko 2023-07-12T01:39:29.901 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler 2023-07-12T01:39:29.901 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-07-12T01:39:29.901 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-07-12T01:39:29.901 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-07-12T01:39:29.901 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-07-12T01:39:29.901 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/dmx3191d.ko 2023-07-12T01:39:29.901 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esas2r 2023-07-12T01:39:29.902 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esas2r/esas2r.ko 2023-07-12T01:39:29.902 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esp_scsi.ko 2023-07-12T01:39:29.902 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe 2023-07-12T01:39:29.902 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe/fcoe.ko 2023-07-12T01:39:29.902 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-07-12T01:39:29.902 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fnic 2023-07-12T01:39:29.902 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fnic/fnic.ko 2023-07-12T01:39:29.902 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hpsa.ko 2023-07-12T01:39:29.903 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hptiop.ko 2023-07-12T01:39:29.903 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hv_storvsc.ko 2023-07-12T01:39:29.903 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/initio.ko 2023-07-12T01:39:29.903 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ipr.ko 2023-07-12T01:39:29.903 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ips.ko 2023-07-12T01:39:29.903 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/isci 2023-07-12T01:39:29.903 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/isci/isci.ko 2023-07-12T01:39:29.903 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-07-12T01:39:29.904 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/iscsi_tcp.ko 2023-07-12T01:39:29.904 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libfc 2023-07-12T01:39:29.904 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libfc/libfc.ko 2023-07-12T01:39:29.904 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libiscsi.ko 2023-07-12T01:39:29.904 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libiscsi_tcp.ko 2023-07-12T01:39:29.904 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libsas 2023-07-12T01:39:29.904 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libsas/libsas.ko 2023-07-12T01:39:29.904 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/lpfc 2023-07-12T01:39:29.905 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/lpfc/lpfc.ko 2023-07-12T01:39:29.905 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid 2023-07-12T01:39:29.905 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid.ko 2023-07-12T01:39:29.905 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-07-12T01:39:29.905 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-07-12T01:39:29.905 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-07-12T01:39:29.905 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mpt3sas 2023-07-12T01:39:29.905 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-07-12T01:39:29.906 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvsas 2023-07-12T01:39:29.906 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvsas/mvsas.ko 2023-07-12T01:39:29.906 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvumi.ko 2023-07-12T01:39:29.906 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pm8001 2023-07-12T01:39:29.906 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-07-12T01:39:29.906 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pmcraid.ko 2023-07-12T01:39:29.906 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla1280.ko 2023-07-12T01:39:29.906 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx 2023-07-12T01:39:29.907 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-07-12T01:39:29.907 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-07-12T01:39:29.907 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla4xxx 2023-07-12T01:39:29.907 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-07-12T01:39:29.907 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/raid_class.ko 2023-07-12T01:39:29.907 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_debug.ko 2023-07-12T01:39:29.907 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_fc.ko 2023-07-12T01:39:29.908 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-07-12T01:39:29.908 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_sas.ko 2023-07-12T01:39:29.908 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_spi.ko 2023-07-12T01:39:29.908 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_srp.ko 2023-07-12T01:39:29.908 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ses.ko 2023-07-12T01:39:29.908 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/st.ko 2023-07-12T01:39:29.908 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/stex.ko 2023-07-12T01:39:29.908 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/sym53c8xx_2 2023-07-12T01:39:29.909 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-07-12T01:39:29.909 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/virtio_scsi.ko 2023-07-12T01:39:29.909 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/vmw_pvscsi.ko 2023-07-12T01:39:29.909 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/wd719x.ko 2023-07-12T01:39:29.909 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ssb 2023-07-12T01:39:29.909 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ssb/ssb.ko 2023-07-12T01:39:29.909 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target 2023-07-12T01:39:29.910 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/iscsi 2023-07-12T01:39:29.910 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-07-12T01:39:29.910 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/loopback 2023-07-12T01:39:29.910 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/loopback/tcm_loop.ko 2023-07-12T01:39:29.910 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_file.ko 2023-07-12T01:39:29.910 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_iblock.ko 2023-07-12T01:39:29.910 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_mod.ko 2023-07-12T01:39:29.910 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_pscsi.ko 2023-07-12T01:39:29.911 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_user.ko 2023-07-12T01:39:29.911 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/tcm_fc 2023-07-12T01:39:29.911 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-07-12T01:39:29.911 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal 2023-07-12T01:39:29.911 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel 2023-07-12T01:39:29.911 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal 2023-07-12T01:39:29.911 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-07-12T01:39:29.911 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-07-12T01:39:29.912 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-07-12T01:39:29.912 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-07-12T01:39:29.912 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-07-12T01:39:29.912 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-07-12T01:39:29.912 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-07-12T01:39:29.912 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-07-12T01:39:29.912 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-07-12T01:39:29.912 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-07-12T01:39:29.913 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-07-12T01:39:29.913 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-07-12T01:39:29.913 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-07-12T01:39:29.913 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-07-12T01:39:29.913 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-07-12T01:39:29.913 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty 2023-07-12T01:39:29.913 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/ipwireless 2023-07-12T01:39:29.914 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-07-12T01:39:29.914 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/n_gsm.ko 2023-07-12T01:39:29.914 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/n_hdlc.ko 2023-07-12T01:39:29.914 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/nozomi.ko 2023-07-12T01:39:29.914 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial 2023-07-12T01:39:29.914 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/8250 2023-07-12T01:39:29.914 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-07-12T01:39:29.914 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/arc_uart.ko 2023-07-12T01:39:29.915 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/jsm 2023-07-12T01:39:29.915 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/jsm/jsm.ko 2023-07-12T01:39:29.915 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/synclink_gt.ko 2023-07-12T01:39:29.915 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs 2023-07-12T01:39:29.915 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/core 2023-07-12T01:39:29.915 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/core/ufshcd-core.ko 2023-07-12T01:39:29.915 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/host 2023-07-12T01:39:29.915 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-07-12T01:39:29.916 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio 2023-07-12T01:39:29.916 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio.ko 2023-07-12T01:39:29.916 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_aec.ko 2023-07-12T01:39:29.916 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_cif.ko 2023-07-12T01:39:29.916 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_pci_generic.ko 2023-07-12T01:39:29.916 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_sercos3.ko 2023-07-12T01:39:29.916 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb 2023-07-12T01:39:29.917 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class 2023-07-12T01:39:29.917 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/cdc-acm.ko 2023-07-12T01:39:29.917 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/cdc-wdm.ko 2023-07-12T01:39:29.917 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/usblp.ko 2023-07-12T01:39:29.917 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/usbtmc.ko 2023-07-12T01:39:29.917 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host 2023-07-12T01:39:29.917 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/sl811-hcd.ko 2023-07-12T01:39:29.917 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image 2023-07-12T01:39:29.918 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image/mdc800.ko 2023-07-12T01:39:29.918 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image/microtek.ko 2023-07-12T01:39:29.918 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc 2023-07-12T01:39:29.918 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/adutux.ko 2023-07-12T01:39:29.918 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/appledisplay.ko 2023-07-12T01:39:29.918 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/emi26.ko 2023-07-12T01:39:29.918 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/emi62.ko 2023-07-12T01:39:29.918 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/ezusb.ko 2023-07-12T01:39:29.919 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/idmouse.ko 2023-07-12T01:39:29.919 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/iowarrior.ko 2023-07-12T01:39:29.919 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/isight_firmware.ko 2023-07-12T01:39:29.919 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/ldusb.ko 2023-07-12T01:39:29.919 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/legousbtower.ko 2023-07-12T01:39:29.919 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/sisusbvga 2023-07-12T01:39:29.919 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-07-12T01:39:29.919 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/trancevibrator.ko 2023-07-12T01:39:29.920 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usb3503.ko 2023-07-12T01:39:29.920 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usblcd.ko 2023-07-12T01:39:29.920 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usbsevseg.ko 2023-07-12T01:39:29.920 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/uss720.ko 2023-07-12T01:39:29.920 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/yurex.ko 2023-07-12T01:39:29.920 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy 2023-07-12T01:39:29.920 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy/phy-generic.ko 2023-07-12T01:39:29.921 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial 2023-07-12T01:39:29.921 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/aircable.ko 2023-07-12T01:39:29.921 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ark3116.ko 2023-07-12T01:39:29.921 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/belkin_sa.ko 2023-07-12T01:39:29.921 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ch341.ko 2023-07-12T01:39:29.921 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cp210x.ko 2023-07-12T01:39:29.921 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cyberjack.ko 2023-07-12T01:39:29.921 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cypress_m8.ko 2023-07-12T01:39:29.922 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/digi_acceleport.ko 2023-07-12T01:39:29.922 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/empeg.ko 2023-07-12T01:39:29.922 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ftdi_sio.ko 2023-07-12T01:39:29.922 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/garmin_gps.ko 2023-07-12T01:39:29.922 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/io_edgeport.ko 2023-07-12T01:39:29.922 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/io_ti.ko 2023-07-12T01:39:29.922 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ipaq.ko 2023-07-12T01:39:29.922 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ipw.ko 2023-07-12T01:39:29.923 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ir-usb.ko 2023-07-12T01:39:29.923 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-07-12T01:39:29.923 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/keyspan.ko 2023-07-12T01:39:29.923 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/keyspan_pda.ko 2023-07-12T01:39:29.923 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/kl5kusb105.ko 2023-07-12T01:39:29.923 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/kobil_sct.ko 2023-07-12T01:39:29.923 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mct_u232.ko 2023-07-12T01:39:29.923 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mos7720.ko 2023-07-12T01:39:29.924 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mos7840.ko 2023-07-12T01:39:29.924 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/navman.ko 2023-07-12T01:39:29.924 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/omninet.ko 2023-07-12T01:39:29.924 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/opticon.ko 2023-07-12T01:39:29.924 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/option.ko 2023-07-12T01:39:29.924 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/oti6858.ko 2023-07-12T01:39:29.924 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/pl2303.ko 2023-07-12T01:39:29.925 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/qcaux.ko 2023-07-12T01:39:29.925 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/qcserial.ko 2023-07-12T01:39:29.925 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/quatech2.ko 2023-07-12T01:39:29.925 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/safe_serial.ko 2023-07-12T01:39:29.925 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/sierra.ko 2023-07-12T01:39:29.925 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/spcp8x5.ko 2023-07-12T01:39:29.925 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ssu100.ko 2023-07-12T01:39:29.925 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/symbolserial.ko 2023-07-12T01:39:29.926 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-07-12T01:39:29.926 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-07-12T01:39:29.926 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb_debug.ko 2023-07-12T01:39:29.926 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb_wwan.ko 2023-07-12T01:39:29.926 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/visor.ko 2023-07-12T01:39:29.926 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/whiteheat.ko 2023-07-12T01:39:29.926 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/xsens_mt.ko 2023-07-12T01:39:29.926 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage 2023-07-12T01:39:29.927 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/uas.ko 2023-07-12T01:39:29.927 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-alauda.ko 2023-07-12T01:39:29.927 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-cypress.ko 2023-07-12T01:39:29.927 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-datafab.ko 2023-07-12T01:39:29.927 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-07-12T01:39:29.927 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-freecom.ko 2023-07-12T01:39:29.927 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-isd200.ko 2023-07-12T01:39:29.927 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-07-12T01:39:29.928 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-karma.ko 2023-07-12T01:39:29.928 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-onetouch.ko 2023-07-12T01:39:29.928 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-realtek.ko 2023-07-12T01:39:29.928 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-sddr09.ko 2023-07-12T01:39:29.928 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-sddr55.ko 2023-07-12T01:39:29.928 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-usbat.ko 2023-07-12T01:39:29.928 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/usb-storage.ko 2023-07-12T01:39:29.928 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip 2023-07-12T01:39:29.929 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/usbip-core.ko 2023-07-12T01:39:29.929 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/usbip-host.ko 2023-07-12T01:39:29.929 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-07-12T01:39:29.929 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio 2023-07-12T01:39:29.929 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci 2023-07-12T01:39:29.929 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-07-12T01:39:29.929 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci/vfio-pci.ko 2023-07-12T01:39:29.930 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/vfio.ko 2023-07-12T01:39:29.930 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-07-12T01:39:29.930 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost 2023-07-12T01:39:29.930 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost.ko 2023-07-12T01:39:29.930 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_iotlb.ko 2023-07-12T01:39:29.930 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_net.ko 2023-07-12T01:39:29.930 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_scsi.ko 2023-07-12T01:39:29.930 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video 2023-07-12T01:39:29.931 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight 2023-07-12T01:39:29.931 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/apple_bl.ko 2023-07-12T01:39:29.931 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/lcd.ko 2023-07-12T01:39:29.931 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/platform_lcd.ko 2023-07-12T01:39:29.931 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio 2023-07-12T01:39:29.931 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio.ko 2023-07-12T01:39:29.931 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_balloon.ko 2023-07-12T01:39:29.931 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_mmio.ko 2023-07-12T01:39:29.932 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_pci.ko 2023-07-12T01:39:29.932 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-07-12T01:39:29.932 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-07-12T01:39:29.932 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_ring.ko 2023-07-12T01:39:29.932 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1 2023-07-12T01:39:29.932 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters 2023-07-12T01:39:29.932 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/ds2482.ko 2023-07-12T01:39:29.933 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/ds2490.ko 2023-07-12T01:39:29.933 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves 2023-07-12T01:39:29.933 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-07-12T01:39:29.933 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-07-12T01:39:29.933 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-07-12T01:39:29.933 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-07-12T01:39:29.933 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-07-12T01:39:29.933 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-07-12T01:39:29.934 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-07-12T01:39:29.934 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-07-12T01:39:29.934 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-07-12T01:39:29.934 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_smem.ko 2023-07-12T01:39:29.934 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_therm.ko 2023-07-12T01:39:29.934 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/wire.ko 2023-07-12T01:39:29.934 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog 2023-07-12T01:39:29.934 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/alim1535_wdt.ko 2023-07-12T01:39:29.935 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/alim7101_wdt.ko 2023-07-12T01:39:29.935 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/f71808e_wdt.ko 2023-07-12T01:39:29.935 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/hpwdt.ko 2023-07-12T01:39:29.935 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/i6300esb.ko 2023-07-12T01:39:29.935 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-07-12T01:39:29.935 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/iTCO_wdt.ko 2023-07-12T01:39:29.935 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ib700wdt.ko 2023-07-12T01:39:29.935 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ibmasr.ko 2023-07-12T01:39:29.936 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-07-12T01:39:29.936 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/it8712f_wdt.ko 2023-07-12T01:39:29.936 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/it87_wdt.ko 2023-07-12T01:39:29.936 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/machzwd.ko 2023-07-12T01:39:29.936 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/nv_tco.ko 2023-07-12T01:39:29.937 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/pcwd_pci.ko 2023-07-12T01:39:29.937 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/pcwd_usb.ko 2023-07-12T01:39:29.937 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-07-12T01:39:29.937 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sch311x_wdt.ko 2023-07-12T01:39:29.938 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/softdog.ko 2023-07-12T01:39:29.938 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sp5100_tco.ko 2023-07-12T01:39:29.938 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/via_wdt.ko 2023-07-12T01:39:29.938 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-07-12T01:39:29.939 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83877f_wdt.ko 2023-07-12T01:39:29.939 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83977f_wdt.ko 2023-07-12T01:39:29.939 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/wdt_pci.ko 2023-07-12T01:39:29.940 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/xen_wdt.ko 2023-07-12T01:39:29.940 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen 2023-07-12T01:39:29.940 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-acpi-processor.ko 2023-07-12T01:39:29.940 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-evtchn.ko 2023-07-12T01:39:29.941 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-gntalloc.ko 2023-07-12T01:39:29.941 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-gntdev.ko 2023-07-12T01:39:29.941 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-pciback 2023-07-12T01:39:29.941 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-07-12T01:39:29.942 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-privcmd.ko 2023-07-12T01:39:29.942 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xenfs 2023-07-12T01:39:29.942 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xenfs/xenfs.ko 2023-07-12T01:39:29.942 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs 2023-07-12T01:39:29.942 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/9p 2023-07-12T01:39:29.943 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/9p/9p.ko 2023-07-12T01:39:29.943 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/affs 2023-07-12T01:39:29.943 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/affs/affs.ko 2023-07-12T01:39:29.943 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/befs 2023-07-12T01:39:29.943 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/befs/befs.ko 2023-07-12T01:39:29.943 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/binfmt_misc.ko 2023-07-12T01:39:29.943 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/btrfs 2023-07-12T01:39:29.944 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/btrfs/btrfs.ko 2023-07-12T01:39:29.944 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/cachefiles 2023-07-12T01:39:29.944 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/cachefiles/cachefiles.ko 2023-07-12T01:39:29.944 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ceph 2023-07-12T01:39:29.945 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ceph/ceph.ko 2023-07-12T01:39:29.945 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/coda 2023-07-12T01:39:29.945 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/coda/coda.ko 2023-07-12T01:39:29.946 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/cramfs 2023-07-12T01:39:29.946 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/cramfs/cramfs.ko 2023-07-12T01:39:29.946 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/dlm 2023-07-12T01:39:29.946 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/dlm/dlm.ko 2023-07-12T01:39:29.946 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ecryptfs 2023-07-12T01:39:29.946 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ecryptfs/ecryptfs.ko 2023-07-12T01:39:29.947 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/f2fs 2023-07-12T01:39:29.947 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/f2fs/f2fs.ko 2023-07-12T01:39:29.947 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat 2023-07-12T01:39:29.947 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat/fat.ko 2023-07-12T01:39:29.948 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat/msdos.ko 2023-07-12T01:39:29.948 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat/vfat.ko 2023-07-12T01:39:29.948 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fscache 2023-07-12T01:39:29.949 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fscache/fscache.ko 2023-07-12T01:39:29.949 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fuse 2023-07-12T01:39:29.949 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fuse/cuse.ko 2023-07-12T01:39:29.949 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fuse/fuse.ko 2023-07-12T01:39:29.950 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/gfs2 2023-07-12T01:39:29.950 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/gfs2/gfs2.ko 2023-07-12T01:39:29.950 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfs 2023-07-12T01:39:29.950 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfs/hfs.ko 2023-07-12T01:39:29.951 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfsplus 2023-07-12T01:39:29.951 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfsplus/hfsplus.ko 2023-07-12T01:39:29.951 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/isofs 2023-07-12T01:39:29.951 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/isofs/isofs.ko 2023-07-12T01:39:29.952 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/jfs 2023-07-12T01:39:29.952 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/jfs/jfs.ko 2023-07-12T01:39:29.952 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/lockd 2023-07-12T01:39:29.953 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/lockd/lockd.ko 2023-07-12T01:39:29.953 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/minix 2023-07-12T01:39:29.953 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/minix/minix.ko 2023-07-12T01:39:29.953 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/netfs 2023-07-12T01:39:29.954 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/netfs/netfs.ko 2023-07-12T01:39:29.954 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs 2023-07-12T01:39:29.954 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/blocklayout 2023-07-12T01:39:29.954 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-07-12T01:39:29.955 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/filelayout 2023-07-12T01:39:29.955 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-07-12T01:39:29.955 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/flexfilelayout 2023-07-12T01:39:29.956 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-07-12T01:39:29.956 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfs.ko 2023-07-12T01:39:29.956 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfsv3.ko 2023-07-12T01:39:29.956 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfsv4.ko 2023-07-12T01:39:29.956 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common 2023-07-12T01:39:29.956 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common/grace.ko 2023-07-12T01:39:29.956 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common/nfs_acl.ko 2023-07-12T01:39:29.957 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfsd 2023-07-12T01:39:29.957 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfsd/nfsd.ko 2023-07-12T01:39:29.957 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nilfs2 2023-07-12T01:39:29.957 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nilfs2/nilfs2.ko 2023-07-12T01:39:29.957 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls 2023-07-12T01:39:29.957 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-celtic.ko 2023-07-12T01:39:29.957 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-centeuro.ko 2023-07-12T01:39:29.958 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-croatian.ko 2023-07-12T01:39:29.958 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-cyrillic.ko 2023-07-12T01:39:29.958 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-gaelic.ko 2023-07-12T01:39:29.958 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-greek.ko 2023-07-12T01:39:29.958 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-iceland.ko 2023-07-12T01:39:29.958 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-inuit.ko 2023-07-12T01:39:29.958 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-roman.ko 2023-07-12T01:39:29.958 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-romanian.ko 2023-07-12T01:39:29.959 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-turkish.ko 2023-07-12T01:39:29.959 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1250.ko 2023-07-12T01:39:29.959 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1251.ko 2023-07-12T01:39:29.959 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1255.ko 2023-07-12T01:39:29.959 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp737.ko 2023-07-12T01:39:29.959 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp775.ko 2023-07-12T01:39:29.959 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp850.ko 2023-07-12T01:39:29.959 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp852.ko 2023-07-12T01:39:29.960 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp855.ko 2023-07-12T01:39:29.960 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp857.ko 2023-07-12T01:39:29.960 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp860.ko 2023-07-12T01:39:29.960 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp861.ko 2023-07-12T01:39:29.960 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp862.ko 2023-07-12T01:39:29.960 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp863.ko 2023-07-12T01:39:29.960 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp864.ko 2023-07-12T01:39:29.961 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp865.ko 2023-07-12T01:39:29.961 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp866.ko 2023-07-12T01:39:29.961 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp869.ko 2023-07-12T01:39:29.961 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp874.ko 2023-07-12T01:39:29.961 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp932.ko 2023-07-12T01:39:29.961 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp936.ko 2023-07-12T01:39:29.962 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp949.ko 2023-07-12T01:39:29.962 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp950.ko 2023-07-12T01:39:29.962 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_euc-jp.ko 2023-07-12T01:39:29.963 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-1.ko 2023-07-12T01:39:29.963 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-13.ko 2023-07-12T01:39:29.963 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-14.ko 2023-07-12T01:39:29.963 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-15.ko 2023-07-12T01:39:29.964 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-2.ko 2023-07-12T01:39:29.964 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-3.ko 2023-07-12T01:39:29.964 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-4.ko 2023-07-12T01:39:29.964 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-5.ko 2023-07-12T01:39:29.964 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-6.ko 2023-07-12T01:39:29.964 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-7.ko 2023-07-12T01:39:29.965 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-9.ko 2023-07-12T01:39:29.965 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-r.ko 2023-07-12T01:39:29.965 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-ru.ko 2023-07-12T01:39:29.965 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-u.ko 2023-07-12T01:39:29.965 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_utf8.ko 2023-07-12T01:39:29.965 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2 2023-07-12T01:39:29.965 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/cluster 2023-07-12T01:39:29.965 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-07-12T01:39:29.966 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlm 2023-07-12T01:39:29.966 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-07-12T01:39:29.966 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlmfs 2023-07-12T01:39:29.966 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-07-12T01:39:29.966 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2.ko 2023-07-12T01:39:29.966 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-07-12T01:39:29.966 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-07-12T01:39:29.967 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-07-12T01:39:29.967 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/overlayfs 2023-07-12T01:39:29.967 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/overlayfs/overlay.ko 2023-07-12T01:39:29.967 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/pstore 2023-07-12T01:39:29.967 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/pstore/ramoops.ko 2023-07-12T01:39:29.967 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/reiserfs 2023-07-12T01:39:29.967 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/reiserfs/reiserfs.ko 2023-07-12T01:39:29.967 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/romfs 2023-07-12T01:39:29.968 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/romfs/romfs.ko 2023-07-12T01:39:29.968 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb 2023-07-12T01:39:29.968 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/client 2023-07-12T01:39:29.968 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/client/cifs.ko 2023-07-12T01:39:29.968 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common 2023-07-12T01:39:29.968 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common/cifs_arc4.ko 2023-07-12T01:39:29.968 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common/cifs_md4.ko 2023-07-12T01:39:29.969 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/squashfs 2023-07-12T01:39:29.969 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/squashfs/squashfs.ko 2023-07-12T01:39:29.969 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/sysv 2023-07-12T01:39:29.969 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/sysv/sysv.ko 2023-07-12T01:39:29.969 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/udf 2023-07-12T01:39:29.969 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/udf/udf.ko 2023-07-12T01:39:29.969 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ufs 2023-07-12T01:39:29.969 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ufs/ufs.ko 2023-07-12T01:39:29.970 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/xfs 2023-07-12T01:39:29.970 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/xfs/xfs.ko 2023-07-12T01:39:29.970 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel 2023-07-12T01:39:29.970 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/rcu 2023-07-12T01:39:29.970 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/rcu/rcutorture.ko 2023-07-12T01:39:29.970 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/torture.ko 2023-07-12T01:39:29.970 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/trace 2023-07-12T01:39:29.970 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-07-12T01:39:29.971 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib 2023-07-12T01:39:29.971 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/asn1_encoder.ko 2023-07-12T01:39:29.971 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crc-itu-t.ko 2023-07-12T01:39:29.971 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crc8.ko 2023-07-12T01:39:29.971 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto 2023-07-12T01:39:29.971 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto/libarc4.ko 2023-07-12T01:39:29.971 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto/libdes.ko 2023-07-12T01:39:29.971 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/libcrc32c.ko 2023-07-12T01:39:29.972 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/lru_cache.ko 2023-07-12T01:39:29.972 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4 2023-07-12T01:39:29.972 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4/lz4_compress.ko 2023-07-12T01:39:29.972 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4/lz4hc_compress.ko 2023-07-12T01:39:29.972 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/math 2023-07-12T01:39:29.972 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/math/cordic.ko 2023-07-12T01:39:29.972 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/raid6 2023-07-12T01:39:29.973 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/raid6/raid6_pq.ko 2023-07-12T01:39:29.973 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/reed_solomon 2023-07-12T01:39:29.973 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/reed_solomon/reed_solomon.ko 2023-07-12T01:39:29.973 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_bm.ko 2023-07-12T01:39:29.973 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_fsm.ko 2023-07-12T01:39:29.973 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_kmp.ko 2023-07-12T01:39:29.973 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/zstd 2023-07-12T01:39:29.973 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/zstd/zstd_compress.ko 2023-07-12T01:39:29.974 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/mm 2023-07-12T01:39:29.974 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/mm/hwpoison-inject.ko 2023-07-12T01:39:29.974 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net 2023-07-12T01:39:29.974 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan 2023-07-12T01:39:29.974 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/6lowpan.ko 2023-07-12T01:39:29.974 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_dest.ko 2023-07-12T01:39:29.974 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_fragment.ko 2023-07-12T01:39:29.974 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_hop.ko 2023-07-12T01:39:29.975 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_ipv6.ko 2023-07-12T01:39:29.975 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_mobility.ko 2023-07-12T01:39:29.975 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_routing.ko 2023-07-12T01:39:29.975 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_udp.ko 2023-07-12T01:39:29.975 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802 2023-07-12T01:39:29.975 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/garp.ko 2023-07-12T01:39:29.975 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/mrp.ko 2023-07-12T01:39:29.975 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/p8022.ko 2023-07-12T01:39:29.976 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/psnap.ko 2023-07-12T01:39:29.976 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/stp.ko 2023-07-12T01:39:29.976 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/8021q 2023-07-12T01:39:29.976 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/8021q/8021q.ko 2023-07-12T01:39:29.976 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p 2023-07-12T01:39:29.977 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet.ko 2023-07-12T01:39:29.977 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_fd.ko 2023-07-12T01:39:29.977 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_rdma.ko 2023-07-12T01:39:29.977 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_virtio.ko 2023-07-12T01:39:29.977 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/batman-adv 2023-07-12T01:39:29.977 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/batman-adv/batman-adv.ko 2023-07-12T01:39:29.977 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge 2023-07-12T01:39:29.977 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/br_netfilter.ko 2023-07-12T01:39:29.978 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/bridge.ko 2023-07-12T01:39:29.978 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter 2023-07-12T01:39:29.978 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-07-12T01:39:29.978 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_among.ko 2023-07-12T01:39:29.978 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_arp.ko 2023-07-12T01:39:29.978 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-07-12T01:39:29.978 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-07-12T01:39:29.978 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_ip.ko 2023-07-12T01:39:29.979 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-07-12T01:39:29.979 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_limit.ko 2023-07-12T01:39:29.979 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_log.ko 2023-07-12T01:39:29.979 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_mark.ko 2023-07-12T01:39:29.979 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-07-12T01:39:29.979 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-07-12T01:39:29.979 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-07-12T01:39:29.979 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-07-12T01:39:29.980 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_snat.ko 2023-07-12T01:39:29.980 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_stp.ko 2023-07-12T01:39:29.980 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-07-12T01:39:29.980 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-07-12T01:39:29.980 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-07-12T01:39:29.980 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-07-12T01:39:29.980 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtables.ko 2023-07-12T01:39:29.980 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-07-12T01:39:29.981 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-07-12T01:39:29.981 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-07-12T01:39:29.981 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ceph 2023-07-12T01:39:29.981 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ceph/libceph.ko 2023-07-12T01:39:29.981 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/core 2023-07-12T01:39:29.981 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/core/failover.ko 2023-07-12T01:39:29.981 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/core/pktgen.ko 2023-07-12T01:39:29.982 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp 2023-07-12T01:39:29.982 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp.ko 2023-07-12T01:39:29.982 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_diag.ko 2023-07-12T01:39:29.982 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_ipv4.ko 2023-07-12T01:39:29.982 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_ipv6.ko 2023-07-12T01:39:29.982 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dns_resolver 2023-07-12T01:39:29.982 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dns_resolver/dns_resolver.ko 2023-07-12T01:39:29.982 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa 2023-07-12T01:39:29.983 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/dsa_core.ko 2023-07-12T01:39:29.983 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_brcm.ko 2023-07-12T01:39:29.983 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_dsa.ko 2023-07-12T01:39:29.983 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_none.ko 2023-07-12T01:39:29.983 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_trailer.ko 2023-07-12T01:39:29.983 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154 2023-07-12T01:39:29.983 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/6lowpan 2023-07-12T01:39:29.983 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-07-12T01:39:29.984 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/ieee802154.ko 2023-07-12T01:39:29.984 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/ieee802154_socket.ko 2023-07-12T01:39:29.984 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4 2023-07-12T01:39:29.984 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ah4.ko 2023-07-12T01:39:29.984 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/esp4.ko 2023-07-12T01:39:29.984 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/fou.ko 2023-07-12T01:39:29.984 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/gre.ko 2023-07-12T01:39:29.984 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/inet_diag.ko 2023-07-12T01:39:29.985 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_gre.ko 2023-07-12T01:39:29.985 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_tunnel.ko 2023-07-12T01:39:29.985 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_vti.ko 2023-07-12T01:39:29.985 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ipcomp.ko 2023-07-12T01:39:29.985 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ipip.ko 2023-07-12T01:39:29.985 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter 2023-07-12T01:39:29.985 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arp_tables.ko 2023-07-12T01:39:29.985 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-07-12T01:39:29.986 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-07-12T01:39:29.986 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-07-12T01:39:29.986 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-07-12T01:39:29.986 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-07-12T01:39:29.986 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-07-12T01:39:29.986 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-07-12T01:39:29.986 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-07-12T01:39:29.987 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-07-12T01:39:29.987 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_security.ko 2023-07-12T01:39:29.987 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-07-12T01:39:29.987 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-07-12T01:39:29.987 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-07-12T01:39:29.987 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-07-12T01:39:29.987 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-07-12T01:39:29.987 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-07-12T01:39:29.988 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-07-12T01:39:29.988 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-07-12T01:39:29.988 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-07-12T01:39:29.988 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-07-12T01:39:29.988 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_bic.ko 2023-07-12T01:39:29.988 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_dctcp.ko 2023-07-12T01:39:29.988 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_diag.ko 2023-07-12T01:39:29.988 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_highspeed.ko 2023-07-12T01:39:29.989 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_htcp.ko 2023-07-12T01:39:29.989 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_hybla.ko 2023-07-12T01:39:29.989 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_illinois.ko 2023-07-12T01:39:29.989 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_lp.ko 2023-07-12T01:39:29.989 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_scalable.ko 2023-07-12T01:39:29.989 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_vegas.ko 2023-07-12T01:39:29.989 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_veno.ko 2023-07-12T01:39:29.989 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_westwood.ko 2023-07-12T01:39:29.990 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_yeah.ko 2023-07-12T01:39:29.990 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tunnel4.ko 2023-07-12T01:39:29.990 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/udp_diag.ko 2023-07-12T01:39:29.990 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/udp_tunnel.ko 2023-07-12T01:39:29.990 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/xfrm4_tunnel.ko 2023-07-12T01:39:29.990 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6 2023-07-12T01:39:29.990 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ah6.ko 2023-07-12T01:39:29.990 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/esp6.ko 2023-07-12T01:39:29.991 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/fou6.ko 2023-07-12T01:39:29.991 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_tunnel.ko 2023-07-12T01:39:29.991 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-07-12T01:39:29.991 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_vti.ko 2023-07-12T01:39:29.991 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ipcomp6.ko 2023-07-12T01:39:29.991 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter 2023-07-12T01:39:29.991 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-07-12T01:39:29.991 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-07-12T01:39:29.992 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-07-12T01:39:29.992 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-07-12T01:39:29.992 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-07-12T01:39:29.992 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-07-12T01:39:29.992 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-07-12T01:39:29.992 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-07-12T01:39:29.992 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-07-12T01:39:29.993 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-07-12T01:39:29.993 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-07-12T01:39:29.993 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-07-12T01:39:29.993 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-07-12T01:39:29.993 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-07-12T01:39:29.993 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-07-12T01:39:29.993 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-07-12T01:39:29.993 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-07-12T01:39:29.994 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-07-12T01:39:29.994 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-07-12T01:39:29.994 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-07-12T01:39:29.994 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-07-12T01:39:29.994 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-07-12T01:39:29.994 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-07-12T01:39:29.994 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-07-12T01:39:29.994 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/sit.ko 2023-07-12T01:39:29.995 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/tunnel6.ko 2023-07-12T01:39:29.995 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/xfrm6_tunnel.ko 2023-07-12T01:39:29.995 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/key 2023-07-12T01:39:29.995 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/key/af_key.ko 2023-07-12T01:39:29.995 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp 2023-07-12T01:39:29.995 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_core.ko 2023-07-12T01:39:29.995 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_debugfs.ko 2023-07-12T01:39:29.995 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_eth.ko 2023-07-12T01:39:29.996 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ip.ko 2023-07-12T01:39:29.996 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ip6.ko 2023-07-12T01:39:29.996 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_netlink.ko 2023-07-12T01:39:29.996 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ppp.ko 2023-07-12T01:39:29.996 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/llc 2023-07-12T01:39:29.996 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/llc/llc.ko 2023-07-12T01:39:29.996 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/mac802154 2023-07-12T01:39:29.996 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/mac802154/mac802154.ko 2023-07-12T01:39:29.997 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/mpls 2023-07-12T01:39:29.997 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/mpls/mpls_gso.ko 2023-07-12T01:39:29.997 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter 2023-07-12T01:39:29.997 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset 2023-07-12T01:39:29.997 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set.ko 2023-07-12T01:39:29.997 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-07-12T01:39:29.997 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-07-12T01:39:29.997 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-07-12T01:39:29.998 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-07-12T01:39:29.998 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-07-12T01:39:29.998 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-07-12T01:39:29.998 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-07-12T01:39:29.998 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-07-12T01:39:29.998 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-07-12T01:39:29.998 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-07-12T01:39:29.999 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-07-12T01:39:29.999 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-07-12T01:39:29.999 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-07-12T01:39:29.999 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-07-12T01:39:29.999 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-07-12T01:39:29.999 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs 2023-07-12T01:39:29.999 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs.ko 2023-07-12T01:39:29.999 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-07-12T01:39:30.000 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-07-12T01:39:30.000 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-07-12T01:39:30.000 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-07-12T01:39:30.000 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-07-12T01:39:30.000 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-07-12T01:39:30.000 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-07-12T01:39:30.000 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-07-12T01:39:30.000 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-07-12T01:39:30.001 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-07-12T01:39:30.001 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-07-12T01:39:30.001 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-07-12T01:39:30.001 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-07-12T01:39:30.001 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conncount.ko 2023-07-12T01:39:30.001 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack.ko 2023-07-12T01:39:30.001 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-07-12T01:39:30.001 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-07-12T01:39:30.002 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-07-12T01:39:30.002 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_h323.ko 2023-07-12T01:39:30.002 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_irc.ko 2023-07-12T01:39:30.002 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-07-12T01:39:30.002 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-07-12T01:39:30.002 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-07-12T01:39:30.002 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_sane.ko 2023-07-12T01:39:30.003 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_sip.ko 2023-07-12T01:39:30.003 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-07-12T01:39:30.003 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-07-12T01:39:30.003 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_dup_netdev.ko 2023-07-12T01:39:30.003 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_flow_table.ko 2023-07-12T01:39:30.003 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_flow_table_inet.ko 2023-07-12T01:39:30.003 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_log_syslog.ko 2023-07-12T01:39:30.003 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat.ko 2023-07-12T01:39:30.004 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_amanda.ko 2023-07-12T01:39:30.004 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_ftp.ko 2023-07-12T01:39:30.004 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_irc.ko 2023-07-12T01:39:30.004 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_sip.ko 2023-07-12T01:39:30.004 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_tftp.ko 2023-07-12T01:39:30.004 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_synproxy_core.ko 2023-07-12T01:39:30.004 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_tables.ko 2023-07-12T01:39:30.004 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink.ko 2023-07-12T01:39:30.005 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_acct.ko 2023-07-12T01:39:30.005 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_log.ko 2023-07-12T01:39:30.005 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_osf.ko 2023-07-12T01:39:30.005 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_queue.ko 2023-07-12T01:39:30.005 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_chain_nat.ko 2023-07-12T01:39:30.005 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_compat.ko 2023-07-12T01:39:30.005 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_ct.ko 2023-07-12T01:39:30.005 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_dup_netdev.ko 2023-07-12T01:39:30.006 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_fib.ko 2023-07-12T01:39:30.006 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_fwd_netdev.ko 2023-07-12T01:39:30.006 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_hash.ko 2023-07-12T01:39:30.006 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_limit.ko 2023-07-12T01:39:30.006 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_log.ko 2023-07-12T01:39:30.006 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_masq.ko 2023-07-12T01:39:30.006 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_nat.ko 2023-07-12T01:39:30.006 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_numgen.ko 2023-07-12T01:39:30.007 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_queue.ko 2023-07-12T01:39:30.007 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_quota.ko 2023-07-12T01:39:30.007 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_redir.ko 2023-07-12T01:39:30.007 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_reject.ko 2023-07-12T01:39:30.007 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_reject_inet.ko 2023-07-12T01:39:30.007 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_socket.ko 2023-07-12T01:39:30.007 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_tunnel.ko 2023-07-12T01:39:30.007 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_AUDIT.ko 2023-07-12T01:39:30.008 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CHECKSUM.ko 2023-07-12T01:39:30.008 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CLASSIFY.ko 2023-07-12T01:39:30.008 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-07-12T01:39:30.008 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CT.ko 2023-07-12T01:39:30.008 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_DSCP.ko 2023-07-12T01:39:30.008 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_HL.ko 2023-07-12T01:39:30.008 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_HMARK.ko 2023-07-12T01:39:30.009 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_IDLETIMER.ko 2023-07-12T01:39:30.009 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_LED.ko 2023-07-12T01:39:30.009 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_LOG.ko 2023-07-12T01:39:30.009 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_MASQUERADE.ko 2023-07-12T01:39:30.009 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NETMAP.ko 2023-07-12T01:39:30.009 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NFLOG.ko 2023-07-12T01:39:30.009 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NFQUEUE.ko 2023-07-12T01:39:30.009 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_RATEEST.ko 2023-07-12T01:39:30.010 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_REDIRECT.ko 2023-07-12T01:39:30.010 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_SECMARK.ko 2023-07-12T01:39:30.010 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TCPMSS.ko 2023-07-12T01:39:30.010 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-07-12T01:39:30.010 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TEE.ko 2023-07-12T01:39:30.010 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TPROXY.ko 2023-07-12T01:39:30.010 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TRACE.ko 2023-07-12T01:39:30.010 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_addrtype.ko 2023-07-12T01:39:30.011 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_bpf.ko 2023-07-12T01:39:30.011 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cgroup.ko 2023-07-12T01:39:30.011 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cluster.ko 2023-07-12T01:39:30.011 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_comment.ko 2023-07-12T01:39:30.011 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connbytes.ko 2023-07-12T01:39:30.011 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connlabel.ko 2023-07-12T01:39:30.011 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connlimit.ko 2023-07-12T01:39:30.011 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connmark.ko 2023-07-12T01:39:30.012 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_conntrack.ko 2023-07-12T01:39:30.012 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cpu.ko 2023-07-12T01:39:30.012 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_dccp.ko 2023-07-12T01:39:30.012 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_devgroup.ko 2023-07-12T01:39:30.012 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_dscp.ko 2023-07-12T01:39:30.012 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ecn.ko 2023-07-12T01:39:30.012 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_esp.ko 2023-07-12T01:39:30.013 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_hashlimit.ko 2023-07-12T01:39:30.013 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_helper.ko 2023-07-12T01:39:30.013 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_hl.ko 2023-07-12T01:39:30.013 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ipcomp.ko 2023-07-12T01:39:30.013 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_iprange.ko 2023-07-12T01:39:30.013 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ipvs.ko 2023-07-12T01:39:30.013 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_l2tp.ko 2023-07-12T01:39:30.013 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_length.ko 2023-07-12T01:39:30.014 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_limit.ko 2023-07-12T01:39:30.014 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_mac.ko 2023-07-12T01:39:30.014 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_mark.ko 2023-07-12T01:39:30.014 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_multiport.ko 2023-07-12T01:39:30.014 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_nat.ko 2023-07-12T01:39:30.014 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_nfacct.ko 2023-07-12T01:39:30.014 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_osf.ko 2023-07-12T01:39:30.014 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_owner.ko 2023-07-12T01:39:30.015 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_physdev.ko 2023-07-12T01:39:30.015 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_pkttype.ko 2023-07-12T01:39:30.015 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_policy.ko 2023-07-12T01:39:30.015 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_quota.ko 2023-07-12T01:39:30.015 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_rateest.ko 2023-07-12T01:39:30.015 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_realm.ko 2023-07-12T01:39:30.015 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_recent.ko 2023-07-12T01:39:30.015 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_sctp.ko 2023-07-12T01:39:30.016 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_set.ko 2023-07-12T01:39:30.016 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_socket.ko 2023-07-12T01:39:30.016 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_state.ko 2023-07-12T01:39:30.016 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_statistic.ko 2023-07-12T01:39:30.016 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_string.ko 2023-07-12T01:39:30.016 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_tcpmss.ko 2023-07-12T01:39:30.016 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_time.ko 2023-07-12T01:39:30.017 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_u32.ko 2023-07-12T01:39:30.017 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netlink 2023-07-12T01:39:30.017 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netlink/netlink_diag.ko 2023-07-12T01:39:30.017 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/nsh 2023-07-12T01:39:30.017 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/nsh/nsh.ko 2023-07-12T01:39:30.017 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch 2023-07-12T01:39:30.017 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/openvswitch.ko 2023-07-12T01:39:30.017 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-geneve.ko 2023-07-12T01:39:30.018 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-gre.ko 2023-07-12T01:39:30.018 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-vxlan.ko 2023-07-12T01:39:30.018 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/packet 2023-07-12T01:39:30.018 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/packet/af_packet_diag.ko 2023-07-12T01:39:30.018 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/rds 2023-07-12T01:39:30.018 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds.ko 2023-07-12T01:39:30.018 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds_rdma.ko 2023-07-12T01:39:30.018 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds_tcp.ko 2023-07-12T01:39:30.019 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched 2023-07-12T01:39:30.019 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_csum.ko 2023-07-12T01:39:30.019 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_gact.ko 2023-07-12T01:39:30.019 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_ipt.ko 2023-07-12T01:39:30.019 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_mirred.ko 2023-07-12T01:39:30.019 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_nat.ko 2023-07-12T01:39:30.019 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_pedit.ko 2023-07-12T01:39:30.019 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_police.ko 2023-07-12T01:39:30.020 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_simple.ko 2023-07-12T01:39:30.020 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_skbedit.ko 2023-07-12T01:39:30.020 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_vlan.ko 2023-07-12T01:39:30.020 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_basic.ko 2023-07-12T01:39:30.020 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_bpf.ko 2023-07-12T01:39:30.020 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_flow.ko 2023-07-12T01:39:30.020 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_fw.ko 2023-07-12T01:39:30.020 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_route.ko 2023-07-12T01:39:30.021 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_u32.ko 2023-07-12T01:39:30.021 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_cmp.ko 2023-07-12T01:39:30.021 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_ipset.ko 2023-07-12T01:39:30.021 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_meta.ko 2023-07-12T01:39:30.021 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_nbyte.ko 2023-07-12T01:39:30.021 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_text.ko 2023-07-12T01:39:30.021 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_u32.ko 2023-07-12T01:39:30.021 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_choke.ko 2023-07-12T01:39:30.022 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_codel.ko 2023-07-12T01:39:30.022 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_drr.ko 2023-07-12T01:39:30.022 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_fq.ko 2023-07-12T01:39:30.022 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_gred.ko 2023-07-12T01:39:30.022 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_hfsc.ko 2023-07-12T01:39:30.022 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_hhf.ko 2023-07-12T01:39:30.022 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_htb.ko 2023-07-12T01:39:30.022 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_ingress.ko 2023-07-12T01:39:30.023 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_mqprio.ko 2023-07-12T01:39:30.023 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_mqprio_lib.ko 2023-07-12T01:39:30.023 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_multiq.ko 2023-07-12T01:39:30.023 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_netem.ko 2023-07-12T01:39:30.023 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_pie.ko 2023-07-12T01:39:30.023 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_plug.ko 2023-07-12T01:39:30.023 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_prio.ko 2023-07-12T01:39:30.024 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_qfq.ko 2023-07-12T01:39:30.024 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_red.ko 2023-07-12T01:39:30.024 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_sfb.ko 2023-07-12T01:39:30.024 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_sfq.ko 2023-07-12T01:39:30.024 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_tbf.ko 2023-07-12T01:39:30.024 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_teql.ko 2023-07-12T01:39:30.024 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp 2023-07-12T01:39:30.024 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp/sctp.ko 2023-07-12T01:39:30.025 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp/sctp_diag.ko 2023-07-12T01:39:30.025 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc 2023-07-12T01:39:30.025 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss 2023-07-12T01:39:30.025 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-07-12T01:39:30.025 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-07-12T01:39:30.025 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/sunrpc.ko 2023-07-12T01:39:30.025 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/xprtrdma 2023-07-12T01:39:30.025 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-07-12T01:39:30.026 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc 2023-07-12T01:39:30.026 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc/diag.ko 2023-07-12T01:39:30.026 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc/tipc.ko 2023-07-12T01:39:30.026 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/unix 2023-07-12T01:39:30.026 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/unix/unix_diag.ko 2023-07-12T01:39:30.026 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock 2023-07-12T01:39:30.026 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-07-12T01:39:30.026 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-07-12T01:39:30.027 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock.ko 2023-07-12T01:39:30.027 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock_diag.ko 2023-07-12T01:39:30.027 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock_loopback.ko 2023-07-12T01:39:30.027 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/xfrm 2023-07-12T01:39:30.027 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/xfrm/xfrm_ipcomp.ko 2023-07-12T01:39:30.027 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security 2023-07-12T01:39:30.027 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys 2023-07-12T01:39:30.027 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys/encrypted-keys 2023-07-12T01:39:30.028 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-07-12T01:39:30.028 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys/trusted-keys 2023-07-12T01:39:30.028 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys/trusted-keys/trusted.ko 2023-07-12T01:39:30.028 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/virt 2023-07-12T01:39:30.028 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/virt/lib 2023-07-12T01:39:30.028 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/virt/lib/irqbypass.ko 2023-07-12T01:39:30.028 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.alias 2023-07-12T01:39:30.028 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.alias.bin 2023-07-12T01:39:30.029 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.builtin 2023-07-12T01:39:30.029 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.builtin.bin 2023-07-12T01:39:30.029 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.builtin.modinfo 2023-07-12T01:39:30.029 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.dep 2023-07-12T01:39:30.029 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.dep.bin 2023-07-12T01:39:30.029 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.devname 2023-07-12T01:39:30.029 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.order 2023-07-12T01:39:30.030 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.softdep 2023-07-12T01:39:30.030 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.symbols 2023-07-12T01:39:30.030 INFO:teuthology.orchestra.run.smithi174.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.symbols.bin 2023-07-12T01:39:30.030 DEBUG:teuthology.task.kernel:get_image_version: 6.4.0-g84139c18d56f 2023-07-12T01:39:30.031 DEBUG:teuthology.orchestra.run.smithi174:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-07-12T01:39:30.060 INFO:teuthology.orchestra.run.smithi174.stdout:postinstall scriptlet (using /bin/sh): 2023-07-12T01:39:30.060 INFO:teuthology.orchestra.run.smithi174.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.4.0-g84139c18d56f -a -r /boot/System.map-6.4.0-g84139c18d56f ]; then 2023-07-12T01:39:30.061 INFO:teuthology.orchestra.run.smithi174.stdout:cp /boot/vmlinuz-6.4.0-g84139c18d56f /boot/.vmlinuz-6.4.0-g84139c18d56f-rpm 2023-07-12T01:39:30.061 INFO:teuthology.orchestra.run.smithi174.stdout:cp /boot/System.map-6.4.0-g84139c18d56f /boot/.System.map-6.4.0-g84139c18d56f-rpm 2023-07-12T01:39:30.061 INFO:teuthology.orchestra.run.smithi174.stdout:rm -f /boot/vmlinuz-6.4.0-g84139c18d56f /boot/System.map-6.4.0-g84139c18d56f 2023-07-12T01:39:30.062 INFO:teuthology.orchestra.run.smithi174.stdout:/sbin/installkernel 6.4.0-g84139c18d56f /boot/.vmlinuz-6.4.0-g84139c18d56f-rpm /boot/.System.map-6.4.0-g84139c18d56f-rpm 2023-07-12T01:39:30.062 INFO:teuthology.orchestra.run.smithi174.stdout:rm -f /boot/.vmlinuz-6.4.0-g84139c18d56f-rpm /boot/.System.map-6.4.0-g84139c18d56f-rpm 2023-07-12T01:39:30.062 INFO:teuthology.orchestra.run.smithi174.stdout:fi 2023-07-12T01:39:30.062 INFO:teuthology.orchestra.run.smithi174.stdout:preuninstall scriptlet (using /bin/sh): 2023-07-12T01:39:30.063 INFO:teuthology.orchestra.run.smithi174.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-07-12T01:39:30.063 INFO:teuthology.orchestra.run.smithi174.stdout:new-kernel-pkg --remove 6.4.0-g84139c18d56f --rminitrd --initrdfile=/boot/initramfs-6.4.0-g84139c18d56f.img 2023-07-12T01:39:30.063 INFO:teuthology.orchestra.run.smithi174.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-07-12T01:39:30.063 INFO:teuthology.orchestra.run.smithi174.stdout:kernel-install remove 6.4.0-g84139c18d56f 2023-07-12T01:39:30.064 INFO:teuthology.orchestra.run.smithi174.stdout:fi 2023-07-12T01:39:30.064 INFO:teuthology.orchestra.run.smithi174.stdout:postuninstall scriptlet (using /bin/sh): 2023-07-12T01:39:30.064 INFO:teuthology.orchestra.run.smithi174.stdout:if [ -x /sbin/update-bootloader ]; then 2023-07-12T01:39:30.065 INFO:teuthology.orchestra.run.smithi174.stdout:/sbin/update-bootloader --remove 6.4.0-g84139c18d56f 2023-07-12T01:39:30.065 INFO:teuthology.orchestra.run.smithi174.stdout:fi 2023-07-12T01:39:30.066 DEBUG:teuthology.orchestra.run.smithi174:> sudo rpm -qi grub2-tools 2023-07-12T01:39:30.142 INFO:teuthology.orchestra.run.smithi174.stdout:Name : grub2-tools 2023-07-12T01:39:30.143 INFO:teuthology.orchestra.run.smithi174.stdout:Epoch : 1 2023-07-12T01:39:30.143 INFO:teuthology.orchestra.run.smithi174.stdout:Version : 2.02 2023-07-12T01:39:30.143 INFO:teuthology.orchestra.run.smithi174.stdout:Release : 129.el8 2023-07-12T01:39:30.143 INFO:teuthology.orchestra.run.smithi174.stdout:Architecture: x86_64 2023-07-12T01:39:30.143 INFO:teuthology.orchestra.run.smithi174.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-07-12T01:39:30.144 INFO:teuthology.orchestra.run.smithi174.stdout:Group : System Environment/Base 2023-07-12T01:39:30.144 INFO:teuthology.orchestra.run.smithi174.stdout:Size : 9265586 2023-07-12T01:39:30.144 INFO:teuthology.orchestra.run.smithi174.stdout:License : GPLv3+ 2023-07-12T01:39:30.144 INFO:teuthology.orchestra.run.smithi174.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-07-12T01:39:30.144 INFO:teuthology.orchestra.run.smithi174.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-07-12T01:39:30.144 INFO:teuthology.orchestra.run.smithi174.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-07-12T01:39:30.144 INFO:teuthology.orchestra.run.smithi174.stdout:Build Host : kbuilder.bsys.centos.org 2023-07-12T01:39:30.145 INFO:teuthology.orchestra.run.smithi174.stdout:Relocations : (not relocatable) 2023-07-12T01:39:30.145 INFO:teuthology.orchestra.run.smithi174.stdout:Packager : CentOS BuildSystem 2023-07-12T01:39:30.145 INFO:teuthology.orchestra.run.smithi174.stdout:Vendor : CentOS 2023-07-12T01:39:30.145 INFO:teuthology.orchestra.run.smithi174.stdout:URL : http://www.gnu.org/software/grub/ 2023-07-12T01:39:30.145 INFO:teuthology.orchestra.run.smithi174.stdout:Summary : Support tools for GRUB. 2023-07-12T01:39:30.145 INFO:teuthology.orchestra.run.smithi174.stdout:Description : 2023-07-12T01:39:30.145 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T01:39:30.145 INFO:teuthology.orchestra.run.smithi174.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-07-12T01:39:30.146 INFO:teuthology.orchestra.run.smithi174.stdout:customizable bootloader with modular architecture. It supports a rich 2023-07-12T01:39:30.146 INFO:teuthology.orchestra.run.smithi174.stdout:variety of kernel formats, file systems, computer architectures and 2023-07-12T01:39:30.146 INFO:teuthology.orchestra.run.smithi174.stdout:hardware devices. 2023-07-12T01:39:30.146 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T01:39:30.146 INFO:teuthology.orchestra.run.smithi174.stdout:This subpackage provides tools for support of all platforms. 2023-07-12T01:39:30.147 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-07-12T01:39:30.147 INFO:teuthology.task.kernel:Updating grub on smithi174 to boot 6.4.0-g84139c18d56f 2023-07-12T01:39:30.148 DEBUG:teuthology.orchestra.run.smithi174:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-07-12T01:39:35.178 INFO:teuthology.orchestra.run.smithi174.stderr:Generating grub configuration file ... 2023-07-12T01:39:37.584 INFO:teuthology.orchestra.run.smithi174.stderr:done 2023-07-12T01:39:37.585 DEBUG:teuthology.orchestra.run.smithi174:> mktemp 2023-07-12T01:39:37.614 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.baz2qzoSaZ 2023-07-12T01:39:37.614 DEBUG:teuthology.orchestra.run.smithi174:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.baz2qzoSaZ 2023-07-12T01:39:37.688 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.baz2qzoSaZ 2023-07-12T01:39:37.835 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.baz2qzoSaZ is 6KB 2023-07-12T01:39:37.882 DEBUG:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.baz2qzoSaZ 2023-07-12T01:39:37.900 DEBUG:teuthology.orchestra.run.smithi174:> sudo /bin/ls /boot/loader/entries || true 2023-07-12T01:39:37.979 INFO:teuthology.orchestra.run.smithi174.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-07-12T01:39:37.979 INFO:teuthology.orchestra.run.smithi174.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-07-12T01:39:37.979 INFO:teuthology.orchestra.run.smithi174.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-07-12T01:39:37.979 INFO:teuthology.orchestra.run.smithi174.stdout:a1b29d6c289747bdb22930598d39874a-6.4.0-g84139c18d56f.conf 2023-07-12T01:39:37.980 DEBUG:teuthology.orchestra.run.smithi174:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.4.0-g84139c18d56f 2023-07-12T01:39:38.121 DEBUG:teuthology.orchestra.run.smithi174:> sudo shutdown -r now 2023-07-12T01:40:08.124 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-07-12T01:40:08.125 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-07-12T01:40:08.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:40:26.608 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-07-12T01:40:35.610 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-07-12T01:40:35.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:40:38.672 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-07-12T01:40:50.673 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-07-12T01:40:50.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:41:22.433 DEBUG:teuthology.orchestra.run.smithi174:> true 2023-07-12T01:41:22.826 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-07-12T01:41:22.826 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.4.0-g84139c18d56f"... 2023-07-12T01:41:22.826 DEBUG:teuthology.orchestra.run.smithi174:> uname -r 2023-07-12T01:41:22.872 INFO:teuthology.orchestra.run.smithi174.stdout:6.4.0-g84139c18d56f 2023-07-12T01:41:22.872 DEBUG:teuthology.task.kernel:current kernel version is 6.4.0-g84139c18d56f vs 6.4.0-g84139c18d56f 2023-07-12T01:41:22.873 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-12T01:41:22.873 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-07-12T01:41:23.874 DEBUG:teuthology.parallel:result is None 2023-07-12T01:41:23.875 INFO:teuthology.run_tasks:Running task internal.base... 2023-07-12T01:41:23.883 INFO:teuthology.task.internal:Creating test directory... 2023-07-12T01:41:23.883 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-12T01:41:23.886 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-12T01:41:23.889 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-12T01:41:23.939 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-07-12T01:41:23.959 INFO:teuthology.run_tasks:Running task internal.archive... 2023-07-12T01:41:23.979 INFO:teuthology.task.internal:Creating archive directory... 2023-07-12T01:41:23.979 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-12T01:41:23.982 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-12T01:41:23.984 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-12T01:41:24.283 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-07-12T01:41:24.295 INFO:teuthology.task.internal:Enabling coredump saving... 2023-07-12T01:41:24.296 DEBUG:teuthology.orchestra.run.smithi060:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-12T01:41:24.317 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-12T01:41:24.318 DEBUG:teuthology.orchestra.run.smithi079:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-12T01:41:24.339 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-12T01:41:24.340 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-12T01:41:24.361 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-12T01:41:24.382 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-12T01:41:24.404 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-12T01:41:24.420 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-12T01:41:24.428 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-12T01:41:24.444 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-12T01:41:24.507 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-12T01:41:24.571 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-12T01:41:24.574 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-07-12T01:41:24.581 INFO:teuthology.task.internal:Configuring sudo... 2023-07-12T01:41:24.582 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-12T01:41:24.585 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-12T01:41:24.587 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-12T01:41:24.657 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-07-12T01:41:24.667 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-07-12T01:41:24.668 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-12T01:41:24.670 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-12T01:41:24.672 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-12T01:41:24.718 DEBUG:teuthology.orchestra.run.smithi060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-12T01:41:24.778 DEBUG:teuthology.orchestra.run.smithi060:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-12T01:41:24.828 DEBUG:teuthology.orchestra.run.smithi060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-12T01:41:24.917 DEBUG:teuthology.orchestra.run.smithi060:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-12T01:41:24.960 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-07-12T01:41:24.960 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-12T01:41:25.028 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-12T01:41:25.083 DEBUG:teuthology.orchestra.run.smithi079:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-12T01:41:25.137 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-12T01:41:25.226 DEBUG:teuthology.orchestra.run.smithi079:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-12T01:41:25.269 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-07-12T01:41:25.269 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-12T01:41:25.338 DEBUG:teuthology.orchestra.run.smithi174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-12T01:41:25.413 DEBUG:teuthology.orchestra.run.smithi174:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-12T01:41:25.483 DEBUG:teuthology.orchestra.run.smithi174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-12T01:41:25.559 DEBUG:teuthology.orchestra.run.smithi174:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-12T01:41:25.628 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-07-12T01:41:25.628 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-12T01:41:25.696 DEBUG:teuthology.orchestra.run.smithi060:> sudo service rsyslog restart 2023-07-12T01:41:25.699 DEBUG:teuthology.orchestra.run.smithi079:> sudo service rsyslog restart 2023-07-12T01:41:25.701 DEBUG:teuthology.orchestra.run.smithi174:> sudo service rsyslog restart 2023-07-12T01:41:25.751 INFO:teuthology.orchestra.run.smithi079.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-12T01:41:25.821 INFO:teuthology.orchestra.run.smithi060.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-12T01:41:25.857 INFO:teuthology.orchestra.run.smithi174.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-12T01:41:26.076 INFO:teuthology.run_tasks:Running task internal.timer... 2023-07-12T01:41:26.086 INFO:teuthology.task.internal:Starting timer... 2023-07-12T01:41:26.086 INFO:teuthology.run_tasks:Running task pcp... 2023-07-12T01:41:26.116 INFO:teuthology.run_tasks:Running task selinux... 2023-07-12T01:41:26.150 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-07-12T01:41:26.151 DEBUG:teuthology.orchestra.run.smithi060:> sudo service auditd rotate 2023-07-12T01:41:26.233 INFO:teuthology.orchestra.run.smithi060.stdout:Rotating logs: 2023-07-12T01:41:26.233 DEBUG:teuthology.orchestra.run.smithi079:> sudo service auditd rotate 2023-07-12T01:41:26.315 INFO:teuthology.orchestra.run.smithi079.stdout:Rotating logs: 2023-07-12T01:41:26.317 DEBUG:teuthology.orchestra.run.smithi174:> sudo service auditd rotate 2023-07-12T01:41:26.448 INFO:teuthology.orchestra.run.smithi174.stdout:Rotating logs: 2023-07-12T01:41:26.451 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-07-12T01:41:26.452 DEBUG:teuthology.orchestra.run.smithi060:> /usr/sbin/getenforce 2023-07-12T01:41:26.480 INFO:teuthology.orchestra.run.smithi060.stdout:Permissive 2023-07-12T01:41:26.481 DEBUG:teuthology.orchestra.run.smithi079:> /usr/sbin/getenforce 2023-07-12T01:41:26.519 INFO:teuthology.orchestra.run.smithi079.stdout:Permissive 2023-07-12T01:41:26.519 DEBUG:teuthology.orchestra.run.smithi174:> /usr/sbin/getenforce 2023-07-12T01:41:26.577 INFO:teuthology.orchestra.run.smithi174.stdout:Permissive 2023-07-12T01:41:26.578 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi060.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi079.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi174.front.sepia.ceph.com': 'permissive'} 2023-07-12T01:41:26.578 DEBUG:teuthology.orchestra.run.smithi060:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-12T01:41:26.610 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-12T01:41:26.611 DEBUG:teuthology.orchestra.run.smithi079:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-12T01:41:26.641 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-12T01:41:26.642 DEBUG:teuthology.orchestra.run.smithi174:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-12T01:41:26.711 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-12T01:41:26.712 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-07-12T01:41:26.712 DEBUG:teuthology.orchestra.run.smithi060:> sudo /usr/sbin/setenforce permissive 2023-07-12T01:41:26.742 DEBUG:teuthology.orchestra.run.smithi079:> sudo /usr/sbin/setenforce permissive 2023-07-12T01:41:26.771 DEBUG:teuthology.orchestra.run.smithi174:> sudo /usr/sbin/setenforce permissive 2023-07-12T01:41:26.839 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-07-12T01:41:26.849 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-07-12T01:41:26.856 INFO:teuthology.repo_utils:Fetching main from origin 2023-07-12T01:41:27.038 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-07-12T01:41:27.063 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-07-12T01:41:27.065 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi060.front.sepia.ceph.com,smithi079.front.sepia.ceph.com,smithi174.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-07-12T01:52:18.222 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi060.front.sepia.ceph.com'), Remote(name='ubuntu@smithi079.front.sepia.ceph.com'), Remote(name='ubuntu@smithi174.front.sepia.ceph.com')] 2023-07-12T01:52:18.223 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-07-12T01:52:18.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:52:18.298 DEBUG:teuthology.orchestra.run.smithi060:> true 2023-07-12T01:52:18.370 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-07-12T01:52:18.371 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-07-12T01:52:18.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:52:18.438 DEBUG:teuthology.orchestra.run.smithi079:> true 2023-07-12T01:52:18.506 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-07-12T01:52:18.507 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-07-12T01:52:18.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T01:52:18.597 DEBUG:teuthology.orchestra.run.smithi174:> true 2023-07-12T01:52:18.712 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-07-12T01:52:18.713 INFO:teuthology.run_tasks:Running task clock... 2023-07-12T01:52:18.731 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-07-12T01:52:18.732 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-12T01:52:18.733 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-12T01:52:18.735 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-12T01:52:18.735 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-12T01:52:18.738 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-12T01:52:18.738 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-12T01:52:18.771 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-12T01:52:18.773 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-12T01:52:18.786 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-12T01:52:18.789 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-12T01:52:18.826 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-12T01:52:18.851 INFO:teuthology.orchestra.run.smithi079.stderr:sudo: ntpd: command not found 2023-07-12T01:52:18.856 INFO:teuthology.orchestra.run.smithi060.stderr:sudo: ntpd: command not found 2023-07-12T01:52:18.858 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-12T01:52:18.863 INFO:teuthology.orchestra.run.smithi079.stdout:506 Cannot talk to daemon 2023-07-12T01:52:18.869 INFO:teuthology.orchestra.run.smithi060.stdout:506 Cannot talk to daemon 2023-07-12T01:52:18.877 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-12T01:52:18.884 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-12T01:52:18.891 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-12T01:52:18.899 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-12T01:52:18.945 INFO:teuthology.orchestra.run.smithi174.stderr:sudo: ntpd: command not found 2023-07-12T01:52:18.955 INFO:teuthology.orchestra.run.smithi079.stderr:bash: ntpq: command not found 2023-07-12T01:52:18.958 INFO:teuthology.orchestra.run.smithi079.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-12T01:52:18.958 INFO:teuthology.orchestra.run.smithi079.stdout:=============================================================================== 2023-07-12T01:52:18.958 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-12T01:52:18.959 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-12T01:52:18.959 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-12T01:52:18.959 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-12T01:52:18.971 INFO:teuthology.orchestra.run.smithi060.stderr:bash: ntpq: command not found 2023-07-12T01:52:18.973 INFO:teuthology.orchestra.run.smithi174.stdout:506 Cannot talk to daemon 2023-07-12T01:52:18.974 INFO:teuthology.orchestra.run.smithi060.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-12T01:52:18.975 INFO:teuthology.orchestra.run.smithi060.stdout:=============================================================================== 2023-07-12T01:52:18.975 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-12T01:52:18.975 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-12T01:52:18.975 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-12T01:52:18.975 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-12T01:52:19.005 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-12T01:52:19.038 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-12T01:52:19.127 INFO:teuthology.orchestra.run.smithi174.stderr:bash: ntpq: command not found 2023-07-12T01:52:19.134 INFO:teuthology.orchestra.run.smithi174.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-12T01:52:19.134 INFO:teuthology.orchestra.run.smithi174.stdout:=============================================================================== 2023-07-12T01:52:19.135 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-12T01:52:19.135 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-12T01:52:19.135 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-12T01:52:19.135 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-12T01:52:19.136 INFO:teuthology.run_tasks:Running task install... 2023-07-12T01:52:19.145 DEBUG:teuthology.task.install:project ceph 2023-07-12T01:52:19.145 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b5891ed62e7aba6227aed8ab09a4dd0853a1caf2'}} 2023-07-12T01:52:19.146 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b5891ed62e7aba6227aed8ab09a4dd0853a1caf2'} 2023-07-12T01:52:19.146 INFO:teuthology.task.install:Using flavor: default 2023-07-12T01:52:19.151 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-07-12T01:52:19.152 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-07-12T01:52:19.152 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b5891ed62e7aba6227aed8ab09a4dd0853a1caf2', 'tag': None, 'wait_for_package': False} 2023-07-12T01:52:19.153 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b5891ed62e7aba6227aed8ab09a4dd0853a1caf2 2023-07-12T01:52:19.155 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b5891ed62e7aba6227aed8ab09a4dd0853a1caf2', 'tag': None, 'wait_for_package': False} 2023-07-12T01:52:19.155 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b5891ed62e7aba6227aed8ab09a4dd0853a1caf2 2023-07-12T01:52:19.156 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b5891ed62e7aba6227aed8ab09a4dd0853a1caf2', 'tag': None, 'wait_for_package': False} 2023-07-12T01:52:19.156 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b5891ed62e7aba6227aed8ab09a4dd0853a1caf2 2023-07-12T01:52:19.301 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230710.195410/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/centos/8/flavors/default/ 2023-07-12T01:52:19.301 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4828.gb5891ed6 2023-07-12T01:52:19.313 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230710.195410/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/centos/8/flavors/default/ 2023-07-12T01:52:19.314 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4828.gb5891ed6 2023-07-12T01:52:19.370 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230710.195410/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/centos/8/flavors/default/ 2023-07-12T01:52:19.370 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4828.gb5891ed6 2023-07-12T01:52:19.472 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230710.195410/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230710.195410/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230710.195410/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-12T01:52:19.472 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-07-12T01:52:19.472 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-12T01:52:19.478 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230710.195410/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230710.195410/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230710.195410/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-12T01:52:19.479 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-07-12T01:52:19.479 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-12T01:52:19.508 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-12T01:52:19.509 DEBUG:teuthology.orchestra.run.smithi079:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-12T01:52:19.531 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230710.195410/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230710.195410/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230710.195410/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-12T01:52:19.531 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-07-12T01:52:19.531 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-12T01:52:19.543 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-12T01:52:19.543 DEBUG:teuthology.orchestra.run.smithi174:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-12T01:52:19.565 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-12T01:52:19.565 DEBUG:teuthology.orchestra.run.smithi060:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b5891ed62e7aba6227aed8ab09a4dd0853a1caf2/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-12T01:52:19.579 DEBUG:teuthology.orchestra.run.smithi079:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-12T01:52:19.637 DEBUG:teuthology.orchestra.run.smithi060:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-12T01:52:19.652 DEBUG:teuthology.orchestra.run.smithi174:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-12T01:52:19.658 DEBUG:teuthology.orchestra.run.smithi079:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-12T01:52:19.719 DEBUG:teuthology.orchestra.run.smithi060:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-12T01:52:19.725 INFO:teuthology.orchestra.run.smithi079.stdout:check_obsoletes = 1 2023-07-12T01:52:19.727 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum clean all 2023-07-12T01:52:19.746 DEBUG:teuthology.orchestra.run.smithi174:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-12T01:52:19.789 INFO:teuthology.orchestra.run.smithi060.stdout:check_obsoletes = 1 2023-07-12T01:52:19.791 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum clean all 2023-07-12T01:52:19.813 INFO:teuthology.orchestra.run.smithi174.stdout:check_obsoletes = 1 2023-07-12T01:52:19.816 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum clean all 2023-07-12T01:52:19.997 INFO:teuthology.orchestra.run.smithi079.stdout:73 files removed 2023-07-12T01:52:20.024 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-12T01:52:20.078 INFO:teuthology.orchestra.run.smithi060.stdout:73 files removed 2023-07-12T01:52:20.107 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-12T01:52:20.158 INFO:teuthology.orchestra.run.smithi174.stdout:73 files removed 2023-07-12T01:52:20.193 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-12T01:52:20.704 INFO:teuthology.orchestra.run.smithi079.stdout:ceph packages for x86_64 264 kB/s | 81 kB 00:00 2023-07-12T01:52:20.808 INFO:teuthology.orchestra.run.smithi060.stdout:ceph packages for x86_64 269 kB/s | 81 kB 00:00 2023-07-12T01:52:20.996 INFO:teuthology.orchestra.run.smithi079.stdout:ceph noarch packages 37 kB/s | 9.4 kB 00:00 2023-07-12T01:52:21.110 INFO:teuthology.orchestra.run.smithi174.stdout:ceph packages for x86_64 212 kB/s | 81 kB 00:00 2023-07-12T01:52:21.166 INFO:teuthology.orchestra.run.smithi060.stdout:ceph noarch packages 30 kB/s | 9.4 kB 00:00 2023-07-12T01:52:21.297 INFO:teuthology.orchestra.run.smithi079.stdout:ceph source packages 5.4 kB/s | 1.5 kB 00:00 2023-07-12T01:52:21.436 INFO:teuthology.orchestra.run.smithi174.stdout:ceph noarch packages 33 kB/s | 9.4 kB 00:00 2023-07-12T01:52:21.526 INFO:teuthology.orchestra.run.smithi060.stdout:ceph source packages 4.5 kB/s | 1.5 kB 00:00 2023-07-12T01:52:21.820 INFO:teuthology.orchestra.run.smithi174.stdout:ceph source packages 4.2 kB/s | 1.5 kB 00:00 2023-07-12T01:53:54.598 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 8 - AppStream 337 kB/s | 31 MB 01:33 2023-07-12T01:54:04.796 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 8 - BaseOS 9.3 MB/s | 41 MB 00:04 2023-07-12T01:54:11.479 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 8 - Extras 33 kB/s | 18 kB 00:00 2023-07-12T01:54:12.214 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 8 - Extras common packages 12 kB/s | 6.6 kB 00:00 2023-07-12T01:54:14.098 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 8 - PowerTools 3.6 MB/s | 6.3 MB 00:01 2023-07-12T01:54:18.049 INFO:teuthology.orchestra.run.smithi079.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-07-12T01:54:20.569 INFO:teuthology.orchestra.run.smithi079.stdout:Extra Packages for Enterprise Linux 6.6 MB/s | 16 MB 00:02 2023-07-12T01:54:24.574 INFO:teuthology.orchestra.run.smithi079.stdout:lab-extras 357 kB/s | 24 kB 00:00 2023-07-12T01:54:28.420 INFO:teuthology.orchestra.run.smithi079.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-12T01:54:28.421 INFO:teuthology.orchestra.run.smithi079.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-12T01:54:28.433 INFO:teuthology.orchestra.run.smithi079.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-07-12T01:54:28.434 INFO:teuthology.orchestra.run.smithi079.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-07-12T01:54:28.434 INFO:teuthology.orchestra.run.smithi079.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-07-12T01:54:28.435 INFO:teuthology.orchestra.run.smithi079.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-07-12T01:54:28.436 INFO:teuthology.orchestra.run.smithi079.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-12T01:54:28.438 INFO:teuthology.orchestra.run.smithi079.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-12T01:54:28.441 INFO:teuthology.orchestra.run.smithi079.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-12T01:54:28.442 INFO:teuthology.orchestra.run.smithi079.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-12T01:54:28.623 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2023-07-12T01:54:28.636 INFO:teuthology.orchestra.run.smithi079.stdout:==================================================================================================== 2023-07-12T01:54:28.637 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repository Size 2023-07-12T01:54:28.637 INFO:teuthology.orchestra.run.smithi079.stdout:==================================================================================================== 2023-07-12T01:54:28.637 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2023-07-12T01:54:28.637 INFO:teuthology.orchestra.run.smithi079.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-07-12T01:54:28.637 INFO:teuthology.orchestra.run.smithi079.stdout: ceph x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 6.4 k 2023-07-12T01:54:28.637 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-base x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 5.4 M 2023-07-12T01:54:28.637 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-fuse x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 848 k 2023-07-12T01:54:28.638 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 165 k 2023-07-12T01:54:28.638 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 1.5 M 2023-07-12T01:54:28.638 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 129 k 2023-07-12T01:54:28.638 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 1.7 M 2023-07-12T01:54:28.638 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 7.4 M 2023-07-12T01:54:28.638 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-rook noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 47 k 2023-07-12T01:54:28.639 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-radosgw x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 13 M 2023-07-12T01:54:28.639 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-test x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 48 M 2023-07-12T01:54:28.639 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-volume noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 258 k 2023-07-12T01:54:28.639 INFO:teuthology.orchestra.run.smithi079.stdout: cephadm noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 164 k 2023-07-12T01:54:28.639 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-mirror x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 258 k 2023-07-12T01:54:28.639 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-top noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 18 k 2023-07-12T01:54:28.639 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-07-12T01:54:28.639 INFO:teuthology.orchestra.run.smithi079.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-07-12T01:54:28.640 INFO:teuthology.orchestra.run.smithi079.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-07-12T01:54:28.640 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs-devel x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 31 k 2023-07-12T01:54:28.640 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs2 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 771 k 2023-07-12T01:54:28.640 INFO:teuthology.orchestra.run.smithi079.stdout: librados-devel x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 139 k 2023-07-12T01:54:28.640 INFO:teuthology.orchestra.run.smithi079.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-07-12T01:54:28.640 INFO:teuthology.orchestra.run.smithi079.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-07-12T01:54:28.640 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-07-12T01:54:28.641 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql x86_64 10.23-1.module_el8+300+2c53004c appstream 1.6 M 2023-07-12T01:54:28.641 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-contrib x86_64 10.23-1.module_el8+300+2c53004c appstream 903 k 2023-07-12T01:54:28.641 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-server x86_64 10.23-1.module_el8+300+2c53004c appstream 5.1 M 2023-07-12T01:54:28.641 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cephfs x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 197 k 2023-07-12T01:54:28.641 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rados x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 371 k 2023-07-12T01:54:28.641 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rbd x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 364 k 2023-07-12T01:54:28.641 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rgw x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 107 k 2023-07-12T01:54:28.642 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-fuse x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 94 k 2023-07-12T01:54:28.642 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-mirror x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 3.4 M 2023-07-12T01:54:28.642 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-nbd x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 180 k 2023-07-12T01:54:28.642 INFO:teuthology.orchestra.run.smithi079.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-07-12T01:54:28.642 INFO:teuthology.orchestra.run.smithi079.stdout:Upgrading: 2023-07-12T01:54:28.642 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-8.el8 baseos 143 k 2023-07-12T01:54:28.642 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-07-12T01:54:28.642 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-07-12T01:54:28.643 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-07-12T01:54:28.643 INFO:teuthology.orchestra.run.smithi079.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-07-12T01:54:28.643 INFO:teuthology.orchestra.run.smithi079.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-07-12T01:54:28.643 INFO:teuthology.orchestra.run.smithi079.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-07-12T01:54:28.643 INFO:teuthology.orchestra.run.smithi079.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-07-12T01:54:28.643 INFO:teuthology.orchestra.run.smithi079.stdout: librados2 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 3.7 M 2023-07-12T01:54:28.643 INFO:teuthology.orchestra.run.smithi079.stdout: librbd1 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 3.6 M 2023-07-12T01:54:28.644 INFO:teuthology.orchestra.run.smithi079.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-07-12T01:54:28.644 INFO:teuthology.orchestra.run.smithi079.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-07-12T01:54:28.644 INFO:teuthology.orchestra.run.smithi079.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-07-12T01:54:28.644 INFO:teuthology.orchestra.run.smithi079.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-07-12T01:54:28.644 INFO:teuthology.orchestra.run.smithi079.stdout: xfsdump x86_64 3.1.8-6.el8 baseos 334 k 2023-07-12T01:54:28.644 INFO:teuthology.orchestra.run.smithi079.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-07-12T01:54:28.644 INFO:teuthology.orchestra.run.smithi079.stdout:Installing dependencies: 2023-07-12T01:54:28.644 INFO:teuthology.orchestra.run.smithi079.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-07-12T01:54:28.645 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-common x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 22 M 2023-07-12T01:54:28.645 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 23 k 2023-07-12T01:54:28.645 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mds x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 2.3 M 2023-07-12T01:54:28.645 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 240 k 2023-07-12T01:54:28.645 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mon x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 4.6 M 2023-07-12T01:54:28.645 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-osd x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 18 M 2023-07-12T01:54:28.645 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 15 k 2023-07-12T01:54:28.646 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-selinux x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 24 k 2023-07-12T01:54:28.646 INFO:teuthology.orchestra.run.smithi079.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-07-12T01:54:28.646 INFO:teuthology.orchestra.run.smithi079.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-12T01:54:28.646 INFO:teuthology.orchestra.run.smithi079.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-07-12T01:54:28.646 INFO:teuthology.orchestra.run.smithi079.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-07-12T01:54:28.646 INFO:teuthology.orchestra.run.smithi079.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-07-12T01:54:28.646 INFO:teuthology.orchestra.run.smithi079.stdout: libcephsqlite x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 137 k 2023-07-12T01:54:28.646 INFO:teuthology.orchestra.run.smithi079.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-07-12T01:54:28.647 INFO:teuthology.orchestra.run.smithi079.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-07-12T01:54:28.647 INFO:teuthology.orchestra.run.smithi079.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-12T01:54:28.647 INFO:teuthology.orchestra.run.smithi079.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-07-12T01:54:28.647 INFO:teuthology.orchestra.run.smithi079.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-07-12T01:54:28.647 INFO:teuthology.orchestra.run.smithi079.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-07-12T01:54:28.647 INFO:teuthology.orchestra.run.smithi079.stdout: libradosstriper1 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 473 k 2023-07-12T01:54:28.647 INFO:teuthology.orchestra.run.smithi079.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-07-12T01:54:28.647 INFO:teuthology.orchestra.run.smithi079.stdout: librgw2 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 6.7 M 2023-07-12T01:54:28.648 INFO:teuthology.orchestra.run.smithi079.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-07-12T01:54:28.648 INFO:teuthology.orchestra.run.smithi079.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-07-12T01:54:28.648 INFO:teuthology.orchestra.run.smithi079.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-12T01:54:28.648 INFO:teuthology.orchestra.run.smithi079.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-07-12T01:54:28.648 INFO:teuthology.orchestra.run.smithi079.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-07-12T01:54:28.648 INFO:teuthology.orchestra.run.smithi079.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-07-12T01:54:28.649 INFO:teuthology.orchestra.run.smithi079.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-07-12T01:54:28.649 INFO:teuthology.orchestra.run.smithi079.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-07-12T01:54:28.649 INFO:teuthology.orchestra.run.smithi079.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-07-12T01:54:28.649 INFO:teuthology.orchestra.run.smithi079.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-07-12T01:54:28.649 INFO:teuthology.orchestra.run.smithi079.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-07-12T01:54:28.649 INFO:teuthology.orchestra.run.smithi079.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-07-12T01:54:28.649 INFO:teuthology.orchestra.run.smithi079.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-12T01:54:28.650 INFO:teuthology.orchestra.run.smithi079.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-07-12T01:54:28.650 INFO:teuthology.orchestra.run.smithi079.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-12T01:54:28.650 INFO:teuthology.orchestra.run.smithi079.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-12T01:54:28.650 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-12T01:54:28.650 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-argparse x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 45 k 2023-07-12T01:54:28.650 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-common x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 122 k 2023-07-12T01:54:28.650 INFO:teuthology.orchestra.run.smithi079.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-12T01:54:28.650 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-07-12T01:54:28.651 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-12T01:54:28.651 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-12T01:54:28.651 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-07-12T01:54:28.651 INFO:teuthology.orchestra.run.smithi079.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-12T01:54:28.651 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-12T01:54:28.651 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-12T01:54:28.651 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-07-12T01:54:28.651 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-07-12T01:54:28.652 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-07-12T01:54:28.652 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-07-12T01:54:28.652 INFO:teuthology.orchestra.run.smithi079.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-12T01:54:28.652 INFO:teuthology.orchestra.run.smithi079.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-12T01:54:28.652 INFO:teuthology.orchestra.run.smithi079.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-07-12T01:54:28.652 INFO:teuthology.orchestra.run.smithi079.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-07-12T01:54:28.652 INFO:teuthology.orchestra.run.smithi079.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-12T01:54:28.653 INFO:teuthology.orchestra.run.smithi079.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-12T01:54:28.653 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-07-12T01:54:28.653 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-07-12T01:54:28.653 INFO:teuthology.orchestra.run.smithi079.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-07-12T01:54:28.653 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-12T01:54:28.653 INFO:teuthology.orchestra.run.smithi079.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-12T01:54:28.653 INFO:teuthology.orchestra.run.smithi079.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-07-12T01:54:28.653 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-07-12T01:54:28.654 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-07-12T01:54:28.654 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-07-12T01:54:28.654 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-07-12T01:54:28.654 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-07-12T01:54:28.654 INFO:teuthology.orchestra.run.smithi079.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-12T01:54:28.654 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-07-12T01:54:28.654 INFO:teuthology.orchestra.run.smithi079.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-12T01:54:28.654 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-12T01:54:28.655 INFO:teuthology.orchestra.run.smithi079.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-07-12T01:54:28.655 INFO:teuthology.orchestra.run.smithi079.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-12T01:54:28.655 INFO:teuthology.orchestra.run.smithi079.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-12T01:54:28.655 INFO:teuthology.orchestra.run.smithi079.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-12T01:54:28.655 INFO:teuthology.orchestra.run.smithi079.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-12T01:54:28.655 INFO:teuthology.orchestra.run.smithi079.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-12T01:54:28.655 INFO:teuthology.orchestra.run.smithi079.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-12T01:54:28.656 INFO:teuthology.orchestra.run.smithi079.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-12T01:54:28.656 INFO:teuthology.orchestra.run.smithi079.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-12T01:54:28.656 INFO:teuthology.orchestra.run.smithi079.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-07-12T01:54:28.656 INFO:teuthology.orchestra.run.smithi079.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-12T01:54:28.656 INFO:teuthology.orchestra.run.smithi079.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-07-12T01:54:28.656 INFO:teuthology.orchestra.run.smithi079.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-12T01:54:28.656 INFO:teuthology.orchestra.run.smithi079.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-07-12T01:54:28.656 INFO:teuthology.orchestra.run.smithi079.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-07-12T01:54:28.657 INFO:teuthology.orchestra.run.smithi079.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-07-12T01:54:28.657 INFO:teuthology.orchestra.run.smithi079.stdout:Enabling module streams: 2023-07-12T01:54:28.657 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql 10 2023-07-12T01:54:28.657 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-07-12T01:54:28.657 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2023-07-12T01:54:28.657 INFO:teuthology.orchestra.run.smithi079.stdout:==================================================================================================== 2023-07-12T01:54:28.657 INFO:teuthology.orchestra.run.smithi079.stdout:Install 128 Packages 2023-07-12T01:54:28.658 INFO:teuthology.orchestra.run.smithi079.stdout:Upgrade 16 Packages 2023-07-12T01:54:28.658 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-07-12T01:54:28.658 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 212 M 2023-07-12T01:54:28.658 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2023-07-12T01:54:29.191 INFO:teuthology.orchestra.run.smithi079.stdout:(1/144): ceph-18.0.0-4828.gb5891ed6.el8.x86_64. 54 kB/s | 6.4 kB 00:00 2023-07-12T01:54:29.467 INFO:teuthology.orchestra.run.smithi079.stdout:(2/144): ceph-fuse-18.0.0-4828.gb5891ed6.el8.x8 3.0 MB/s | 848 kB 00:00 2023-07-12T01:54:29.542 INFO:teuthology.orchestra.run.smithi079.stdout:(3/144): ceph-immutable-object-cache-18.0.0-482 2.2 MB/s | 165 kB 00:00 2023-07-12T01:54:30.101 INFO:teuthology.orchestra.run.smithi079.stdout:(4/144): ceph-mds-18.0.0-4828.gb5891ed6.el8.x86 4.1 MB/s | 2.3 MB 00:00 2023-07-12T01:54:30.376 INFO:teuthology.orchestra.run.smithi079.stdout:(5/144): ceph-common-18.0.0-4828.gb5891ed6.el8. 17 MB/s | 22 MB 00:01 2023-07-12T01:54:30.435 INFO:teuthology.orchestra.run.smithi079.stdout:(6/144): ceph-mgr-18.0.0-4828.gb5891ed6.el8.x86 4.6 MB/s | 1.5 MB 00:00 2023-07-12T01:54:30.668 INFO:teuthology.orchestra.run.smithi079.stdout:(7/144): ceph-mon-18.0.0-4828.gb5891ed6.el8.x86 16 MB/s | 4.6 MB 00:00 2023-07-12T01:54:31.494 INFO:teuthology.orchestra.run.smithi079.stdout:(8/144): ceph-radosgw-18.0.0-4828.gb5891ed6.el8 16 MB/s | 13 MB 00:00 2023-07-12T01:54:31.535 INFO:teuthology.orchestra.run.smithi079.stdout:(9/144): ceph-selinux-18.0.0-4828.gb5891ed6.el8 589 kB/s | 24 kB 00:00 2023-07-12T01:54:32.794 INFO:teuthology.orchestra.run.smithi079.stdout:(10/144): ceph-osd-18.0.0-4828.gb5891ed6.el8.x8 7.5 MB/s | 18 MB 00:02 2023-07-12T01:54:32.844 INFO:teuthology.orchestra.run.smithi079.stdout:(11/144): cephfs-mirror-18.0.0-4828.gb5891ed6.e 5.1 MB/s | 258 kB 00:00 2023-07-12T01:54:32.912 INFO:teuthology.orchestra.run.smithi079.stdout:(12/144): libcephfs-devel-18.0.0-4828.gb5891ed6 466 kB/s | 31 kB 00:00 2023-07-12T01:54:33.070 INFO:teuthology.orchestra.run.smithi079.stdout:(13/144): libcephfs2-18.0.0-4828.gb5891ed6.el8. 4.8 MB/s | 771 kB 00:00 2023-07-12T01:54:33.154 INFO:teuthology.orchestra.run.smithi079.stdout:(14/144): libcephsqlite-18.0.0-4828.gb5891ed6.e 1.6 MB/s | 137 kB 00:00 2023-07-12T01:54:33.229 INFO:teuthology.orchestra.run.smithi079.stdout:(15/144): librados-devel-18.0.0-4828.gb5891ed6. 1.8 MB/s | 139 kB 00:00 2023-07-12T01:54:33.329 INFO:teuthology.orchestra.run.smithi079.stdout:(16/144): libradosstriper1-18.0.0-4828.gb5891ed 4.6 MB/s | 473 kB 00:00 2023-07-12T01:54:34.246 INFO:teuthology.orchestra.run.smithi079.stdout:(17/144): ceph-test-18.0.0-4828.gb5891ed6.el8.x 18 MB/s | 48 MB 00:02 2023-07-12T01:54:34.346 INFO:teuthology.orchestra.run.smithi079.stdout:(18/144): librgw2-18.0.0-4828.gb5891ed6.el8.x86 6.6 MB/s | 6.7 MB 00:01 2023-07-12T01:54:34.363 INFO:teuthology.orchestra.run.smithi079.stdout:(19/144): python3-ceph-argparse-18.0.0-4828.gb5 383 kB/s | 45 kB 00:00 2023-07-12T01:54:34.397 INFO:teuthology.orchestra.run.smithi079.stdout:(20/144): python3-ceph-common-18.0.0-4828.gb589 2.4 MB/s | 122 kB 00:00 2023-07-12T01:54:34.422 INFO:teuthology.orchestra.run.smithi079.stdout:(21/144): python3-cephfs-18.0.0-4828.gb5891ed6. 3.3 MB/s | 197 kB 00:00 2023-07-12T01:54:34.447 INFO:teuthology.orchestra.run.smithi079.stdout:(22/144): python3-rados-18.0.0-4828.gb5891ed6.e 7.2 MB/s | 371 kB 00:00 2023-07-12T01:54:34.473 INFO:teuthology.orchestra.run.smithi079.stdout:(23/144): python3-rbd-18.0.0-4828.gb5891ed6.el8 7.1 MB/s | 364 kB 00:00 2023-07-12T01:54:34.498 INFO:teuthology.orchestra.run.smithi079.stdout:(24/144): python3-rgw-18.0.0-4828.gb5891ed6.el8 2.1 MB/s | 107 kB 00:00 2023-07-12T01:54:34.524 INFO:teuthology.orchestra.run.smithi079.stdout:(25/144): rbd-fuse-18.0.0-4828.gb5891ed6.el8.x8 1.8 MB/s | 94 kB 00:00 2023-07-12T01:54:34.582 INFO:teuthology.orchestra.run.smithi079.stdout:(26/144): rbd-nbd-18.0.0-4828.gb5891ed6.el8.x86 3.0 MB/s | 180 kB 00:00 2023-07-12T01:54:34.649 INFO:teuthology.orchestra.run.smithi079.stdout:(27/144): ceph-base-18.0.0-4828.gb5891ed6.el8.x 989 kB/s | 5.4 MB 00:05 2023-07-12T01:54:34.675 INFO:teuthology.orchestra.run.smithi079.stdout:(28/144): ceph-grafana-dashboards-18.0.0-4828.g 251 kB/s | 23 kB 00:00 2023-07-12T01:54:34.800 INFO:teuthology.orchestra.run.smithi079.stdout:(29/144): rbd-mirror-18.0.0-4828.gb5891ed6.el8. 11 MB/s | 3.4 MB 00:00 2023-07-12T01:54:34.817 INFO:teuthology.orchestra.run.smithi079.stdout:(30/144): ceph-mgr-cephadm-18.0.0-4828.gb5891ed 772 kB/s | 129 kB 00:00 2023-07-12T01:54:34.876 INFO:teuthology.orchestra.run.smithi079.stdout:(31/144): ceph-mgr-dashboard-18.0.0-4828.gb5891 8.5 MB/s | 1.7 MB 00:00 2023-07-12T01:54:34.945 INFO:teuthology.orchestra.run.smithi079.stdout:(32/144): ceph-mgr-rook-18.0.0-4828.gb5891ed6.e 690 kB/s | 47 kB 00:00 2023-07-12T01:54:35.001 INFO:teuthology.orchestra.run.smithi079.stdout:(33/144): ceph-prometheus-alerts-18.0.0-4828.gb 259 kB/s | 15 kB 00:00 2023-07-12T01:54:35.026 INFO:teuthology.orchestra.run.smithi079.stdout:(34/144): ceph-mgr-modules-core-18.0.0-4828.gb5 1.1 MB/s | 240 kB 00:00 2023-07-12T01:54:35.060 INFO:teuthology.orchestra.run.smithi079.stdout:(35/144): ceph-volume-18.0.0-4828.gb5891ed6.el8 4.3 MB/s | 258 kB 00:00 2023-07-12T01:54:35.110 INFO:teuthology.orchestra.run.smithi079.stdout:(36/144): cephfs-top-18.0.0-4828.gb5891ed6.el8. 359 kB/s | 18 kB 00:00 2023-07-12T01:54:35.144 INFO:teuthology.orchestra.run.smithi079.stdout:(37/144): cephadm-18.0.0-4828.gb5891ed6.el8.noa 1.4 MB/s | 164 kB 00:00 2023-07-12T01:54:35.337 INFO:teuthology.orchestra.run.smithi079.stdout:(38/144): ceph-mgr-diskprediction-local-18.0.0- 14 MB/s | 7.4 MB 00:00 2023-07-12T01:54:37.669 INFO:teuthology.orchestra.run.smithi079.stdout:(39/144): flex-2.6.1-9.el8.x86_64.rpm 137 kB/s | 320 kB 00:02 2023-07-12T01:54:38.711 INFO:teuthology.orchestra.run.smithi079.stdout:(40/144): jq-1.6-7.el8.x86_64.rpm 194 kB/s | 202 kB 00:01 2023-07-12T01:54:38.886 INFO:teuthology.orchestra.run.smithi079.stdout:(41/144): automake-1.16.1-7.el8.noarch.rpm 189 kB/s | 713 kB 00:03 2023-07-12T01:54:40.236 INFO:teuthology.orchestra.run.smithi079.stdout:(42/144): librdkafka-0.11.4-3.el8.x86_64.rpm 262 kB/s | 354 kB 00:01 2023-07-12T01:54:41.720 INFO:teuthology.orchestra.run.smithi079.stdout:(43/144): libpq-13.5-1.el8.x86_64.rpm 66 kB/s | 198 kB 00:03 2023-07-12T01:54:41.970 INFO:teuthology.orchestra.run.smithi079.stdout:(44/144): bison-3.0.4-10.el8.x86_64.rpm 101 kB/s | 688 kB 00:06 2023-07-12T01:54:42.729 INFO:teuthology.orchestra.run.smithi079.stdout:(45/144): oniguruma-6.8.2-2.el8.x86_64.rpm 247 kB/s | 187 kB 00:00 2023-07-12T01:54:43.104 INFO:teuthology.orchestra.run.smithi079.stdout:(46/144): libtool-2.4.6-25.el8.x86_64.rpm 247 kB/s | 709 kB 00:02 2023-07-12T01:54:43.812 INFO:teuthology.orchestra.run.smithi079.stdout:(47/144): lttng-ust-2.8.1-11.el8.x86_64.rpm 124 kB/s | 259 kB 00:02 2023-07-12T01:54:51.170 INFO:teuthology.orchestra.run.smithi079.stdout:(48/144): postgresql-10.23-1.module_el8+300+2c5 218 kB/s | 1.6 MB 00:07 2023-07-12T01:54:54.478 INFO:teuthology.orchestra.run.smithi079.stdout:(49/144): postgresql-contrib-10.23-1.module_el8 273 kB/s | 903 kB 00:03 2023-07-12T01:54:59.602 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 8 - AppStream 199 kB/s | 31 MB 02:38 2023-07-12T01:55:06.251 INFO:teuthology.orchestra.run.smithi079.stdout:(50/144): openblas-threads-0.3.15-4.el8.x86_64. 215 kB/s | 4.9 MB 00:23 2023-07-12T01:55:12.318 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 8 - BaseOS 6.0 MB/s | 41 MB 00:06 2023-07-12T01:55:13.625 INFO:teuthology.orchestra.run.smithi079.stdout:(51/144): postgresql-server-10.23-1.module_el8+ 273 kB/s | 5.1 MB 00:19 2023-07-12T01:55:16.341 INFO:teuthology.orchestra.run.smithi079.stdout:(52/144): python3-jinja2-2.10.1-3.el8.noarch.rp 198 kB/s | 538 kB 00:02 2023-07-12T01:55:16.758 INFO:teuthology.orchestra.run.smithi079.stdout:(53/144): python3-jsonpatch-1.21-2.el8.noarch.r 64 kB/s | 27 kB 00:00 2023-07-12T01:55:16.909 INFO:teuthology.orchestra.run.smithi079.stdout:(54/144): python3-jsonpointer-1.10-11.el8.noarc 133 kB/s | 20 kB 00:00 2023-07-12T01:55:17.526 INFO:teuthology.orchestra.run.smithi079.stdout:(55/144): python3-mako-1.0.6-14.el8.noarch.rpm 255 kB/s | 157 kB 00:00 2023-07-12T01:55:17.734 INFO:teuthology.orchestra.run.smithi079.stdout:(56/144): python3-markupsafe-0.23-19.el8.x86_64 186 kB/s | 39 kB 00:00 2023-07-12T01:55:19.134 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 8 - Extras 43 kB/s | 18 kB 00:00 2023-07-12T01:55:19.768 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 8 - Extras common packages 15 kB/s | 6.6 kB 00:00 2023-07-12T01:55:21.011 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 8 - PowerTools 5.8 MB/s | 6.3 MB 00:01 2023-07-12T01:55:23.675 INFO:teuthology.orchestra.run.smithi079.stdout:(57/144): python3-babel-2.5.1-7.el8.noarch.rpm 281 kB/s | 4.8 MB 00:17 2023-07-12T01:55:24.550 INFO:teuthology.orchestra.run.smithi079.stdout:(58/144): python3-numpy-f2py-1.14.3-10.el8.x86_ 257 kB/s | 225 kB 00:00 2023-07-12T01:55:24.779 INFO:teuthology.orchestra.run.smithi060.stdout:Copr repo for python3-asyncssh owned by ceph 1.4 kB/s | 3.5 kB 00:02 2023-07-12T01:55:26.179 INFO:teuthology.orchestra.run.smithi060.stdout:Extra Packages for Enterprise Linux 13 MB/s | 16 MB 00:01 2023-07-12T01:55:29.633 INFO:teuthology.orchestra.run.smithi079.stdout:(59/144): python3-prettytable-0.7.2-14.el8.noar 8.6 kB/s | 44 kB 00:05 2023-07-12T01:55:30.280 INFO:teuthology.orchestra.run.smithi060.stdout:lab-extras 342 kB/s | 24 kB 00:00 2023-07-12T01:55:30.608 INFO:teuthology.orchestra.run.smithi079.stdout:(60/144): python3-pyOpenSSL-19.0.0-1.el8.noarch 106 kB/s | 103 kB 00:00 2023-07-12T01:55:31.175 INFO:teuthology.orchestra.run.smithi079.stdout:(61/144): python3-pyasn1-0.3.7-6.el8.noarch.rpm 223 kB/s | 126 kB 00:00 2023-07-12T01:55:31.633 INFO:teuthology.orchestra.run.smithi079.stdout:(62/144): python3-pyasn1-modules-0.3.7-6.el8.no 240 kB/s | 110 kB 00:00 2023-07-12T01:55:31.742 INFO:teuthology.orchestra.run.smithi079.stdout:(63/144): python3-numpy-1.14.3-10.el8.x86_64.rp 273 kB/s | 3.7 MB 00:14 2023-07-12T01:55:31.892 INFO:teuthology.orchestra.run.smithi079.stdout:(64/144): python3-pytz-2017.2-9.el8.noarch.rpm 209 kB/s | 54 kB 00:00 2023-07-12T01:55:33.268 INFO:teuthology.orchestra.run.smithi079.stdout:(65/144): openblas-0.3.15-4.el8.x86_64.rpm 96 kB/s | 4.7 MB 00:50 2023-07-12T01:55:34.009 INFO:teuthology.orchestra.run.smithi079.stdout:(66/144): python3-werkzeug-0.12.2-4.el8.noarch. 216 kB/s | 457 kB 00:02 2023-07-12T01:55:34.335 INFO:teuthology.orchestra.run.smithi079.stdout:(67/144): uuid-1.6.2-43.el8.x86_64.rpm 197 kB/s | 64 kB 00:00 2023-07-12T01:55:34.339 INFO:teuthology.orchestra.run.smithi060.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-12T01:55:34.340 INFO:teuthology.orchestra.run.smithi060.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-12T01:55:34.353 INFO:teuthology.orchestra.run.smithi060.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-07-12T01:55:34.353 INFO:teuthology.orchestra.run.smithi060.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-07-12T01:55:34.354 INFO:teuthology.orchestra.run.smithi060.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-07-12T01:55:34.355 INFO:teuthology.orchestra.run.smithi060.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-07-12T01:55:34.356 INFO:teuthology.orchestra.run.smithi060.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-12T01:55:34.358 INFO:teuthology.orchestra.run.smithi060.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-12T01:55:34.361 INFO:teuthology.orchestra.run.smithi060.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-12T01:55:34.362 INFO:teuthology.orchestra.run.smithi060.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-12T01:55:34.554 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2023-07-12T01:55:34.568 INFO:teuthology.orchestra.run.smithi060.stdout:==================================================================================================== 2023-07-12T01:55:34.569 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2023-07-12T01:55:34.569 INFO:teuthology.orchestra.run.smithi060.stdout:==================================================================================================== 2023-07-12T01:55:34.569 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2023-07-12T01:55:34.569 INFO:teuthology.orchestra.run.smithi060.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-07-12T01:55:34.569 INFO:teuthology.orchestra.run.smithi060.stdout: ceph x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 6.4 k 2023-07-12T01:55:34.569 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-base x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 5.4 M 2023-07-12T01:55:34.570 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-fuse x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 848 k 2023-07-12T01:55:34.570 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 165 k 2023-07-12T01:55:34.570 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 1.5 M 2023-07-12T01:55:34.570 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 129 k 2023-07-12T01:55:34.570 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 1.7 M 2023-07-12T01:55:34.570 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 7.4 M 2023-07-12T01:55:34.570 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-rook noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 47 k 2023-07-12T01:55:34.571 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-radosgw x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 13 M 2023-07-12T01:55:34.571 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-test x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 48 M 2023-07-12T01:55:34.571 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-volume noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 258 k 2023-07-12T01:55:34.571 INFO:teuthology.orchestra.run.smithi060.stdout: cephadm noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 164 k 2023-07-12T01:55:34.571 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-mirror x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 258 k 2023-07-12T01:55:34.571 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-top noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 18 k 2023-07-12T01:55:34.571 INFO:teuthology.orchestra.run.smithi060.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-07-12T01:55:34.571 INFO:teuthology.orchestra.run.smithi060.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-07-12T01:55:34.572 INFO:teuthology.orchestra.run.smithi060.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-07-12T01:55:34.572 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs-devel x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 31 k 2023-07-12T01:55:34.572 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs2 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 771 k 2023-07-12T01:55:34.572 INFO:teuthology.orchestra.run.smithi060.stdout: librados-devel x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 139 k 2023-07-12T01:55:34.572 INFO:teuthology.orchestra.run.smithi060.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-07-12T01:55:34.572 INFO:teuthology.orchestra.run.smithi060.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-07-12T01:55:34.572 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-07-12T01:55:34.572 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql x86_64 10.23-1.module_el8+300+2c53004c appstream 1.6 M 2023-07-12T01:55:34.573 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-contrib x86_64 10.23-1.module_el8+300+2c53004c appstream 903 k 2023-07-12T01:55:34.573 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-server x86_64 10.23-1.module_el8+300+2c53004c appstream 5.1 M 2023-07-12T01:55:34.573 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cephfs x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 197 k 2023-07-12T01:55:34.573 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rados x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 371 k 2023-07-12T01:55:34.573 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rbd x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 364 k 2023-07-12T01:55:34.573 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rgw x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 107 k 2023-07-12T01:55:34.573 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-fuse x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 94 k 2023-07-12T01:55:34.574 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-mirror x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 3.4 M 2023-07-12T01:55:34.574 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-nbd x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 180 k 2023-07-12T01:55:34.574 INFO:teuthology.orchestra.run.smithi060.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-07-12T01:55:34.574 INFO:teuthology.orchestra.run.smithi060.stdout:Upgrading: 2023-07-12T01:55:34.574 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-8.el8 baseos 143 k 2023-07-12T01:55:34.574 INFO:teuthology.orchestra.run.smithi060.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-07-12T01:55:34.574 INFO:teuthology.orchestra.run.smithi060.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-07-12T01:55:34.574 INFO:teuthology.orchestra.run.smithi060.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-07-12T01:55:34.575 INFO:teuthology.orchestra.run.smithi060.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-07-12T01:55:34.575 INFO:teuthology.orchestra.run.smithi060.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-07-12T01:55:34.575 INFO:teuthology.orchestra.run.smithi060.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-07-12T01:55:34.575 INFO:teuthology.orchestra.run.smithi060.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-07-12T01:55:34.575 INFO:teuthology.orchestra.run.smithi060.stdout: librados2 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 3.7 M 2023-07-12T01:55:34.575 INFO:teuthology.orchestra.run.smithi060.stdout: librbd1 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 3.6 M 2023-07-12T01:55:34.575 INFO:teuthology.orchestra.run.smithi060.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-07-12T01:55:34.575 INFO:teuthology.orchestra.run.smithi060.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-07-12T01:55:34.576 INFO:teuthology.orchestra.run.smithi060.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-07-12T01:55:34.576 INFO:teuthology.orchestra.run.smithi060.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-07-12T01:55:34.576 INFO:teuthology.orchestra.run.smithi060.stdout: xfsdump x86_64 3.1.8-6.el8 baseos 334 k 2023-07-12T01:55:34.576 INFO:teuthology.orchestra.run.smithi060.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-07-12T01:55:34.576 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2023-07-12T01:55:34.576 INFO:teuthology.orchestra.run.smithi060.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-07-12T01:55:34.576 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-common x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 22 M 2023-07-12T01:55:34.577 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 23 k 2023-07-12T01:55:34.577 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mds x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 2.3 M 2023-07-12T01:55:34.577 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 240 k 2023-07-12T01:55:34.577 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mon x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 4.6 M 2023-07-12T01:55:34.577 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-osd x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 18 M 2023-07-12T01:55:34.577 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 15 k 2023-07-12T01:55:34.577 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-selinux x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 24 k 2023-07-12T01:55:34.578 INFO:teuthology.orchestra.run.smithi060.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-07-12T01:55:34.578 INFO:teuthology.orchestra.run.smithi060.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-12T01:55:34.578 INFO:teuthology.orchestra.run.smithi060.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-07-12T01:55:34.578 INFO:teuthology.orchestra.run.smithi060.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-07-12T01:55:34.578 INFO:teuthology.orchestra.run.smithi060.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-07-12T01:55:34.578 INFO:teuthology.orchestra.run.smithi060.stdout: libcephsqlite x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 137 k 2023-07-12T01:55:34.578 INFO:teuthology.orchestra.run.smithi060.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-07-12T01:55:34.578 INFO:teuthology.orchestra.run.smithi060.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-07-12T01:55:34.579 INFO:teuthology.orchestra.run.smithi060.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-12T01:55:34.579 INFO:teuthology.orchestra.run.smithi060.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-07-12T01:55:34.579 INFO:teuthology.orchestra.run.smithi060.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-07-12T01:55:34.579 INFO:teuthology.orchestra.run.smithi060.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-07-12T01:55:34.579 INFO:teuthology.orchestra.run.smithi060.stdout: libradosstriper1 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 473 k 2023-07-12T01:55:34.579 INFO:teuthology.orchestra.run.smithi060.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-07-12T01:55:34.579 INFO:teuthology.orchestra.run.smithi060.stdout: librgw2 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 6.7 M 2023-07-12T01:55:34.579 INFO:teuthology.orchestra.run.smithi060.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-07-12T01:55:34.580 INFO:teuthology.orchestra.run.smithi060.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-07-12T01:55:34.580 INFO:teuthology.orchestra.run.smithi060.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-12T01:55:34.580 INFO:teuthology.orchestra.run.smithi060.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-07-12T01:55:34.580 INFO:teuthology.orchestra.run.smithi060.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-07-12T01:55:34.580 INFO:teuthology.orchestra.run.smithi060.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-07-12T01:55:34.580 INFO:teuthology.orchestra.run.smithi060.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-07-12T01:55:34.580 INFO:teuthology.orchestra.run.smithi060.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-07-12T01:55:34.580 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-07-12T01:55:34.581 INFO:teuthology.orchestra.run.smithi060.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-07-12T01:55:34.581 INFO:teuthology.orchestra.run.smithi060.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-07-12T01:55:34.581 INFO:teuthology.orchestra.run.smithi060.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-07-12T01:55:34.581 INFO:teuthology.orchestra.run.smithi060.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-12T01:55:34.581 INFO:teuthology.orchestra.run.smithi060.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-07-12T01:55:34.581 INFO:teuthology.orchestra.run.smithi060.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-12T01:55:34.581 INFO:teuthology.orchestra.run.smithi060.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-12T01:55:34.581 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-12T01:55:34.582 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-argparse x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 45 k 2023-07-12T01:55:34.582 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-common x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 122 k 2023-07-12T01:55:34.582 INFO:teuthology.orchestra.run.smithi060.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-12T01:55:34.582 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-07-12T01:55:34.582 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-12T01:55:34.582 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-12T01:55:34.582 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-07-12T01:55:34.582 INFO:teuthology.orchestra.run.smithi060.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-12T01:55:34.583 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-12T01:55:34.583 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-12T01:55:34.583 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-07-12T01:55:34.583 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-07-12T01:55:34.583 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-07-12T01:55:34.583 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-07-12T01:55:34.583 INFO:teuthology.orchestra.run.smithi060.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-12T01:55:34.584 INFO:teuthology.orchestra.run.smithi060.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-12T01:55:34.584 INFO:teuthology.orchestra.run.smithi060.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-07-12T01:55:34.584 INFO:teuthology.orchestra.run.smithi060.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-07-12T01:55:34.584 INFO:teuthology.orchestra.run.smithi060.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-12T01:55:34.584 INFO:teuthology.orchestra.run.smithi060.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-12T01:55:34.584 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-07-12T01:55:34.584 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-07-12T01:55:34.584 INFO:teuthology.orchestra.run.smithi060.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-07-12T01:55:34.585 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-12T01:55:34.585 INFO:teuthology.orchestra.run.smithi060.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-12T01:55:34.585 INFO:teuthology.orchestra.run.smithi060.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-07-12T01:55:34.585 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-07-12T01:55:34.585 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-07-12T01:55:34.585 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-07-12T01:55:34.585 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-07-12T01:55:34.585 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-07-12T01:55:34.586 INFO:teuthology.orchestra.run.smithi060.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-12T01:55:34.586 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-07-12T01:55:34.586 INFO:teuthology.orchestra.run.smithi060.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-12T01:55:34.586 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-12T01:55:34.586 INFO:teuthology.orchestra.run.smithi060.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-07-12T01:55:34.586 INFO:teuthology.orchestra.run.smithi060.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-12T01:55:34.586 INFO:teuthology.orchestra.run.smithi060.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-12T01:55:34.586 INFO:teuthology.orchestra.run.smithi060.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-12T01:55:34.587 INFO:teuthology.orchestra.run.smithi060.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-12T01:55:34.587 INFO:teuthology.orchestra.run.smithi060.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-12T01:55:34.587 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-12T01:55:34.587 INFO:teuthology.orchestra.run.smithi060.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-12T01:55:34.587 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-12T01:55:34.587 INFO:teuthology.orchestra.run.smithi060.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-07-12T01:55:34.587 INFO:teuthology.orchestra.run.smithi060.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-12T01:55:34.587 INFO:teuthology.orchestra.run.smithi060.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-07-12T01:55:34.588 INFO:teuthology.orchestra.run.smithi060.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-12T01:55:34.588 INFO:teuthology.orchestra.run.smithi060.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-07-12T01:55:34.588 INFO:teuthology.orchestra.run.smithi060.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-07-12T01:55:34.588 INFO:teuthology.orchestra.run.smithi060.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-07-12T01:55:34.588 INFO:teuthology.orchestra.run.smithi060.stdout:Enabling module streams: 2023-07-12T01:55:34.588 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql 10 2023-07-12T01:55:34.588 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T01:55:34.589 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2023-07-12T01:55:34.589 INFO:teuthology.orchestra.run.smithi060.stdout:==================================================================================================== 2023-07-12T01:55:34.589 INFO:teuthology.orchestra.run.smithi060.stdout:Install 128 Packages 2023-07-12T01:55:34.589 INFO:teuthology.orchestra.run.smithi060.stdout:Upgrade 16 Packages 2023-07-12T01:55:34.589 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T01:55:34.590 INFO:teuthology.orchestra.run.smithi079.stdout:(68/144): socat-1.7.4.1-1.el8.x86_64.rpm 245 kB/s | 323 kB 00:01 2023-07-12T01:55:34.590 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 212 M 2023-07-12T01:55:34.590 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2023-07-12T01:55:34.785 INFO:teuthology.orchestra.run.smithi079.stdout:(69/144): elfutils-libelf-devel-0.189-2.el8.x86 308 kB/s | 61 kB 00:00 2023-07-12T01:55:34.877 INFO:teuthology.orchestra.run.smithi079.stdout:(70/144): fuse-2.9.7-17.el8.x86_64.rpm 906 kB/s | 83 kB 00:00 2023-07-12T01:55:34.936 INFO:teuthology.orchestra.run.smithi079.stdout:(71/144): keyutils-libs-devel-1.5.10-9.el8.x86_ 824 kB/s | 48 kB 00:00 2023-07-12T01:55:34.997 INFO:teuthology.orchestra.run.smithi060.stdout:(1/144): ceph-18.0.0-4828.gb5891ed6.el8.x86_64. 35 kB/s | 6.4 kB 00:00 2023-07-12T01:55:35.103 INFO:teuthology.orchestra.run.smithi079.stdout:(72/144): krb5-devel-1.18.2-22.el8.x86_64.rpm 3.3 MB/s | 561 kB 00:00 2023-07-12T01:55:35.161 INFO:teuthology.orchestra.run.smithi079.stdout:(73/144): libaio-devel-0.3.112-1.el8.x86_64.rpm 321 kB/s | 19 kB 00:00 2023-07-12T01:55:35.203 INFO:teuthology.orchestra.run.smithi079.stdout:(74/144): xmlstarlet-1.6.1-20.el8.x86_64.rpm 81 kB/s | 71 kB 00:00 2023-07-12T01:55:35.229 INFO:teuthology.orchestra.run.smithi079.stdout:(75/144): libcom_err-devel-1.45.6-5.el8.x86_64. 578 kB/s | 39 kB 00:00 2023-07-12T01:55:35.279 INFO:teuthology.orchestra.run.smithi079.stdout:(76/144): libquadmath-8.5.0-20.el8.x86_64.rpm 3.4 MB/s | 172 kB 00:00 2023-07-12T01:55:35.338 INFO:teuthology.orchestra.run.smithi079.stdout:(77/144): librabbitmq-0.9.0-4.el8.x86_64.rpm 802 kB/s | 47 kB 00:00 2023-07-12T01:55:35.373 INFO:teuthology.orchestra.run.smithi060.stdout:(2/144): ceph-fuse-18.0.0-4828.gb5891ed6.el8.x8 2.2 MB/s | 848 kB 00:00 2023-07-12T01:55:35.430 INFO:teuthology.orchestra.run.smithi079.stdout:(78/144): libselinux-devel-2.9-8.el8.x86_64.rpm 2.1 MB/s | 200 kB 00:00 2023-07-12T01:55:35.489 INFO:teuthology.orchestra.run.smithi079.stdout:(79/144): libsepol-devel-2.9-3.el8.x86_64.rpm 1.5 MB/s | 87 kB 00:00 2023-07-12T01:55:35.522 INFO:teuthology.orchestra.run.smithi079.stdout:(80/144): libgfortran-8.5.0-20.el8.x86_64.rpm 2.0 MB/s | 645 kB 00:00 2023-07-12T01:55:35.547 INFO:teuthology.orchestra.run.smithi079.stdout:(81/144): libuuid-devel-2.32.1-42.el8.x86_64.rp 1.7 MB/s | 99 kB 00:00 2023-07-12T01:55:35.573 INFO:teuthology.orchestra.run.smithi060.stdout:(3/144): ceph-immutable-object-cache-18.0.0-482 827 kB/s | 165 kB 00:00 2023-07-12T01:55:35.581 INFO:teuthology.orchestra.run.smithi079.stdout:(82/144): libverto-devel-0.3.2-2.el8.x86_64.rpm 308 kB/s | 18 kB 00:00 2023-07-12T01:55:35.631 INFO:teuthology.orchestra.run.smithi079.stdout:(83/144): libzstd-devel-1.4.4-1.el8.x86_64.rpm 525 kB/s | 44 kB 00:00 2023-07-12T01:55:35.798 INFO:teuthology.orchestra.run.smithi079.stdout:(84/144): pcre2-devel-10.32-3.el8.x86_64.rpm 3.5 MB/s | 605 kB 00:00 2023-07-12T01:55:35.850 INFO:teuthology.orchestra.run.smithi060.stdout:(4/144): ceph-base-18.0.0-4828.gb5891ed6.el8.x8 5.2 MB/s | 5.4 MB 00:01 2023-07-12T01:55:35.890 INFO:teuthology.orchestra.run.smithi079.stdout:(85/144): pcre2-utf16-10.32-3.el8.x86_64.rpm 2.4 MB/s | 229 kB 00:00 2023-07-12T01:55:35.915 INFO:teuthology.orchestra.run.smithi060.stdout:(5/144): ceph-mds-18.0.0-4828.gb5891ed6.el8.x86 6.7 MB/s | 2.3 MB 00:00 2023-07-12T01:55:35.982 INFO:teuthology.orchestra.run.smithi079.stdout:(86/144): pcre2-utf32-10.32-3.el8.x86_64.rpm 2.3 MB/s | 220 kB 00:00 2023-07-12T01:55:36.053 INFO:teuthology.orchestra.run.smithi060.stdout:(6/144): ceph-mgr-18.0.0-4828.gb5891ed6.el8.x86 7.6 MB/s | 1.5 MB 00:00 2023-07-12T01:55:36.083 INFO:teuthology.orchestra.run.smithi079.stdout:(87/144): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.4 MB/s | 249 kB 00:00 2023-07-12T01:55:36.200 INFO:teuthology.orchestra.run.smithi079.stdout:(88/144): openssl-devel-1.1.1k-9.el8.x86_64.rpm 5.1 MB/s | 3.2 MB 00:00 2023-07-12T01:55:36.242 INFO:teuthology.orchestra.run.smithi079.stdout:(89/144): python3-cryptography-3.2.1-6.el8.x86_ 3.9 MB/s | 641 kB 00:00 2023-07-12T01:55:36.267 INFO:teuthology.orchestra.run.smithi079.stdout:(90/144): python3-jwt-1.6.1-2.el8.noarch.rpm 637 kB/s | 43 kB 00:00 2023-07-12T01:55:36.301 INFO:teuthology.orchestra.run.smithi079.stdout:(91/144): python3-oauthlib-2.1.0-1.el8.noarch.r 2.6 MB/s | 155 kB 00:00 2023-07-12T01:55:36.326 INFO:teuthology.orchestra.run.smithi079.stdout:(92/144): python3-pycparser-2.14-14.el8.noarch. 1.8 MB/s | 109 kB 00:00 2023-07-12T01:55:36.380 INFO:teuthology.orchestra.run.smithi079.stdout:(93/144): python3-requests-oauthlib-1.0.0-1.el8 540 kB/s | 43 kB 00:00 2023-07-12T01:55:36.418 INFO:teuthology.orchestra.run.smithi079.stdout:(94/144): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 810 kB/s | 74 kB 00:00 2023-07-12T01:55:36.443 INFO:teuthology.orchestra.run.smithi079.stdout:(95/144): zlib-devel-1.2.11-21.el8.x86_64.rpm 919 kB/s | 58 kB 00:00 2023-07-12T01:55:36.535 INFO:teuthology.orchestra.run.smithi079.stdout:(96/144): liboath-2.6.2-3.el8.x86_64.rpm 643 kB/s | 59 kB 00:00 2023-07-12T01:55:36.586 INFO:teuthology.orchestra.run.smithi079.stdout:(97/144): gperftools-libs-2.7-9.el8.x86_64.rpm 1.8 MB/s | 306 kB 00:00 2023-07-12T01:55:36.611 INFO:teuthology.orchestra.run.smithi079.stdout:(98/144): libunwind-1.3.1-3.el8.x86_64.rpm 998 kB/s | 75 kB 00:00 2023-07-12T01:55:36.645 INFO:teuthology.orchestra.run.smithi079.stdout:(99/144): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.3 MB/s | 44 kB 00:00 2023-07-12T01:55:36.649 INFO:teuthology.orchestra.run.smithi060.stdout:(7/144): ceph-mon-18.0.0-4828.gb5891ed6.el8.x86 6.3 MB/s | 4.6 MB 00:00 2023-07-12T01:55:36.678 INFO:teuthology.orchestra.run.smithi079.stdout:(100/144): python3-asyncssh-2.7.0-2.el8.noarch. 5.0 MB/s | 476 kB 00:00 2023-07-12T01:55:36.720 INFO:teuthology.orchestra.run.smithi079.stdout:(101/144): python3-beautifulsoup4-4.6.3-2.el8.1 2.4 MB/s | 185 kB 00:00 2023-07-12T01:55:36.746 INFO:teuthology.orchestra.run.smithi079.stdout:(102/144): python3-cachetools-3.1.1-4.el8.noarc 493 kB/s | 33 kB 00:00 2023-07-12T01:55:36.771 INFO:teuthology.orchestra.run.smithi079.stdout:(103/144): python3-certifi-2018.10.15-7.el8.noa 322 kB/s | 16 kB 00:00 2023-07-12T01:55:36.797 INFO:teuthology.orchestra.run.smithi079.stdout:(104/144): python3-cheroot-8.5.2-1.el8.noarch.r 3.3 MB/s | 173 kB 00:00 2023-07-12T01:55:36.838 INFO:teuthology.orchestra.run.smithi079.stdout:(105/144): python3-cherrypy-18.4.0-1.el8.noarch 5.6 MB/s | 384 kB 00:00 2023-07-12T01:55:36.864 INFO:teuthology.orchestra.run.smithi079.stdout:(106/144): python3-google-auth-1.1.1-10.el8.noa 1.2 MB/s | 81 kB 00:00 2023-07-12T01:55:36.889 INFO:teuthology.orchestra.run.smithi079.stdout:(107/144): python3-jaraco-6.2-6.el8.noarch.rpm 221 kB/s | 11 kB 00:00 2023-07-12T01:55:36.914 INFO:teuthology.orchestra.run.smithi079.stdout:(108/144): python3-jaraco-functools-2.0-4.el8.n 350 kB/s | 18 kB 00:00 2023-07-12T01:55:36.965 INFO:teuthology.orchestra.run.smithi079.stdout:(109/144): python3-kubernetes-11.0.0-6.el8.noar 15 MB/s | 1.2 MB 00:00 2023-07-12T01:55:36.990 INFO:teuthology.orchestra.run.smithi079.stdout:(110/144): python3-logutils-0.3.5-11.el8.noarch 647 kB/s | 49 kB 00:00 2023-07-12T01:55:37.016 INFO:teuthology.orchestra.run.smithi079.stdout:(111/144): python3-more-itertools-7.2.0-3.el8.n 1.1 MB/s | 59 kB 00:00 2023-07-12T01:55:37.041 INFO:teuthology.orchestra.run.smithi079.stdout:(112/144): python3-natsort-7.1.1-2.el8.noarch.r 1.2 MB/s | 60 kB 00:00 2023-07-12T01:55:37.066 INFO:teuthology.orchestra.run.smithi079.stdout:(113/144): python3-pecan-1.3.2-9.el8.noarch.rpm 5.5 MB/s | 283 kB 00:00 2023-07-12T01:55:37.108 INFO:teuthology.orchestra.run.smithi079.stdout:(114/144): python3-portend-2.6-1.el8.noarch.rpm 233 kB/s | 16 kB 00:00 2023-07-12T01:55:37.158 INFO:teuthology.orchestra.run.smithi079.stdout:(115/144): python3-repoze-lru-0.7-6.el8.noarch. 367 kB/s | 34 kB 00:00 2023-07-12T01:55:37.184 INFO:teuthology.orchestra.run.smithi079.stdout:(116/144): python3-routes-2.4.1-12.el8.noarch.r 2.6 MB/s | 196 kB 00:00 2023-07-12T01:55:37.209 INFO:teuthology.orchestra.run.smithi079.stdout:(117/144): python3-rsa-4.8-1.el8.noarch.rpm 1.2 MB/s | 61 kB 00:00 2023-07-12T01:55:37.234 INFO:teuthology.orchestra.run.smithi079.stdout:(118/144): python3-simplegeneric-0.8.1-17.el8.n 373 kB/s | 19 kB 00:00 2023-07-12T01:55:37.260 INFO:teuthology.orchestra.run.smithi079.stdout:(119/144): python3-singledispatch-3.4.0.3-18.el 477 kB/s | 24 kB 00:00 2023-07-12T01:55:37.285 INFO:teuthology.orchestra.run.smithi079.stdout:(120/144): python3-tempora-1.14.1-5.el8.noarch. 580 kB/s | 29 kB 00:00 2023-07-12T01:55:37.310 INFO:teuthology.orchestra.run.smithi079.stdout:(121/144): python3-trustme-0.6.0-4.el8.noarch.r 547 kB/s | 27 kB 00:00 2023-07-12T01:55:37.336 INFO:teuthology.orchestra.run.smithi079.stdout:(122/144): python3-waitress-1.4.3-1.el8.noarch. 5.0 MB/s | 255 kB 00:00 2023-07-12T01:55:37.361 INFO:teuthology.orchestra.run.smithi079.stdout:(123/144): python3-webob-1.8.5-1.el8.1.noarch.r 4.9 MB/s | 251 kB 00:00 2023-07-12T01:55:37.386 INFO:teuthology.orchestra.run.smithi079.stdout:(124/144): python3-websocket-client-0.56.0-5.el 1.2 MB/s | 61 kB 00:00 2023-07-12T01:55:37.412 INFO:teuthology.orchestra.run.smithi079.stdout:(125/144): python3-webtest-2.0.33-1.el8.noarch. 1.7 MB/s | 85 kB 00:00 2023-07-12T01:55:37.433 INFO:teuthology.orchestra.run.smithi060.stdout:(8/144): ceph-common-18.0.0-4828.gb5891ed6.el8. 8.4 MB/s | 22 MB 00:02 2023-07-12T01:55:37.437 INFO:teuthology.orchestra.run.smithi079.stdout:(126/144): python3-zc-lockfile-2.0-2.el8.noarch 456 kB/s | 23 kB 00:00 2023-07-12T01:55:37.504 INFO:teuthology.orchestra.run.smithi079.stdout:(127/144): thrift-0.13.0-2.el8.x86_64.rpm 19 MB/s | 1.7 MB 00:00 2023-07-12T01:55:37.516 INFO:teuthology.orchestra.run.smithi060.stdout:(9/144): ceph-selinux-18.0.0-4828.gb5891ed6.el8 292 kB/s | 24 kB 00:00 2023-07-12T01:55:37.700 INFO:teuthology.orchestra.run.smithi060.stdout:(10/144): ceph-osd-18.0.0-4828.gb5891ed6.el8.x8 11 MB/s | 18 MB 00:01 2023-07-12T01:55:37.859 INFO:teuthology.orchestra.run.smithi060.stdout:(11/144): cephfs-mirror-18.0.0-4828.gb5891ed6.e 1.6 MB/s | 258 kB 00:00 2023-07-12T01:55:37.950 INFO:teuthology.orchestra.run.smithi060.stdout:(12/144): libcephfs-devel-18.0.0-4828.gb5891ed6 338 kB/s | 31 kB 00:00 2023-07-12T01:55:37.965 INFO:teuthology.orchestra.run.smithi079.stdout:(128/144): librados2-18.0.0-4828.gb5891ed6.el8. 6.9 MB/s | 3.7 MB 00:00 2023-07-12T01:55:38.109 INFO:teuthology.orchestra.run.smithi060.stdout:(13/144): libcephfs2-18.0.0-4828.gb5891ed6.el8. 4.8 MB/s | 771 kB 00:00 2023-07-12T01:55:38.123 INFO:teuthology.orchestra.run.smithi079.stdout:(129/144): NetworkManager-initscripts-updown-1. 908 kB/s | 143 kB 00:00 2023-07-12T01:55:38.182 INFO:teuthology.orchestra.run.smithi079.stdout:(130/144): elfutils-debuginfod-client-0.189-2.e 1.3 MB/s | 76 kB 00:00 2023-07-12T01:55:38.201 INFO:teuthology.orchestra.run.smithi060.stdout:(14/144): libcephsqlite-18.0.0-4828.gb5891ed6.e 1.5 MB/s | 137 kB 00:00 2023-07-12T01:55:38.282 INFO:teuthology.orchestra.run.smithi079.stdout:(131/144): elfutils-libelf-0.189-2.el8.x86_64.r 2.3 MB/s | 232 kB 00:00 2023-07-12T01:55:38.318 INFO:teuthology.orchestra.run.smithi060.stdout:(15/144): librados-devel-18.0.0-4828.gb5891ed6. 1.2 MB/s | 139 kB 00:00 2023-07-12T01:55:38.374 INFO:teuthology.orchestra.run.smithi079.stdout:(132/144): elfutils-libs-0.189-2.el8.x86_64.rpm 3.2 MB/s | 302 kB 00:00 2023-07-12T01:55:38.426 INFO:teuthology.orchestra.run.smithi060.stdout:(16/144): libradosstriper1-18.0.0-4828.gb5891ed 4.3 MB/s | 473 kB 00:00 2023-07-12T01:55:38.591 INFO:teuthology.orchestra.run.smithi079.stdout:(133/144): iproute-6.2.0-2.el8.x86_64.rpm 4.0 MB/s | 880 kB 00:00 2023-07-12T01:55:38.708 INFO:teuthology.orchestra.run.smithi079.stdout:(134/144): libblkid-2.32.1-42.el8.x86_64.rpm 1.8 MB/s | 220 kB 00:00 2023-07-12T01:55:38.777 INFO:teuthology.orchestra.run.smithi060.stdout:(17/144): ceph-radosgw-18.0.0-4828.gb5891ed6.el 6.3 MB/s | 13 MB 00:02 2023-07-12T01:55:38.800 INFO:teuthology.orchestra.run.smithi079.stdout:(135/144): libfdisk-2.32.1-42.el8.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2023-07-12T01:55:38.889 INFO:teuthology.orchestra.run.smithi060.stdout:(18/144): python3-ceph-argparse-18.0.0-4828.gb5 398 kB/s | 45 kB 00:00 2023-07-12T01:55:38.909 INFO:teuthology.orchestra.run.smithi079.stdout:(136/144): libmount-2.32.1-42.el8.x86_64.rpm 2.1 MB/s | 236 kB 00:00 2023-07-12T01:55:38.968 INFO:teuthology.orchestra.run.smithi079.stdout:(137/144): libsmartcols-2.32.1-42.el8.x86_64.rp 3.0 MB/s | 179 kB 00:00 2023-07-12T01:55:38.994 INFO:teuthology.orchestra.run.smithi060.stdout:(19/144): python3-ceph-common-18.0.0-4828.gb589 1.1 MB/s | 122 kB 00:00 2023-07-12T01:55:39.026 INFO:teuthology.orchestra.run.smithi079.stdout:(138/144): libuuid-2.32.1-42.el8.x86_64.rpm 1.7 MB/s | 98 kB 00:00 2023-07-12T01:55:39.086 INFO:teuthology.orchestra.run.smithi060.stdout:(20/144): python3-cephfs-18.0.0-4828.gb5891ed6. 2.1 MB/s | 197 kB 00:00 2023-07-12T01:55:39.186 INFO:teuthology.orchestra.run.smithi060.stdout:(21/144): librgw2-18.0.0-4828.gb5891ed6.el8.x86 8.9 MB/s | 6.7 MB 00:00 2023-07-12T01:55:39.212 INFO:teuthology.orchestra.run.smithi060.stdout:(22/144): python3-rados-18.0.0-4828.gb5891ed6.e 2.9 MB/s | 371 kB 00:00 2023-07-12T01:55:39.287 INFO:teuthology.orchestra.run.smithi060.stdout:(23/144): python3-rbd-18.0.0-4828.gb5891ed6.el8 3.5 MB/s | 364 kB 00:00 2023-07-12T01:55:39.312 INFO:teuthology.orchestra.run.smithi060.stdout:(24/144): python3-rgw-18.0.0-4828.gb5891ed6.el8 1.0 MB/s | 107 kB 00:00 2023-07-12T01:55:39.363 INFO:teuthology.orchestra.run.smithi060.stdout:(25/144): rbd-fuse-18.0.0-4828.gb5891ed6.el8.x8 1.2 MB/s | 94 kB 00:00 2023-07-12T01:55:39.438 INFO:teuthology.orchestra.run.smithi060.stdout:(26/144): rbd-nbd-18.0.0-4828.gb5891ed6.el8.x86 2.3 MB/s | 180 kB 00:00 2023-07-12T01:55:39.513 INFO:teuthology.orchestra.run.smithi060.stdout:(27/144): ceph-grafana-dashboards-18.0.0-4828.g 307 kB/s | 23 kB 00:00 2023-07-12T01:55:39.535 INFO:teuthology.orchestra.run.smithi079.stdout:(139/144): librbd1-18.0.0-4828.gb5891ed6.el8.x8 1.8 MB/s | 3.6 MB 00:02 2023-07-12T01:55:39.593 INFO:teuthology.orchestra.run.smithi079.stdout:(140/144): util-linux-2.32.1-42.el8.x86_64.rpm 4.6 MB/s | 2.6 MB 00:00 2023-07-12T01:55:39.622 INFO:teuthology.orchestra.run.smithi060.stdout:(28/144): ceph-mgr-cephadm-18.0.0-4828.gb5891ed 1.2 MB/s | 129 kB 00:00 2023-07-12T01:55:39.727 INFO:teuthology.orchestra.run.smithi079.stdout:(141/144): xfsdump-3.1.8-6.el8.x86_64.rpm 2.4 MB/s | 334 kB 00:00 2023-07-12T01:55:39.769 INFO:teuthology.orchestra.run.smithi079.stdout:(142/144): util-linux-user-2.32.1-42.el8.x86_64 438 kB/s | 102 kB 00:00 2023-07-12T01:55:39.914 INFO:teuthology.orchestra.run.smithi060.stdout:(29/144): rbd-mirror-18.0.0-4828.gb5891ed6.el8. 5.7 MB/s | 3.4 MB 00:00 2023-07-12T01:55:39.989 INFO:teuthology.orchestra.run.smithi060.stdout:(30/144): ceph-mgr-dashboard-18.0.0-4828.gb5891 4.7 MB/s | 1.7 MB 00:00 2023-07-12T01:55:39.994 INFO:teuthology.orchestra.run.smithi079.stdout:(143/144): xfsprogs-5.0.0-12.el8.x86_64.rpm 4.1 MB/s | 1.1 MB 00:00 2023-07-12T01:55:40.106 INFO:teuthology.orchestra.run.smithi060.stdout:(31/144): ceph-mgr-modules-core-18.0.0-4828.gb5 2.0 MB/s | 240 kB 00:00 2023-07-12T01:55:40.190 INFO:teuthology.orchestra.run.smithi060.stdout:(32/144): ceph-mgr-rook-18.0.0-4828.gb5891ed6.e 569 kB/s | 47 kB 00:00 2023-07-12T01:55:40.273 INFO:teuthology.orchestra.run.smithi060.stdout:(33/144): ceph-prometheus-alerts-18.0.0-4828.gb 175 kB/s | 15 kB 00:00 2023-07-12T01:55:40.373 INFO:teuthology.orchestra.run.smithi060.stdout:(34/144): ceph-volume-18.0.0-4828.gb5891ed6.el8 2.5 MB/s | 258 kB 00:00 2023-07-12T01:55:40.466 INFO:teuthology.orchestra.run.smithi060.stdout:(35/144): cephadm-18.0.0-4828.gb5891ed6.el8.noa 1.7 MB/s | 164 kB 00:00 2023-07-12T01:55:40.549 INFO:teuthology.orchestra.run.smithi060.stdout:(36/144): cephfs-top-18.0.0-4828.gb5891ed6.el8. 216 kB/s | 18 kB 00:00 2023-07-12T01:55:40.941 INFO:teuthology.orchestra.run.smithi060.stdout:(37/144): ceph-mgr-diskprediction-local-18.0.0- 7.2 MB/s | 7.4 MB 00:01 2023-07-12T01:55:42.150 INFO:teuthology.orchestra.run.smithi060.stdout:(38/144): ceph-test-18.0.0-4828.gb5891ed6.el8.x 10 MB/s | 48 MB 00:04 2023-07-12T01:55:43.450 INFO:teuthology.orchestra.run.smithi060.stdout:(39/144): automake-1.16.1-7.el8.noarch.rpm 246 kB/s | 713 kB 00:02 2023-07-12T01:55:43.825 INFO:teuthology.orchestra.run.smithi060.stdout:(40/144): bison-3.0.4-10.el8.x86_64.rpm 239 kB/s | 688 kB 00:02 2023-07-12T01:55:44.642 INFO:teuthology.orchestra.run.smithi060.stdout:(41/144): libpq-13.5-1.el8.x86_64.rpm 242 kB/s | 198 kB 00:00 2023-07-12T01:55:46.292 INFO:teuthology.orchestra.run.smithi060.stdout:(42/144): librdkafka-0.11.4-3.el8.x86_64.rpm 214 kB/s | 354 kB 00:01 2023-07-12T01:55:46.509 INFO:teuthology.orchestra.run.smithi060.stdout:(43/144): jq-1.6-7.el8.x86_64.rpm 66 kB/s | 202 kB 00:03 2023-07-12T01:55:48.867 INFO:teuthology.orchestra.run.smithi060.stdout:(44/144): libtool-2.4.6-25.el8.x86_64.rpm 275 kB/s | 709 kB 00:02 2023-07-12T01:55:49.226 INFO:teuthology.orchestra.run.smithi060.stdout:(45/144): lttng-ust-2.8.1-11.el8.x86_64.rpm 96 kB/s | 259 kB 00:02 2023-07-12T01:55:50.143 INFO:teuthology.orchestra.run.smithi060.stdout:(46/144): oniguruma-6.8.2-2.el8.x86_64.rpm 147 kB/s | 187 kB 00:01 2023-07-12T01:56:00.626 INFO:teuthology.orchestra.run.smithi060.stdout:(47/144): flex-2.6.1-9.el8.x86_64.rpm 17 kB/s | 320 kB 00:18 2023-07-12T01:56:06.251 INFO:teuthology.orchestra.run.smithi060.stdout:(48/144): postgresql-10.23-1.module_el8+300+2c5 285 kB/s | 1.6 MB 00:05 2023-07-12T01:56:06.817 INFO:teuthology.orchestra.run.smithi060.stdout:(49/144): openblas-0.3.15-4.el8.x86_64.rpm 275 kB/s | 4.7 MB 00:17 2023-07-12T01:56:07.993 INFO:teuthology.orchestra.run.smithi060.stdout:(50/144): openblas-threads-0.3.15-4.el8.x86_64. 279 kB/s | 4.9 MB 00:17 2023-07-12T01:56:09.893 INFO:teuthology.orchestra.run.smithi060.stdout:(51/144): postgresql-contrib-10.23-1.module_el8 248 kB/s | 903 kB 00:03 2023-07-12T01:56:13.959 INFO:teuthology.orchestra.run.smithi060.stdout:(52/144): python3-jinja2-2.10.1-3.el8.noarch.rp 132 kB/s | 538 kB 00:04 2023-07-12T01:56:14.126 INFO:teuthology.orchestra.run.smithi060.stdout:(53/144): python3-jsonpatch-1.21-2.el8.noarch.r 159 kB/s | 27 kB 00:00 2023-07-12T01:56:14.298 INFO:teuthology.orchestra.run.smithi060.stdout:(54/144): python3-jsonpointer-1.10-11.el8.noarc 116 kB/s | 20 kB 00:00 2023-07-12T01:56:14.918 INFO:teuthology.orchestra.run.smithi060.stdout:(55/144): python3-mako-1.0.6-14.el8.noarch.rpm 253 kB/s | 157 kB 00:00 2023-07-12T01:56:15.127 INFO:teuthology.orchestra.run.smithi060.stdout:(56/144): python3-markupsafe-0.23-19.el8.x86_64 186 kB/s | 39 kB 00:00 2023-07-12T01:56:25.018 INFO:teuthology.orchestra.run.smithi060.stdout:(57/144): python3-babel-2.5.1-7.el8.noarch.rpm 288 kB/s | 4.8 MB 00:17 2023-07-12T01:56:30.484 INFO:teuthology.orchestra.run.smithi060.stdout:(58/144): python3-numpy-f2py-1.14.3-10.el8.x86_ 41 kB/s | 225 kB 00:05 2023-07-12T01:56:30.743 INFO:teuthology.orchestra.run.smithi060.stdout:(59/144): postgresql-server-10.23-1.module_el8+ 219 kB/s | 5.1 MB 00:23 2023-07-12T01:56:31.393 INFO:teuthology.orchestra.run.smithi060.stdout:(60/144): python3-pyOpenSSL-19.0.0-1.el8.noarch 159 kB/s | 103 kB 00:00 2023-07-12T01:56:31.426 INFO:teuthology.orchestra.run.smithi079.stdout:(144/144): python3-scipy-1.0.0-21.module_el8.5. 235 kB/s | 14 MB 00:59 2023-07-12T01:56:31.429 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2023-07-12T01:56:31.429 INFO:teuthology.orchestra.run.smithi079.stdout:Total 1.7 MB/s | 212 MB 02:02 2023-07-12T01:56:32.026 INFO:teuthology.orchestra.run.smithi060.stdout:(61/144): python3-pyasn1-0.3.7-6.el8.noarch.rpm 199 kB/s | 126 kB 00:00 2023-07-12T01:56:32.312 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2023-07-12T01:56:32.477 INFO:teuthology.orchestra.run.smithi060.stdout:(62/144): python3-pyasn1-modules-0.3.7-6.el8.no 244 kB/s | 110 kB 00:00 2023-07-12T01:56:32.669 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2023-07-12T01:56:32.670 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2023-07-12T01:56:32.752 INFO:teuthology.orchestra.run.smithi060.stdout:(63/144): python3-pytz-2017.2-9.el8.noarch.rpm 197 kB/s | 54 kB 00:00 2023-07-12T01:56:33.261 INFO:teuthology.orchestra.run.smithi060.stdout:(64/144): python3-numpy-1.14.3-10.el8.x86_64.rp 211 kB/s | 3.7 MB 00:18 2023-07-12T01:56:33.826 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2023-07-12T01:56:33.829 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2023-07-12T01:56:34.169 INFO:teuthology.orchestra.run.smithi060.stdout:(65/144): python3-prettytable-0.7.2-14.el8.noar 12 kB/s | 44 kB 00:03 2023-07-12T01:56:35.211 INFO:teuthology.orchestra.run.smithi060.stdout:(66/144): python3-werkzeug-0.12.2-4.el8.noarch. 235 kB/s | 457 kB 00:01 2023-07-12T01:56:35.553 INFO:teuthology.orchestra.run.smithi060.stdout:(67/144): uuid-1.6.2-43.el8.x86_64.rpm 187 kB/s | 64 kB 00:00 2023-07-12T01:56:35.586 INFO:teuthology.orchestra.run.smithi060.stdout:(68/144): socat-1.7.4.1-1.el8.x86_64.rpm 228 kB/s | 323 kB 00:01 2023-07-12T01:56:36.128 INFO:teuthology.orchestra.run.smithi060.stdout:(69/144): xmlstarlet-1.6.1-20.el8.x86_64.rpm 123 kB/s | 71 kB 00:00 2023-07-12T01:56:36.420 INFO:teuthology.orchestra.run.smithi060.stdout:(70/144): elfutils-libelf-devel-0.189-2.el8.x86 74 kB/s | 61 kB 00:00 2023-07-12T01:56:36.487 INFO:teuthology.orchestra.run.smithi060.stdout:(71/144): keyutils-libs-devel-1.5.10-9.el8.x86_ 723 kB/s | 48 kB 00:00 2023-07-12T01:56:36.529 INFO:teuthology.orchestra.run.smithi060.stdout:(72/144): fuse-2.9.7-17.el8.x86_64.rpm 207 kB/s | 83 kB 00:00 2023-07-12T01:56:36.587 INFO:teuthology.orchestra.run.smithi060.stdout:(73/144): libaio-devel-0.3.112-1.el8.x86_64.rpm 321 kB/s | 19 kB 00:00 2023-07-12T01:56:36.671 INFO:teuthology.orchestra.run.smithi060.stdout:(74/144): libcom_err-devel-1.45.6-5.el8.x86_64. 464 kB/s | 39 kB 00:00 2023-07-12T01:56:36.863 INFO:teuthology.orchestra.run.smithi060.stdout:(75/144): libgfortran-8.5.0-20.el8.x86_64.rpm 3.3 MB/s | 645 kB 00:00 2023-07-12T01:56:36.930 INFO:teuthology.orchestra.run.smithi060.stdout:(76/144): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.2 MB/s | 561 kB 00:00 2023-07-12T01:56:36.991 INFO:teuthology.orchestra.run.smithi060.stdout:(77/144): libquadmath-8.5.0-20.el8.x86_64.rpm 1.3 MB/s | 172 kB 00:00 2023-07-12T01:56:37.014 INFO:teuthology.orchestra.run.smithi060.stdout:(78/144): librabbitmq-0.9.0-4.el8.x86_64.rpm 562 kB/s | 47 kB 00:00 2023-07-12T01:56:37.056 INFO:teuthology.orchestra.run.smithi060.stdout:(79/144): libselinux-devel-2.9-8.el8.x86_64.rpm 3.0 MB/s | 200 kB 00:00 2023-07-12T01:56:37.123 INFO:teuthology.orchestra.run.smithi060.stdout:(80/144): libsepol-devel-2.9-3.el8.x86_64.rpm 801 kB/s | 87 kB 00:00 2023-07-12T01:56:37.148 INFO:teuthology.orchestra.run.smithi060.stdout:(81/144): libuuid-devel-2.32.1-42.el8.x86_64.rp 1.1 MB/s | 99 kB 00:00 2023-07-12T01:56:37.182 INFO:teuthology.orchestra.run.smithi060.stdout:(82/144): libverto-devel-0.3.2-2.el8.x86_64.rpm 309 kB/s | 18 kB 00:00 2023-07-12T01:56:37.215 INFO:teuthology.orchestra.run.smithi060.stdout:(83/144): libzstd-devel-1.4.4-1.el8.x86_64.rpm 656 kB/s | 44 kB 00:00 2023-07-12T01:56:37.374 INFO:teuthology.orchestra.run.smithi060.stdout:(84/144): pcre2-devel-10.32-3.el8.x86_64.rpm 3.7 MB/s | 605 kB 00:00 2023-07-12T01:56:37.441 INFO:teuthology.orchestra.run.smithi060.stdout:(85/144): pcre2-utf16-10.32-3.el8.x86_64.rpm 3.4 MB/s | 229 kB 00:00 2023-07-12T01:56:37.508 INFO:teuthology.orchestra.run.smithi060.stdout:(86/144): pcre2-utf32-10.32-3.el8.x86_64.rpm 3.2 MB/s | 220 kB 00:00 2023-07-12T01:56:37.575 INFO:teuthology.orchestra.run.smithi060.stdout:(87/144): python3-cffi-1.11.5-6.el8.x86_64.rpm 3.7 MB/s | 249 kB 00:00 2023-07-12T01:56:37.750 INFO:teuthology.orchestra.run.smithi060.stdout:(88/144): python3-cryptography-3.2.1-6.el8.x86_ 3.6 MB/s | 641 kB 00:00 2023-07-12T01:56:37.817 INFO:teuthology.orchestra.run.smithi060.stdout:(89/144): python3-jwt-1.6.1-2.el8.noarch.rpm 640 kB/s | 43 kB 00:00 2023-07-12T01:56:37.892 INFO:teuthology.orchestra.run.smithi060.stdout:(90/144): python3-oauthlib-2.1.0-1.el8.noarch.r 2.0 MB/s | 155 kB 00:00 2023-07-12T01:56:37.968 INFO:teuthology.orchestra.run.smithi060.stdout:(91/144): python3-pycparser-2.14-14.el8.noarch. 1.4 MB/s | 109 kB 00:00 2023-07-12T01:56:38.074 INFO:teuthology.orchestra.run.smithi060.stdout:(92/144): python3-requests-oauthlib-1.0.0-1.el8 404 kB/s | 43 kB 00:00 2023-07-12T01:56:38.151 INFO:teuthology.orchestra.run.smithi060.stdout:(93/144): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 960 kB/s | 74 kB 00:00 2023-07-12T01:56:38.227 INFO:teuthology.orchestra.run.smithi060.stdout:(94/144): zlib-devel-1.2.11-21.el8.x86_64.rpm 773 kB/s | 58 kB 00:00 2023-07-12T01:56:38.944 INFO:teuthology.orchestra.run.smithi060.stdout:(95/144): openssl-devel-1.1.1k-9.el8.x86_64.rpm 1.8 MB/s | 3.2 MB 00:01 2023-07-12T01:56:39.212 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2023-07-12T01:56:39.328 INFO:teuthology.orchestra.run.smithi060.stdout:(96/144): gperftools-libs-2.7-9.el8.x86_64.rpm 278 kB/s | 306 kB 00:01 2023-07-12T01:56:39.389 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-07-12T01:56:39.569 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/160 2023-07-12T01:56:39.578 INFO:teuthology.orchestra.run.smithi060.stdout:(97/144): libunwind-1.3.1-3.el8.x86_64.rpm 300 kB/s | 75 kB 00:00 2023-07-12T01:56:39.603 INFO:teuthology.orchestra.run.smithi060.stdout:(98/144): liboath-2.6.2-3.el8.x86_64.rpm 89 kB/s | 59 kB 00:00 2023-07-12T01:56:39.698 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 2/160 2023-07-12T01:56:39.767 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 2/160 2023-07-12T01:56:39.795 INFO:teuthology.orchestra.run.smithi060.stdout:(99/144): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 227 kB/s | 44 kB 00:00 2023-07-12T01:56:39.887 INFO:teuthology.orchestra.run.smithi060.stdout:(100/144): python3-asyncssh-2.7.0-2.el8.noarch. 1.5 MB/s | 476 kB 00:00 2023-07-12T01:56:39.939 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 3/160 2023-07-12T01:56:40.004 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 3/160 2023-07-12T01:56:40.004 INFO:teuthology.orchestra.run.smithi060.stdout:(101/144): python3-cachetools-3.1.1-4.el8.noarc 283 kB/s | 33 kB 00:00 2023-07-12T01:56:40.087 INFO:teuthology.orchestra.run.smithi060.stdout:(102/144): python3-beautifulsoup4-4.6.3-2.el8.1 634 kB/s | 185 kB 00:00 2023-07-12T01:56:40.113 INFO:teuthology.orchestra.run.smithi060.stdout:(103/144): python3-certifi-2018.10.15-7.el8.noa 150 kB/s | 16 kB 00:00 2023-07-12T01:56:40.230 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/160 2023-07-12T01:56:40.255 INFO:teuthology.orchestra.run.smithi060.stdout:(104/144): python3-cheroot-8.5.2-1.el8.noarch.r 1.0 MB/s | 173 kB 00:00 2023-07-12T01:56:40.280 INFO:teuthology.orchestra.run.smithi060.stdout:(105/144): python3-cherrypy-18.4.0-1.el8.noarch 2.3 MB/s | 384 kB 00:00 2023-07-12T01:56:40.380 INFO:teuthology.orchestra.run.smithi060.stdout:(106/144): python3-google-auth-1.1.1-10.el8.noa 649 kB/s | 81 kB 00:00 2023-07-12T01:56:40.406 INFO:teuthology.orchestra.run.smithi060.stdout:(107/144): python3-jaraco-6.2-6.el8.noarch.rpm 89 kB/s | 11 kB 00:00 2023-07-12T01:56:40.411 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 5/160 2023-07-12T01:56:40.489 INFO:teuthology.orchestra.run.smithi060.stdout:(108/144): python3-jaraco-functools-2.0-4.el8.n 162 kB/s | 18 kB 00:00 2023-07-12T01:56:40.592 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/160 2023-07-12T01:56:40.606 INFO:teuthology.orchestra.run.smithi060.stdout:(109/144): python3-logutils-0.3.5-11.el8.noarch 418 kB/s | 49 kB 00:00 2023-07-12T01:56:40.715 INFO:teuthology.orchestra.run.smithi060.stdout:(110/144): python3-more-itertools-7.2.0-3.el8.n 542 kB/s | 59 kB 00:00 2023-07-12T01:56:40.748 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-07-12T01:56:40.748 INFO:teuthology.orchestra.run.smithi060.stdout:(111/144): python3-kubernetes-11.0.0-6.el8.noar 3.4 MB/s | 1.2 MB 00:00 2023-07-12T01:56:40.832 INFO:teuthology.orchestra.run.smithi060.stdout:(112/144): python3-natsort-7.1.1-2.el8.noarch.r 515 kB/s | 60 kB 00:00 2023-07-12T01:56:40.908 INFO:teuthology.orchestra.run.smithi060.stdout:(113/144): python3-pecan-1.3.2-9.el8.noarch.rpm 1.7 MB/s | 283 kB 00:00 2023-07-12T01:56:40.958 INFO:teuthology.orchestra.run.smithi060.stdout:(114/144): python3-portend-2.6-1.el8.noarch.rpm 124 kB/s | 16 kB 00:00 2023-07-12T01:56:41.041 INFO:teuthology.orchestra.run.smithi060.stdout:(115/144): python3-repoze-lru-0.7-6.el8.noarch. 253 kB/s | 34 kB 00:00 2023-07-12T01:56:41.100 INFO:teuthology.orchestra.run.smithi060.stdout:(116/144): python3-routes-2.4.1-12.el8.noarch.r 1.4 MB/s | 196 kB 00:00 2023-07-12T01:56:41.151 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-07-12T01:56:41.175 INFO:teuthology.orchestra.run.smithi060.stdout:(117/144): python3-rsa-4.8-1.el8.noarch.rpm 461 kB/s | 61 kB 00:00 2023-07-12T01:56:41.209 INFO:teuthology.orchestra.run.smithi060.stdout:(118/144): python3-simplegeneric-0.8.1-17.el8.n 172 kB/s | 19 kB 00:00 2023-07-12T01:56:41.292 INFO:teuthology.orchestra.run.smithi060.stdout:(119/144): python3-singledispatch-3.4.0.3-18.el 205 kB/s | 24 kB 00:00 2023-07-12T01:56:41.318 INFO:teuthology.orchestra.run.smithi060.stdout:(120/144): python3-tempora-1.14.1-5.el8.noarch. 269 kB/s | 29 kB 00:00 2023-07-12T01:56:41.323 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : librados2-2:18.0.0-4828.gb5891ed6.el8.x86_64 8/160 2023-07-12T01:56:41.393 INFO:teuthology.orchestra.run.smithi060.stdout:(121/144): python3-trustme-0.6.0-4.el8.noarch.r 275 kB/s | 27 kB 00:00 2023-07-12T01:56:41.460 INFO:teuthology.orchestra.run.smithi060.stdout:(122/144): python3-waitress-1.4.3-1.el8.noarch. 1.8 MB/s | 255 kB 00:00 2023-07-12T01:56:41.519 INFO:teuthology.orchestra.run.smithi060.stdout:(123/144): python3-webob-1.8.5-1.el8.1.noarch.r 2.0 MB/s | 251 kB 00:00 2023-07-12T01:56:41.577 INFO:teuthology.orchestra.run.smithi060.stdout:(124/144): python3-websocket-client-0.56.0-5.el 524 kB/s | 61 kB 00:00 2023-07-12T01:56:41.644 INFO:teuthology.orchestra.run.smithi060.stdout:(125/144): python3-webtest-2.0.33-1.el8.noarch. 682 kB/s | 85 kB 00:00 2023-07-12T01:56:41.686 INFO:teuthology.orchestra.run.smithi060.stdout:(126/144): python3-zc-lockfile-2.0-2.el8.noarch 211 kB/s | 23 kB 00:00 2023-07-12T01:56:41.721 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librados2-2:18.0.0-4828.gb5891ed6.el8.x86_64 8/160 2023-07-12T01:56:41.861 INFO:teuthology.orchestra.run.smithi060.stdout:(127/144): thrift-0.13.0-2.el8.x86_64.rpm 8.0 MB/s | 1.7 MB 00:00 2023-07-12T01:56:41.889 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : librbd1-2:18.0.0-4828.gb5891ed6.el8.x86_64 9/160 2023-07-12T01:56:42.012 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librbd1-2:18.0.0-4828.gb5891ed6.el8.x86_64 9/160 2023-07-12T01:56:42.214 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcephfs2-2:18.0.0-4828.gb5891ed6.el8.x86_64 10/160 2023-07-12T01:56:42.317 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libcephfs2-2:18.0.0-4828.gb5891ed6.el8.x86_64 10/160 2023-07-12T01:56:42.387 INFO:teuthology.orchestra.run.smithi060.stdout:(128/144): librados2-18.0.0-4828.gb5891ed6.el8. 5.2 MB/s | 3.7 MB 00:00 2023-07-12T01:56:42.487 INFO:teuthology.orchestra.run.smithi060.stdout:(129/144): librbd1-18.0.0-4828.gb5891ed6.el8.x8 5.7 MB/s | 3.6 MB 00:00 2023-07-12T01:56:42.579 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rados-2:18.0.0-4828.gb5891ed6.el8.x86_64 11/160 2023-07-12T01:56:42.612 INFO:teuthology.orchestra.run.smithi060.stdout:(130/144): NetworkManager-initscripts-updown-1. 637 kB/s | 143 kB 00:00 2023-07-12T01:56:42.695 INFO:teuthology.orchestra.run.smithi060.stdout:(131/144): elfutils-debuginfod-client-0.189-2.e 366 kB/s | 76 kB 00:00 2023-07-12T01:56:42.730 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/160 2023-07-12T01:56:42.829 INFO:teuthology.orchestra.run.smithi060.stdout:(132/144): elfutils-libelf-0.189-2.el8.x86_64.r 1.0 MB/s | 232 kB 00:00 2023-07-12T01:56:42.912 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/160 2023-07-12T01:56:42.913 INFO:teuthology.orchestra.run.smithi060.stdout:(133/144): elfutils-libs-0.189-2.el8.x86_64.rpm 1.4 MB/s | 302 kB 00:00 2023-07-12T01:56:42.997 INFO:teuthology.orchestra.run.smithi060.stdout:(134/144): libblkid-2.32.1-42.el8.x86_64.rpm 2.6 MB/s | 220 kB 00:00 2023-07-12T01:56:43.130 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-07-12T01:56:43.139 INFO:teuthology.orchestra.run.smithi060.stdout:(135/144): libfdisk-2.32.1-42.el8.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2023-07-12T01:56:43.222 INFO:teuthology.orchestra.run.smithi060.stdout:(136/144): libmount-2.32.1-42.el8.x86_64.rpm 2.8 MB/s | 236 kB 00:00 2023-07-12T01:56:43.240 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-07-12T01:56:43.314 INFO:teuthology.orchestra.run.smithi060.stdout:(137/144): libsmartcols-2.32.1-42.el8.x86_64.rp 1.9 MB/s | 179 kB 00:00 2023-07-12T01:56:43.406 INFO:teuthology.orchestra.run.smithi060.stdout:(138/144): iproute-6.2.0-2.el8.x86_64.rpm 1.5 MB/s | 880 kB 00:00 2023-07-12T01:56:43.432 INFO:teuthology.orchestra.run.smithi060.stdout:(139/144): libuuid-2.32.1-42.el8.x86_64.rpm 841 kB/s | 98 kB 00:00 2023-07-12T01:56:43.444 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/160 2023-07-12T01:56:43.524 INFO:teuthology.orchestra.run.smithi060.stdout:(140/144): util-linux-user-2.32.1-42.el8.x86_64 1.1 MB/s | 102 kB 00:00 2023-07-12T01:56:43.645 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/160 2023-07-12T01:56:43.682 INFO:teuthology.orchestra.run.smithi060.stdout:(141/144): xfsdump-3.1.8-6.el8.x86_64.rpm 2.1 MB/s | 334 kB 00:00 2023-07-12T01:56:44.039 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libpq-13.5-1.el8.x86_64 16/160 2023-07-12T01:56:44.057 INFO:teuthology.orchestra.run.smithi060.stdout:(142/144): xfsprogs-5.0.0-12.el8.x86_64.rpm 2.9 MB/s | 1.1 MB 00:00 2023-07-12T01:56:44.242 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 17/160 2023-07-12T01:56:44.364 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcephsqlite-2:18.0.0-4828.gb5891ed6.el8.x86_64 18/160 2023-07-12T01:56:44.452 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4828.gb5891ed6.el8.x86_64 18/160 2023-07-12T01:56:44.597 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libradosstriper1-2:18.0.0-4828.gb5891ed6.el8.x86 19/160 2023-07-12T01:56:44.718 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4828.gb5891ed6.el8.x86 19/160 2023-07-12T01:56:44.741 INFO:teuthology.orchestra.run.smithi060.stdout:(143/144): util-linux-2.32.1-42.el8.x86_64.rpm 1.9 MB/s | 2.6 MB 00:01 2023-07-12T01:56:44.969 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/160 2023-07-12T01:56:45.110 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 21/160 2023-07-12T01:56:45.230 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 22/160 2023-07-12T01:56:45.365 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 22/160 2023-07-12T01:56:45.538 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 23/160 2023-07-12T01:56:46.133 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 23/160 2023-07-12T01:56:46.363 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : openblas-0.3.15-4.el8.x86_64 24/160 2023-07-12T01:56:46.979 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 24/160 2023-07-12T01:56:47.138 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-07-12T01:56:47.817 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-07-12T01:56:48.173 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 26/160 2023-07-12T01:56:48.368 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 27/160 2023-07-12T01:56:48.542 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 28/160 2023-07-12T01:56:48.773 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 29/160 2023-07-12T01:56:48.953 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-ceph-common-2:18.0.0-4828.gb5891ed6.el8. 30/160 2023-07-12T01:56:49.098 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-ceph-argparse-2:18.0.0-4828.gb5891ed6.el 31/160 2023-07-12T01:56:49.308 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cephfs-2:18.0.0-4828.gb5891ed6.el8.x86_6 32/160 2023-07-12T01:56:50.317 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 33/160 2023-07-12T01:56:50.637 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 34/160 2023-07-12T01:56:50.875 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 35/160 2023-07-12T01:56:51.046 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-07-12T01:56:52.790 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-07-12T01:56:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 37/160 2023-07-12T01:56:53.305 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/160 2023-07-12T01:56:53.513 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rsa-4.8-1.el8.noarch 39/160 2023-07-12T01:56:53.701 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 40/160 2023-07-12T01:56:53.876 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librados-devel-2:18.0.0-4828.gb5891ed6.el8.x86_6 41/160 2023-07-12T01:56:54.088 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 42/160 2023-07-12T01:56:54.269 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 43/160 2023-07-12T01:56:54.461 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 44/160 2023-07-12T01:56:54.521 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 44/160 2023-07-12T01:56:54.686 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 45/160 2023-07-12T01:56:54.790 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 45/160 2023-07-12T01:56:54.922 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 46/160 2023-07-12T01:56:55.103 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-07-12T01:56:55.566 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-07-12T01:56:55.820 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 48/160 2023-07-12T01:56:55.835 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 48/160 2023-07-12T01:56:55.998 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/160 2023-07-12T01:56:56.229 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/160 2023-07-12T01:56:56.443 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/160 2023-07-12T01:56:56.590 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/160 2023-07-12T01:56:56.738 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/160 2023-07-12T01:56:56.902 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/160 2023-07-12T01:56:57.122 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/160 2023-07-12T01:56:57.279 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/160 2023-07-12T01:56:57.422 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/160 2023-07-12T01:56:57.574 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/160 2023-07-12T01:56:57.747 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/160 2023-07-12T01:56:57.932 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/160 2023-07-12T01:56:58.076 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/160 2023-07-12T01:56:58.234 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/160 2023-07-12T01:56:58.425 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/160 2023-07-12T01:56:58.683 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/160 2023-07-12T01:56:58.878 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/160 2023-07-12T01:56:59.183 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/160 2023-07-12T01:56:59.752 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/160 2023-07-12T01:56:59.952 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/160 2023-07-12T01:57:00.776 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/160 2023-07-12T01:57:01.001 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librgw2-2:18.0.0-4828.gb5891ed6.el8.x86_64 70/160 2023-07-12T01:57:01.072 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librgw2-2:18.0.0-4828.gb5891ed6.el8.x86_64 70/160 2023-07-12T01:57:01.290 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 71/160 2023-07-12T01:57:01.504 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 72/160 2023-07-12T01:57:01.882 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 73/160 2023-07-12T01:57:02.130 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 74/160 2023-07-12T01:57:02.295 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 75/160 2023-07-12T01:57:02.558 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 76/160 2023-07-12T01:57:02.772 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 77/160 2023-07-12T01:57:03.838 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/160 2023-07-12T01:57:04.221 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/160 2023-07-12T01:57:04.417 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 80/160 2023-07-12T01:57:04.593 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 81/160 2023-07-12T01:57:04.933 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 82/160 2023-07-12T01:57:05.175 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 83/160 2023-07-12T01:57:05.370 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 84/160 2023-07-12T01:57:05.595 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 85/160 2023-07-12T01:57:05.884 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 86/160 2023-07-12T01:57:06.081 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 87/160 2023-07-12T01:57:06.228 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 88/160 2023-07-12T01:57:06.415 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 89/160 2023-07-12T01:57:06.721 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 90/160 2023-07-12T01:57:06.946 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 91/160 2023-07-12T01:57:07.113 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 92/160 2023-07-12T01:57:07.289 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 93/160 2023-07-12T01:57:07.501 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 94/160 2023-07-12T01:57:07.718 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : fuse-2.9.7-17.el8.x86_64 95/160 2023-07-12T01:57:07.934 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 96/160 2023-07-12T01:57:08.083 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : uuid-1.6.2-43.el8.x86_64 97/160 2023-07-12T01:57:08.179 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 97/160 2023-07-12T01:57:08.358 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 98/160 2023-07-12T01:57:08.492 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 99/160 2023-07-12T01:57:11.009 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 100/160 2023-07-12T01:57:11.267 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 100/160 2023-07-12T01:57:11.849 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 100/160 2023-07-12T01:57:12.137 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-base-2:18.0.0-4828.gb5891ed6.el8.x86_64 101/160 2023-07-12T01:57:12.219 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-base-2:18.0.0-4828.gb5891ed6.el8.x86_64 101/160 2023-07-12T01:57:12.366 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-selinux-2:18.0.0-4828.gb5891ed6.el8.x86_64 102/160 2023-07-12T01:57:30.861 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 8 - AppStream 102 kB/s | 31 MB 05:09 2023-07-12T01:57:31.342 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4828.gb5891ed6.el8.x86_64 102/160 2023-07-12T01:57:31.343 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /sys 2023-07-12T01:57:31.343 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /proc 2023-07-12T01:57:31.343 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /dev 2023-07-12T01:57:31.343 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /run 2023-07-12T01:57:31.344 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /mnt 2023-07-12T01:57:31.344 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /var/tmp 2023-07-12T01:57:31.344 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /home 2023-07-12T01:57:31.344 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /tmp 2023-07-12T01:57:31.344 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /dev 2023-07-12T01:57:31.344 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-07-12T01:57:31.721 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-volume-2:18.0.0-4828.gb5891ed6.el8.noarch 103/160 2023-07-12T01:57:32.453 INFO:teuthology.orchestra.run.smithi060.stdout:(144/144): python3-scipy-1.0.0-21.module_el8.5. 235 kB/s | 14 MB 00:59 2023-07-12T01:57:32.457 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2023-07-12T01:57:32.458 INFO:teuthology.orchestra.run.smithi060.stdout:Total 1.8 MB/s | 212 MB 01:57 2023-07-12T01:57:33.291 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-volume-2:18.0.0-4828.gb5891ed6.el8.noarch 103/160 2023-07-12T01:57:33.364 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2023-07-12T01:57:33.533 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-osd-2:18.0.0-4828.gb5891ed6.el8.x86_64 104/160 2023-07-12T01:57:33.752 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-osd-2:18.0.0-4828.gb5891ed6.el8.x86_64 104/160 2023-07-12T01:57:33.754 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2023-07-12T01:57:33.754 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2023-07-12T01:57:33.945 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mds-2:18.0.0-4828.gb5891ed6.el8.x86_64 105/160 2023-07-12T01:57:34.401 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mds-2:18.0.0-4828.gb5891ed6.el8.x86_64 105/160 2023-07-12T01:57:34.586 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mon-2:18.0.0-4828.gb5891ed6.el8.x86_64 106/160 2023-07-12T01:57:34.610 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mon-2:18.0.0-4828.gb5891ed6.el8.x86_64 106/160 2023-07-12T01:57:34.785 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 107/160 2023-07-12T01:57:34.999 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2023-07-12T01:57:35.002 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2023-07-12T01:57:35.005 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 108/160 2023-07-12T01:57:35.153 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 109/160 2023-07-12T01:57:35.234 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 109/160 2023-07-12T01:57:35.521 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : jq-1.6-7.el8.x86_64 110/160 2023-07-12T01:57:36.028 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : automake-1.16.1-7.el8.noarch 111/160 2023-07-12T01:57:36.551 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 112/160 2023-07-12T01:57:36.709 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 112/160 2023-07-12T01:57:36.817 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4828.gb5891ed6.e 113/160 2023-07-12T01:57:36.984 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4828.gb5891ed6. 114/160 2023-07-12T01:57:37.252 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4828.gb5891ed6.el8.noa 115/160 2023-07-12T01:57:37.463 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4828.gb5891ed6.el8.noa 115/160 2023-07-12T01:57:37.706 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4828.gb5891ed6.el8.n 116/160 2023-07-12T01:57:38.679 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4828.gb5891ed6.el8.n 116/160 2023-07-12T01:57:38.910 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4828.gb58 117/160 2023-07-12T01:57:39.003 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4828.gb58 117/160 2023-07-12T01:57:39.359 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4828.gb5891ed6.el 118/160 2023-07-12T01:57:39.589 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-2:18.0.0-4828.gb5891ed6.el8.x86_64 119/160 2023-07-12T01:57:39.624 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4828.gb5891ed6.el8.x86_64 119/160 2023-07-12T01:57:39.776 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-rook-2:18.0.0-4828.gb5891ed6.el8.noarch 120/160 2023-07-12T01:57:39.787 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4828.gb5891ed6.el8.noarch 120/160 2023-07-12T01:57:39.989 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-2:18.0.0-4828.gb5891ed6.el8.x86_64 121/160 2023-07-12T01:57:40.135 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libtool-2.4.6-25.el8.x86_64 122/160 2023-07-12T01:57:40.810 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2023-07-12T01:57:40.998 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-07-12T01:57:41.187 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/160 2023-07-12T01:57:41.374 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 2/160 2023-07-12T01:57:41.437 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 2/160 2023-07-12T01:57:41.641 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 3/160 2023-07-12T01:57:41.706 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 3/160 2023-07-12T01:57:41.892 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/160 2023-07-12T01:57:42.105 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 5/160 2023-07-12T01:57:42.357 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/160 2023-07-12T01:57:42.369 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 8 - BaseOS 7.4 MB/s | 41 MB 00:05 2023-07-12T01:57:42.541 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-07-12T01:57:42.951 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-07-12T01:57:43.191 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : librados2-2:18.0.0-4828.gb5891ed6.el8.x86_64 8/160 2023-07-12T01:57:43.593 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librados2-2:18.0.0-4828.gb5891ed6.el8.x86_64 8/160 2023-07-12T01:57:43.799 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : librbd1-2:18.0.0-4828.gb5891ed6.el8.x86_64 9/160 2023-07-12T01:57:43.917 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librbd1-2:18.0.0-4828.gb5891ed6.el8.x86_64 9/160 2023-07-12T01:57:44.132 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephfs2-2:18.0.0-4828.gb5891ed6.el8.x86_64 10/160 2023-07-12T01:57:44.220 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libcephfs2-2:18.0.0-4828.gb5891ed6.el8.x86_64 10/160 2023-07-12T01:57:44.482 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rados-2:18.0.0-4828.gb5891ed6.el8.x86_64 11/160 2023-07-12T01:57:44.627 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 122/160 2023-07-12T01:57:44.649 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/160 2023-07-12T01:57:44.838 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/160 2023-07-12T01:57:45.074 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-07-12T01:57:45.162 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-07-12T01:57:45.374 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/160 2023-07-12T01:57:45.641 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/160 2023-07-12T01:57:46.053 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libpq-13.5-1.el8.x86_64 16/160 2023-07-12T01:57:46.087 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-test-2:18.0.0-4828.gb5891ed6.el8.x86_64 123/160 2023-07-12T01:57:46.296 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-radosgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 124/160 2023-07-12T01:57:46.311 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 17/160 2023-07-12T01:57:46.330 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 124/160 2023-07-12T01:57:46.457 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephsqlite-2:18.0.0-4828.gb5891ed6.el8.x86_64 18/160 2023-07-12T01:57:46.526 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4828.gb5891 125/160 2023-07-12T01:57:46.563 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4828.gb5891ed6.el8.x86_64 18/160 2023-07-12T01:57:46.568 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4828.gb5891 125/160 2023-07-12T01:57:46.732 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libradosstriper1-2:18.0.0-4828.gb5891ed6.el8.x86 19/160 2023-07-12T01:57:46.750 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephfs-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 126/160 2023-07-12T01:57:46.855 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4828.gb5891ed6.el8.x86 19/160 2023-07-12T01:57:47.098 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 126/160 2023-07-12T01:57:47.114 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/160 2023-07-12T01:57:47.262 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 21/160 2023-07-12T01:57:47.342 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : rbd-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 127/160 2023-07-12T01:57:47.423 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 22/160 2023-07-12T01:57:47.543 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 127/160 2023-07-12T01:57:47.567 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 22/160 2023-07-12T01:57:47.765 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 23/160 2023-07-12T01:57:47.847 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : postgresql-contrib-10.23-1.module_el8+300+2c5300 128/160 2023-07-12T01:57:48.406 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 23/160 2023-07-12T01:57:48.599 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openblas-0.3.15-4.el8.x86_64 24/160 2023-07-12T01:57:48.748 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 129/160 2023-07-12T01:57:49.012 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 130/160 2023-07-12T01:57:49.094 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 8 - Extras 36 kB/s | 18 kB 00:00 2023-07-12T01:57:49.197 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 131/160 2023-07-12T01:57:49.241 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 24/160 2023-07-12T01:57:49.382 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-07-12T01:57:49.385 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 132/160 2023-07-12T01:57:49.562 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/160 2023-07-12T01:57:49.694 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 8 - Extras common packages 16 kB/s | 6.6 kB 00:00 2023-07-12T01:57:49.717 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcephfs-devel-2:18.0.0-4828.gb5891ed6.el8.x86_ 134/160 2023-07-12T01:57:50.150 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-07-12T01:57:50.498 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 26/160 2023-07-12T01:57:50.659 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-12T01:57:50.739 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 27/160 2023-07-12T01:57:50.866 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-12T01:57:50.912 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-12T01:57:50.962 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 28/160 2023-07-12T01:57:51.145 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 136/160 2023-07-12T01:57:51.155 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 29/160 2023-07-12T01:57:51.324 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephfs-top-2:18.0.0-4828.gb5891ed6.el8.noarch 137/160 2023-07-12T01:57:51.363 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ceph-common-2:18.0.0-4828.gb5891ed6.el8. 30/160 2023-07-12T01:57:51.486 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ceph-argparse-2:18.0.0-4828.gb5891ed6.el 31/160 2023-07-12T01:57:51.507 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : rbd-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 138/160 2023-07-12T01:57:51.744 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cephfs-2:18.0.0-4828.gb5891ed6.el8.x86_6 32/160 2023-07-12T01:57:51.836 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : rbd-nbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 139/160 2023-07-12T01:57:51.937 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 8 - PowerTools 3.0 MB/s | 6.3 MB 00:02 2023-07-12T01:57:52.151 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 140/160 2023-07-12T01:57:52.290 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-07-12T01:57:52.302 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-07-12T01:57:52.460 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 142/160 2023-07-12T01:57:52.723 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/160 2023-07-12T01:57:52.799 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/160 2023-07-12T01:57:52.842 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 33/160 2023-07-12T01:57:52.999 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/160 2023-07-12T01:57:53.010 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/160 2023-07-12T01:57:53.192 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 145/160 2023-07-12T01:57:53.215 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 34/160 2023-07-12T01:57:53.412 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 146/160 2023-07-12T01:57:53.524 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 35/160 2023-07-12T01:57:53.585 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 147/160 2023-07-12T01:57:53.585 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-07-12T01:57:53.745 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-07-12T01:57:53.826 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-07-12T01:57:53.826 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-07-12T01:57:54.050 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-07-12T01:57:54.055 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-07-12T01:57:54.177 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-07-12T01:57:54.177 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 151/160 2023-07-12T01:57:54.404 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 151/160 2023-07-12T01:57:54.558 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 152/160 2023-07-12T01:57:54.717 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 153/160 2023-07-12T01:57:54.975 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 154/160 2023-07-12T01:57:54.975 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 155/160 2023-07-12T01:57:55.176 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 155/160 2023-07-12T01:57:55.176 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 156/160 2023-07-12T01:57:55.351 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 156/160 2023-07-12T01:57:55.351 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 157/160 2023-07-12T01:57:55.543 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 157/160 2023-07-12T01:57:55.543 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 158/160 2023-07-12T01:57:55.631 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-07-12T01:57:55.784 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 158/160 2023-07-12T01:57:55.784 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-07-12T01:57:55.954 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 37/160 2023-07-12T01:57:55.955 INFO:teuthology.orchestra.run.smithi174.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-07-12T01:57:56.001 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-07-12T01:57:56.136 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/160 2023-07-12T01:57:56.173 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-07-12T01:57:56.385 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rsa-4.8-1.el8.noarch 39/160 2023-07-12T01:57:56.563 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 40/160 2023-07-12T01:57:56.747 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-07-12T01:57:56.747 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-2:18.0.0-4828.gb5891ed6.el8.x86_64 1/160 2023-07-12T01:57:56.747 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-base-2:18.0.0-4828.gb5891ed6.el8.x86_64 2/160 2023-07-12T01:57:56.748 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 3/160 2023-07-12T01:57:56.748 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 4/160 2023-07-12T01:57:56.748 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4828.gb5891 5/160 2023-07-12T01:57:56.748 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mds-2:18.0.0-4828.gb5891ed6.el8.x86_64 6/160 2023-07-12T01:57:56.748 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-2:18.0.0-4828.gb5891ed6.el8.x86_64 7/160 2023-07-12T01:57:56.748 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mon-2:18.0.0-4828.gb5891ed6.el8.x86_64 8/160 2023-07-12T01:57:56.748 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-osd-2:18.0.0-4828.gb5891ed6.el8.x86_64 9/160 2023-07-12T01:57:56.749 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-radosgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 10/160 2023-07-12T01:57:56.749 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-selinux-2:18.0.0-4828.gb5891ed6.el8.x86_64 11/160 2023-07-12T01:57:56.749 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-test-2:18.0.0-4828.gb5891ed6.el8.x86_64 12/160 2023-07-12T01:57:56.749 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephfs-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 13/160 2023-07-12T01:57:56.749 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcephfs-devel-2:18.0.0-4828.gb5891ed6.el8.x86_ 14/160 2023-07-12T01:57:56.749 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcephfs2-2:18.0.0-4828.gb5891ed6.el8.x86_64 15/160 2023-07-12T01:57:56.749 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcephsqlite-2:18.0.0-4828.gb5891ed6.el8.x86_64 16/160 2023-07-12T01:57:56.749 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librados-devel-2:18.0.0-4828.gb5891ed6.el8.x86_6 17/160 2023-07-12T01:57:56.750 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libradosstriper1-2:18.0.0-4828.gb5891ed6.el8.x86 18/160 2023-07-12T01:57:56.750 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librgw2-2:18.0.0-4828.gb5891ed6.el8.x86_64 19/160 2023-07-12T01:57:56.750 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4828.gb5891ed6.el 20/160 2023-07-12T01:57:56.750 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-ceph-common-2:18.0.0-4828.gb5891ed6.el8. 21/160 2023-07-12T01:57:56.750 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cephfs-2:18.0.0-4828.gb5891ed6.el8.x86_6 22/160 2023-07-12T01:57:56.750 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rados-2:18.0.0-4828.gb5891ed6.el8.x86_64 23/160 2023-07-12T01:57:56.750 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 24/160 2023-07-12T01:57:56.750 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 25/160 2023-07-12T01:57:56.751 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : rbd-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 26/160 2023-07-12T01:57:56.751 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : rbd-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 27/160 2023-07-12T01:57:56.759 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : rbd-nbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 28/160 2023-07-12T01:57:56.759 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4828.gb5891ed6. 29/160 2023-07-12T01:57:56.759 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4828.gb5891ed6.el8.noa 30/160 2023-07-12T01:57:56.760 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4828.gb5891ed6.el8.n 31/160 2023-07-12T01:57:56.760 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4828.gb58 32/160 2023-07-12T01:57:56.760 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4828.gb5891ed6.el 33/160 2023-07-12T01:57:56.760 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4828.gb5891ed6.el8.noarch 34/160 2023-07-12T01:57:56.760 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4828.gb5891ed6.e 35/160 2023-07-12T01:57:56.760 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-volume-2:18.0.0-4828.gb5891ed6.el8.noarch 36/160 2023-07-12T01:57:56.760 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 37/160 2023-07-12T01:57:56.760 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephfs-top-2:18.0.0-4828.gb5891ed6.el8.noarch 38/160 2023-07-12T01:57:56.761 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/160 2023-07-12T01:57:56.761 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/160 2023-07-12T01:57:56.761 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/160 2023-07-12T01:57:56.761 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : jq-1.6-7.el8.x86_64 42/160 2023-07-12T01:57:56.761 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/160 2023-07-12T01:57:56.761 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/160 2023-07-12T01:57:56.761 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/160 2023-07-12T01:57:56.761 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/160 2023-07-12T01:57:56.762 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/160 2023-07-12T01:57:56.762 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/160 2023-07-12T01:57:56.762 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/160 2023-07-12T01:57:56.762 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 50/160 2023-07-12T01:57:56.762 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : postgresql-contrib-10.23-1.module_el8+300+2c5300 51/160 2023-07-12T01:57:56.762 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : postgresql-server-10.23-1.module_el8+300+2c53004 52/160 2023-07-12T01:57:56.762 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/160 2023-07-12T01:57:56.762 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/160 2023-07-12T01:57:56.763 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/160 2023-07-12T01:57:56.763 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/160 2023-07-12T01:57:56.763 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/160 2023-07-12T01:57:56.763 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/160 2023-07-12T01:57:56.763 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/160 2023-07-12T01:57:56.763 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/160 2023-07-12T01:57:56.763 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/160 2023-07-12T01:57:56.764 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/160 2023-07-12T01:57:56.764 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/160 2023-07-12T01:57:56.764 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/160 2023-07-12T01:57:56.764 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/160 2023-07-12T01:57:56.764 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/160 2023-07-12T01:57:56.764 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/160 2023-07-12T01:57:56.764 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/160 2023-07-12T01:57:56.764 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/160 2023-07-12T01:57:56.765 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/160 2023-07-12T01:57:56.765 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 71/160 2023-07-12T01:57:56.765 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 72/160 2023-07-12T01:57:56.765 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/160 2023-07-12T01:57:56.765 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/160 2023-07-12T01:57:56.765 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/160 2023-07-12T01:57:56.765 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/160 2023-07-12T01:57:56.765 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 77/160 2023-07-12T01:57:56.766 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 78/160 2023-07-12T01:57:56.766 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 79/160 2023-07-12T01:57:56.766 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/160 2023-07-12T01:57:56.766 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/160 2023-07-12T01:57:56.766 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 82/160 2023-07-12T01:57:56.766 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/160 2023-07-12T01:57:56.766 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/160 2023-07-12T01:57:56.766 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 85/160 2023-07-12T01:57:56.767 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/160 2023-07-12T01:57:56.767 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/160 2023-07-12T01:57:56.767 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/160 2023-07-12T01:57:56.767 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 89/160 2023-07-12T01:57:56.767 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 90/160 2023-07-12T01:57:56.767 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/160 2023-07-12T01:57:56.767 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/160 2023-07-12T01:57:56.767 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/160 2023-07-12T01:57:56.768 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/160 2023-07-12T01:57:56.768 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 95/160 2023-07-12T01:57:56.768 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/160 2023-07-12T01:57:56.768 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 97/160 2023-07-12T01:57:56.768 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/160 2023-07-12T01:57:56.768 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/160 2023-07-12T01:57:56.769 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 100/160 2023-07-12T01:57:56.769 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/160 2023-07-12T01:57:56.769 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/160 2023-07-12T01:57:56.769 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/160 2023-07-12T01:57:56.769 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/160 2023-07-12T01:57:56.769 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/160 2023-07-12T01:57:56.769 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/160 2023-07-12T01:57:56.769 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/160 2023-07-12T01:57:56.770 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/160 2023-07-12T01:57:56.770 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/160 2023-07-12T01:57:56.770 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/160 2023-07-12T01:57:56.770 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/160 2023-07-12T01:57:56.770 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/160 2023-07-12T01:57:56.770 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 113/160 2023-07-12T01:57:56.770 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 114/160 2023-07-12T01:57:56.770 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-portend-2.6-1.el8.noarch 115/160 2023-07-12T01:57:56.771 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/160 2023-07-12T01:57:56.771 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/160 2023-07-12T01:57:56.771 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 118/160 2023-07-12T01:57:56.771 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/160 2023-07-12T01:57:56.771 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/160 2023-07-12T01:57:56.771 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/160 2023-07-12T01:57:56.771 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/160 2023-07-12T01:57:56.771 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 123/160 2023-07-12T01:57:56.772 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/160 2023-07-12T01:57:56.772 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/160 2023-07-12T01:57:56.772 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/160 2023-07-12T01:57:56.772 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/160 2023-07-12T01:57:56.772 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 128/160 2023-07-12T01:57:56.772 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librados2-2:18.0.0-4828.gb5891ed6.el8.x86_64 129/160 2023-07-12T01:57:56.772 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/160 2023-07-12T01:57:56.772 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librbd1-2:18.0.0-4828.gb5891ed6.el8.x86_64 131/160 2023-07-12T01:57:56.773 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/160 2023-07-12T01:57:56.773 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-8.el 133/160 2023-07-12T01:57:56.773 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 134/160 2023-07-12T01:57:56.773 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 135/160 2023-07-12T01:57:56.773 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 136/160 2023-07-12T01:57:56.773 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 137/160 2023-07-12T01:57:56.773 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 138/160 2023-07-12T01:57:56.773 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 139/160 2023-07-12T01:57:56.774 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 140/160 2023-07-12T01:57:56.774 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 141/160 2023-07-12T01:57:56.774 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 142/160 2023-07-12T01:57:56.774 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 143/160 2023-07-12T01:57:56.774 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 144/160 2023-07-12T01:57:56.774 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 145/160 2023-07-12T01:57:56.774 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 146/160 2023-07-12T01:57:56.774 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 147/160 2023-07-12T01:57:56.775 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 148/160 2023-07-12T01:57:56.775 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 149/160 2023-07-12T01:57:56.775 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 150/160 2023-07-12T01:57:56.775 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 151/160 2023-07-12T01:57:56.775 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 152/160 2023-07-12T01:57:56.775 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 153/160 2023-07-12T01:57:56.775 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 154/160 2023-07-12T01:57:56.775 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 155/160 2023-07-12T01:57:56.776 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 156/160 2023-07-12T01:57:56.776 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 157/160 2023-07-12T01:57:56.776 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 158/160 2023-07-12T01:57:56.776 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 159/160 2023-07-12T01:57:56.776 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librados-devel-2:18.0.0-4828.gb5891ed6.el8.x86_6 41/160 2023-07-12T01:57:56.926 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 42/160 2023-07-12T01:57:57.148 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 43/160 2023-07-12T01:57:57.405 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 44/160 2023-07-12T01:57:57.487 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 44/160 2023-07-12T01:57:57.647 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 45/160 2023-07-12T01:57:57.706 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 45/160 2023-07-12T01:57:57.859 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 46/160 2023-07-12T01:57:58.039 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-07-12T01:57:58.532 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-07-12T01:57:58.848 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 48/160 2023-07-12T01:57:58.863 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 48/160 2023-07-12T01:57:58.871 INFO:teuthology.orchestra.run.smithi174.stdout:Extra Packages for Enterprise Linux 5.7 MB/s | 16 MB 00:02 2023-07-12T01:57:58.874 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 160/160 2023-07-12T01:57:58.874 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-07-12T01:57:58.874 INFO:teuthology.orchestra.run.smithi079.stdout:Upgraded: 2023-07-12T01:57:58.874 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager-initscripts-updown-1:1.40.16-8.el8.noarch 2023-07-12T01:57:58.874 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-07-12T01:57:58.874 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-07-12T01:57:58.875 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-07-12T01:57:58.875 INFO:teuthology.orchestra.run.smithi079.stdout: iproute-6.2.0-2.el8.x86_64 2023-07-12T01:57:58.875 INFO:teuthology.orchestra.run.smithi079.stdout: libblkid-2.32.1-42.el8.x86_64 2023-07-12T01:57:58.875 INFO:teuthology.orchestra.run.smithi079.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-07-12T01:57:58.875 INFO:teuthology.orchestra.run.smithi079.stdout: libmount-2.32.1-42.el8.x86_64 2023-07-12T01:57:58.875 INFO:teuthology.orchestra.run.smithi079.stdout: librados2-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:57:58.875 INFO:teuthology.orchestra.run.smithi079.stdout: librbd1-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:57:58.876 INFO:teuthology.orchestra.run.smithi079.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-07-12T01:57:58.876 INFO:teuthology.orchestra.run.smithi079.stdout: libuuid-2.32.1-42.el8.x86_64 2023-07-12T01:57:58.876 INFO:teuthology.orchestra.run.smithi079.stdout: util-linux-2.32.1-42.el8.x86_64 2023-07-12T01:57:58.876 INFO:teuthology.orchestra.run.smithi079.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-07-12T01:57:58.876 INFO:teuthology.orchestra.run.smithi079.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-07-12T01:57:58.876 INFO:teuthology.orchestra.run.smithi079.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-07-12T01:57:58.876 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2023-07-12T01:57:58.876 INFO:teuthology.orchestra.run.smithi079.stdout: automake-1.16.1-7.el8.noarch 2023-07-12T01:57:58.877 INFO:teuthology.orchestra.run.smithi079.stdout: bison-3.0.4-10.el8.x86_64 2023-07-12T01:57:58.877 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:57:58.877 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-base-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:57:58.877 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:57:58.877 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:57:58.877 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-grafana-dashboards-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T01:57:58.877 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-immutable-object-cache-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:57:58.878 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mds-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:57:58.878 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:57:58.878 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T01:57:58.878 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-dashboard-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T01:57:58.878 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T01:57:58.878 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-modules-core-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T01:57:58.878 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-rook-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T01:57:58.878 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mon-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:57:58.879 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-osd-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:57:58.879 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-prometheus-alerts-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T01:57:58.879 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-radosgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:57:58.879 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-selinux-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:57:58.879 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-test-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:57:58.879 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-volume-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T01:57:58.879 INFO:teuthology.orchestra.run.smithi079.stdout: cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T01:57:58.879 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:57:58.880 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-top-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T01:57:58.880 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-07-12T01:57:58.880 INFO:teuthology.orchestra.run.smithi079.stdout: flex-2.6.1-9.el8.x86_64 2023-07-12T01:57:58.880 INFO:teuthology.orchestra.run.smithi079.stdout: fuse-2.9.7-17.el8.x86_64 2023-07-12T01:57:58.880 INFO:teuthology.orchestra.run.smithi079.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-12T01:57:58.880 INFO:teuthology.orchestra.run.smithi079.stdout: jq-1.6-7.el8.x86_64 2023-07-12T01:57:58.880 INFO:teuthology.orchestra.run.smithi079.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-12T01:57:58.881 INFO:teuthology.orchestra.run.smithi079.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-07-12T01:57:58.881 INFO:teuthology.orchestra.run.smithi079.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-12T01:57:58.881 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs-devel-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:57:58.881 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs2-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:57:58.881 INFO:teuthology.orchestra.run.smithi079.stdout: libcephsqlite-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:57:58.881 INFO:teuthology.orchestra.run.smithi079.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-07-12T01:57:58.881 INFO:teuthology.orchestra.run.smithi079.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-07-12T01:57:58.881 INFO:teuthology.orchestra.run.smithi079.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-12T01:57:58.882 INFO:teuthology.orchestra.run.smithi079.stdout: libpq-13.5-1.el8.x86_64 2023-07-12T01:57:58.882 INFO:teuthology.orchestra.run.smithi079.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-07-12T01:57:58.882 INFO:teuthology.orchestra.run.smithi079.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-07-12T01:57:58.882 INFO:teuthology.orchestra.run.smithi079.stdout: librados-devel-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:57:58.882 INFO:teuthology.orchestra.run.smithi079.stdout: libradosstriper1-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:57:58.882 INFO:teuthology.orchestra.run.smithi079.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-12T01:57:58.882 INFO:teuthology.orchestra.run.smithi079.stdout: librgw2-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:57:58.883 INFO:teuthology.orchestra.run.smithi079.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-07-12T01:57:58.883 INFO:teuthology.orchestra.run.smithi079.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-12T01:57:58.883 INFO:teuthology.orchestra.run.smithi079.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-12T01:57:58.883 INFO:teuthology.orchestra.run.smithi079.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-12T01:57:58.883 INFO:teuthology.orchestra.run.smithi079.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-07-12T01:57:58.883 INFO:teuthology.orchestra.run.smithi079.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-07-12T01:57:58.883 INFO:teuthology.orchestra.run.smithi079.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-07-12T01:57:58.883 INFO:teuthology.orchestra.run.smithi079.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-12T01:57:58.884 INFO:teuthology.orchestra.run.smithi079.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-12T01:57:58.884 INFO:teuthology.orchestra.run.smithi079.stdout: openblas-0.3.15-4.el8.x86_64 2023-07-12T01:57:58.884 INFO:teuthology.orchestra.run.smithi079.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-07-12T01:57:58.884 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-07-12T01:57:58.884 INFO:teuthology.orchestra.run.smithi079.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-07-12T01:57:58.884 INFO:teuthology.orchestra.run.smithi079.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-07-12T01:57:58.884 INFO:teuthology.orchestra.run.smithi079.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-07-12T01:57:58.884 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-12T01:57:58.885 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-contrib-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-12T01:57:58.885 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-server-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-12T01:57:58.885 INFO:teuthology.orchestra.run.smithi079.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-12T01:57:58.885 INFO:teuthology.orchestra.run.smithi079.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-12T01:57:58.885 INFO:teuthology.orchestra.run.smithi079.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-12T01:57:58.885 INFO:teuthology.orchestra.run.smithi079.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-12T01:57:58.885 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-12T01:57:58.885 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-argparse-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:57:58.886 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:57:58.886 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cephfs-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:57:58.886 INFO:teuthology.orchestra.run.smithi079.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-12T01:57:58.886 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-07-12T01:57:58.886 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-12T01:57:58.886 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-12T01:57:58.886 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-07-12T01:57:58.886 INFO:teuthology.orchestra.run.smithi079.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-12T01:57:58.887 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-12T01:57:58.887 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-12T01:57:58.887 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-12T01:57:58.887 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-12T01:57:58.887 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-12T01:57:58.887 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-12T01:57:58.887 INFO:teuthology.orchestra.run.smithi079.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-12T01:57:58.888 INFO:teuthology.orchestra.run.smithi079.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-12T01:57:58.888 INFO:teuthology.orchestra.run.smithi079.stdout: python3-mako-1.0.6-14.el8.noarch 2023-07-12T01:57:58.888 INFO:teuthology.orchestra.run.smithi079.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-12T01:57:58.888 INFO:teuthology.orchestra.run.smithi079.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-12T01:57:58.888 INFO:teuthology.orchestra.run.smithi079.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-12T01:57:58.888 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-12T01:57:58.888 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-12T01:57:58.888 INFO:teuthology.orchestra.run.smithi079.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-12T01:57:58.889 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-12T01:57:58.889 INFO:teuthology.orchestra.run.smithi079.stdout: python3-portend-2.6-1.el8.noarch 2023-07-12T01:57:58.889 INFO:teuthology.orchestra.run.smithi079.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-12T01:57:58.889 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-12T01:57:58.889 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-12T01:57:58.889 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-12T01:57:58.889 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-12T01:57:58.889 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-12T01:57:58.890 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rados-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:57:58.890 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:57:58.890 INFO:teuthology.orchestra.run.smithi079.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-12T01:57:58.890 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-12T01:57:58.890 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:57:58.890 INFO:teuthology.orchestra.run.smithi079.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-12T01:57:58.890 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-12T01:57:58.890 INFO:teuthology.orchestra.run.smithi079.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-07-12T01:57:58.891 INFO:teuthology.orchestra.run.smithi079.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-12T01:57:58.891 INFO:teuthology.orchestra.run.smithi079.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-12T01:57:58.891 INFO:teuthology.orchestra.run.smithi079.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-12T01:57:58.891 INFO:teuthology.orchestra.run.smithi079.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-12T01:57:58.891 INFO:teuthology.orchestra.run.smithi079.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-12T01:57:58.891 INFO:teuthology.orchestra.run.smithi079.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-12T01:57:58.891 INFO:teuthology.orchestra.run.smithi079.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-12T01:57:58.891 INFO:teuthology.orchestra.run.smithi079.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-12T01:57:58.892 INFO:teuthology.orchestra.run.smithi079.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-12T01:57:58.892 INFO:teuthology.orchestra.run.smithi079.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-12T01:57:58.892 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:57:58.892 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:57:58.892 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-nbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:57:58.892 INFO:teuthology.orchestra.run.smithi079.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-12T01:57:58.892 INFO:teuthology.orchestra.run.smithi079.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-12T01:57:58.892 INFO:teuthology.orchestra.run.smithi079.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-12T01:57:58.893 INFO:teuthology.orchestra.run.smithi079.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-07-12T01:57:58.893 INFO:teuthology.orchestra.run.smithi079.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-12T01:57:58.893 INFO:teuthology.orchestra.run.smithi079.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-07-12T01:57:58.893 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-07-12T01:57:58.893 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2023-07-12T01:57:59.073 DEBUG:teuthology.parallel:result is None 2023-07-12T01:57:59.085 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/160 2023-07-12T01:57:59.346 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/160 2023-07-12T01:57:59.604 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/160 2023-07-12T01:57:59.735 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/160 2023-07-12T01:57:59.917 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/160 2023-07-12T01:58:00.086 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/160 2023-07-12T01:58:00.312 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/160 2023-07-12T01:58:00.503 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/160 2023-07-12T01:58:00.709 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/160 2023-07-12T01:58:00.854 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/160 2023-07-12T01:58:01.086 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/160 2023-07-12T01:58:01.270 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/160 2023-07-12T01:58:01.457 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/160 2023-07-12T01:58:01.624 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/160 2023-07-12T01:58:01.869 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/160 2023-07-12T01:58:02.133 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/160 2023-07-12T01:58:02.310 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/160 2023-07-12T01:58:02.687 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/160 2023-07-12T01:58:02.973 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/160 2023-07-12T01:58:03.175 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/160 2023-07-12T01:58:03.280 INFO:teuthology.orchestra.run.smithi174.stdout:lab-extras 162 kB/s | 24 kB 00:00 2023-07-12T01:58:04.063 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/160 2023-07-12T01:58:04.313 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librgw2-2:18.0.0-4828.gb5891ed6.el8.x86_64 70/160 2023-07-12T01:58:04.374 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librgw2-2:18.0.0-4828.gb5891ed6.el8.x86_64 70/160 2023-07-12T01:58:04.554 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 71/160 2023-07-12T01:58:04.852 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 72/160 2023-07-12T01:58:05.306 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 73/160 2023-07-12T01:58:05.610 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 74/160 2023-07-12T01:58:05.859 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 75/160 2023-07-12T01:58:06.101 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 76/160 2023-07-12T01:58:06.345 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 77/160 2023-07-12T01:58:07.203 INFO:teuthology.orchestra.run.smithi174.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-12T01:58:07.204 INFO:teuthology.orchestra.run.smithi174.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-12T01:58:07.218 INFO:teuthology.orchestra.run.smithi174.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-07-12T01:58:07.218 INFO:teuthology.orchestra.run.smithi174.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-07-12T01:58:07.219 INFO:teuthology.orchestra.run.smithi174.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-07-12T01:58:07.220 INFO:teuthology.orchestra.run.smithi174.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-07-12T01:58:07.221 INFO:teuthology.orchestra.run.smithi174.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-12T01:58:07.223 INFO:teuthology.orchestra.run.smithi174.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-12T01:58:07.226 INFO:teuthology.orchestra.run.smithi174.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-12T01:58:07.227 INFO:teuthology.orchestra.run.smithi174.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-12T01:58:07.418 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2023-07-12T01:58:07.432 INFO:teuthology.orchestra.run.smithi174.stdout:==================================================================================================== 2023-07-12T01:58:07.432 INFO:teuthology.orchestra.run.smithi174.stdout: Package Arch Version Repository Size 2023-07-12T01:58:07.432 INFO:teuthology.orchestra.run.smithi174.stdout:==================================================================================================== 2023-07-12T01:58:07.432 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2023-07-12T01:58:07.433 INFO:teuthology.orchestra.run.smithi174.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-07-12T01:58:07.433 INFO:teuthology.orchestra.run.smithi174.stdout: ceph x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 6.4 k 2023-07-12T01:58:07.433 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-base x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 5.4 M 2023-07-12T01:58:07.433 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-fuse x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 848 k 2023-07-12T01:58:07.433 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 165 k 2023-07-12T01:58:07.433 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 1.5 M 2023-07-12T01:58:07.433 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 129 k 2023-07-12T01:58:07.434 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 1.7 M 2023-07-12T01:58:07.434 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 7.4 M 2023-07-12T01:58:07.434 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-rook noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 47 k 2023-07-12T01:58:07.434 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-radosgw x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 13 M 2023-07-12T01:58:07.434 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-test x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 48 M 2023-07-12T01:58:07.434 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-volume noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 258 k 2023-07-12T01:58:07.434 INFO:teuthology.orchestra.run.smithi174.stdout: cephadm noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 164 k 2023-07-12T01:58:07.435 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-mirror x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 258 k 2023-07-12T01:58:07.435 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-top noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 18 k 2023-07-12T01:58:07.435 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-07-12T01:58:07.435 INFO:teuthology.orchestra.run.smithi174.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-07-12T01:58:07.435 INFO:teuthology.orchestra.run.smithi174.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-07-12T01:58:07.435 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs-devel x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 31 k 2023-07-12T01:58:07.435 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs2 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 771 k 2023-07-12T01:58:07.435 INFO:teuthology.orchestra.run.smithi174.stdout: librados-devel x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 139 k 2023-07-12T01:58:07.436 INFO:teuthology.orchestra.run.smithi174.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-07-12T01:58:07.436 INFO:teuthology.orchestra.run.smithi174.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-07-12T01:58:07.436 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-07-12T01:58:07.436 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql x86_64 10.23-1.module_el8+300+2c53004c appstream 1.6 M 2023-07-12T01:58:07.436 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-contrib x86_64 10.23-1.module_el8+300+2c53004c appstream 903 k 2023-07-12T01:58:07.436 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-server x86_64 10.23-1.module_el8+300+2c53004c appstream 5.1 M 2023-07-12T01:58:07.436 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cephfs x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 197 k 2023-07-12T01:58:07.437 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rados x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 371 k 2023-07-12T01:58:07.437 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rbd x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 364 k 2023-07-12T01:58:07.437 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rgw x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 107 k 2023-07-12T01:58:07.437 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-fuse x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 94 k 2023-07-12T01:58:07.437 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-mirror x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 3.4 M 2023-07-12T01:58:07.437 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-nbd x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 180 k 2023-07-12T01:58:07.437 INFO:teuthology.orchestra.run.smithi174.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-07-12T01:58:07.438 INFO:teuthology.orchestra.run.smithi174.stdout:Upgrading: 2023-07-12T01:58:07.438 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-8.el8 baseos 143 k 2023-07-12T01:58:07.438 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-07-12T01:58:07.438 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-07-12T01:58:07.438 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-07-12T01:58:07.438 INFO:teuthology.orchestra.run.smithi174.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-07-12T01:58:07.438 INFO:teuthology.orchestra.run.smithi174.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-07-12T01:58:07.439 INFO:teuthology.orchestra.run.smithi174.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-07-12T01:58:07.439 INFO:teuthology.orchestra.run.smithi174.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-07-12T01:58:07.439 INFO:teuthology.orchestra.run.smithi174.stdout: librados2 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 3.7 M 2023-07-12T01:58:07.439 INFO:teuthology.orchestra.run.smithi174.stdout: librbd1 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 3.6 M 2023-07-12T01:58:07.439 INFO:teuthology.orchestra.run.smithi174.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-07-12T01:58:07.439 INFO:teuthology.orchestra.run.smithi174.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-07-12T01:58:07.439 INFO:teuthology.orchestra.run.smithi174.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-07-12T01:58:07.439 INFO:teuthology.orchestra.run.smithi174.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-07-12T01:58:07.440 INFO:teuthology.orchestra.run.smithi174.stdout: xfsdump x86_64 3.1.8-6.el8 baseos 334 k 2023-07-12T01:58:07.440 INFO:teuthology.orchestra.run.smithi174.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-07-12T01:58:07.440 INFO:teuthology.orchestra.run.smithi174.stdout:Installing dependencies: 2023-07-12T01:58:07.440 INFO:teuthology.orchestra.run.smithi174.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-07-12T01:58:07.440 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-common x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 22 M 2023-07-12T01:58:07.440 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 23 k 2023-07-12T01:58:07.440 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mds x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 2.3 M 2023-07-12T01:58:07.441 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 240 k 2023-07-12T01:58:07.441 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mon x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 4.6 M 2023-07-12T01:58:07.441 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-osd x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 18 M 2023-07-12T01:58:07.441 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4828.gb5891ed6.el8 ceph-noarch 15 k 2023-07-12T01:58:07.441 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-selinux x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 24 k 2023-07-12T01:58:07.441 INFO:teuthology.orchestra.run.smithi174.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-07-12T01:58:07.441 INFO:teuthology.orchestra.run.smithi174.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-12T01:58:07.442 INFO:teuthology.orchestra.run.smithi174.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-07-12T01:58:07.442 INFO:teuthology.orchestra.run.smithi174.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-07-12T01:58:07.442 INFO:teuthology.orchestra.run.smithi174.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-07-12T01:58:07.442 INFO:teuthology.orchestra.run.smithi174.stdout: libcephsqlite x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 137 k 2023-07-12T01:58:07.442 INFO:teuthology.orchestra.run.smithi174.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-07-12T01:58:07.442 INFO:teuthology.orchestra.run.smithi174.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-07-12T01:58:07.442 INFO:teuthology.orchestra.run.smithi174.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-12T01:58:07.443 INFO:teuthology.orchestra.run.smithi174.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-07-12T01:58:07.443 INFO:teuthology.orchestra.run.smithi174.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-07-12T01:58:07.443 INFO:teuthology.orchestra.run.smithi174.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-07-12T01:58:07.443 INFO:teuthology.orchestra.run.smithi174.stdout: libradosstriper1 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 473 k 2023-07-12T01:58:07.443 INFO:teuthology.orchestra.run.smithi174.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-07-12T01:58:07.443 INFO:teuthology.orchestra.run.smithi174.stdout: librgw2 x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 6.7 M 2023-07-12T01:58:07.443 INFO:teuthology.orchestra.run.smithi174.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-07-12T01:58:07.443 INFO:teuthology.orchestra.run.smithi174.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-07-12T01:58:07.444 INFO:teuthology.orchestra.run.smithi174.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-12T01:58:07.444 INFO:teuthology.orchestra.run.smithi174.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-07-12T01:58:07.444 INFO:teuthology.orchestra.run.smithi174.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-07-12T01:58:07.444 INFO:teuthology.orchestra.run.smithi174.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-07-12T01:58:07.444 INFO:teuthology.orchestra.run.smithi174.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-07-12T01:58:07.444 INFO:teuthology.orchestra.run.smithi174.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-07-12T01:58:07.444 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-07-12T01:58:07.445 INFO:teuthology.orchestra.run.smithi174.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-07-12T01:58:07.445 INFO:teuthology.orchestra.run.smithi174.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-07-12T01:58:07.445 INFO:teuthology.orchestra.run.smithi174.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-07-12T01:58:07.445 INFO:teuthology.orchestra.run.smithi174.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-12T01:58:07.445 INFO:teuthology.orchestra.run.smithi174.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-07-12T01:58:07.445 INFO:teuthology.orchestra.run.smithi174.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-12T01:58:07.445 INFO:teuthology.orchestra.run.smithi174.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-12T01:58:07.445 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-12T01:58:07.446 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-argparse x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 45 k 2023-07-12T01:58:07.446 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-common x86_64 2:18.0.0-4828.gb5891ed6.el8 ceph 122 k 2023-07-12T01:58:07.446 INFO:teuthology.orchestra.run.smithi174.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-12T01:58:07.446 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-07-12T01:58:07.446 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-12T01:58:07.446 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-12T01:58:07.446 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-07-12T01:58:07.446 INFO:teuthology.orchestra.run.smithi174.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-12T01:58:07.447 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-12T01:58:07.447 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-12T01:58:07.447 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-07-12T01:58:07.447 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-07-12T01:58:07.447 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-07-12T01:58:07.447 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-07-12T01:58:07.447 INFO:teuthology.orchestra.run.smithi174.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-12T01:58:07.447 INFO:teuthology.orchestra.run.smithi174.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-12T01:58:07.448 INFO:teuthology.orchestra.run.smithi174.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-07-12T01:58:07.448 INFO:teuthology.orchestra.run.smithi174.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-07-12T01:58:07.448 INFO:teuthology.orchestra.run.smithi174.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-12T01:58:07.448 INFO:teuthology.orchestra.run.smithi174.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-12T01:58:07.448 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-07-12T01:58:07.448 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-07-12T01:58:07.448 INFO:teuthology.orchestra.run.smithi174.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-07-12T01:58:07.449 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-12T01:58:07.449 INFO:teuthology.orchestra.run.smithi174.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-12T01:58:07.449 INFO:teuthology.orchestra.run.smithi174.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-07-12T01:58:07.449 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-07-12T01:58:07.449 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-07-12T01:58:07.449 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-07-12T01:58:07.449 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-07-12T01:58:07.449 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-07-12T01:58:07.450 INFO:teuthology.orchestra.run.smithi174.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-12T01:58:07.450 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-07-12T01:58:07.450 INFO:teuthology.orchestra.run.smithi174.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-12T01:58:07.450 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-12T01:58:07.450 INFO:teuthology.orchestra.run.smithi174.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-07-12T01:58:07.450 INFO:teuthology.orchestra.run.smithi174.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-12T01:58:07.450 INFO:teuthology.orchestra.run.smithi174.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-12T01:58:07.450 INFO:teuthology.orchestra.run.smithi174.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-12T01:58:07.451 INFO:teuthology.orchestra.run.smithi174.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-12T01:58:07.451 INFO:teuthology.orchestra.run.smithi174.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-12T01:58:07.451 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-12T01:58:07.451 INFO:teuthology.orchestra.run.smithi174.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-12T01:58:07.451 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-12T01:58:07.451 INFO:teuthology.orchestra.run.smithi174.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-07-12T01:58:07.451 INFO:teuthology.orchestra.run.smithi174.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-12T01:58:07.451 INFO:teuthology.orchestra.run.smithi174.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-07-12T01:58:07.452 INFO:teuthology.orchestra.run.smithi174.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-12T01:58:07.452 INFO:teuthology.orchestra.run.smithi174.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-07-12T01:58:07.452 INFO:teuthology.orchestra.run.smithi174.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-07-12T01:58:07.452 INFO:teuthology.orchestra.run.smithi174.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-07-12T01:58:07.452 INFO:teuthology.orchestra.run.smithi174.stdout:Enabling module streams: 2023-07-12T01:58:07.452 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql 10 2023-07-12T01:58:07.452 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T01:58:07.453 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2023-07-12T01:58:07.453 INFO:teuthology.orchestra.run.smithi174.stdout:==================================================================================================== 2023-07-12T01:58:07.453 INFO:teuthology.orchestra.run.smithi174.stdout:Install 128 Packages 2023-07-12T01:58:07.453 INFO:teuthology.orchestra.run.smithi174.stdout:Upgrade 16 Packages 2023-07-12T01:58:07.453 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T01:58:07.454 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 212 M 2023-07-12T01:58:07.454 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading Packages: 2023-07-12T01:58:07.531 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/160 2023-07-12T01:58:07.898 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/160 2023-07-12T01:58:08.088 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 80/160 2023-07-12T01:58:08.284 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 81/160 2023-07-12T01:58:08.559 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 82/160 2023-07-12T01:58:08.843 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 83/160 2023-07-12T01:58:09.108 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 84/160 2023-07-12T01:58:09.298 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 85/160 2023-07-12T01:58:09.640 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 86/160 2023-07-12T01:58:09.843 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 87/160 2023-07-12T01:58:09.990 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 88/160 2023-07-12T01:58:10.207 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 89/160 2023-07-12T01:58:10.563 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 90/160 2023-07-12T01:58:10.825 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 91/160 2023-07-12T01:58:10.953 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 92/160 2023-07-12T01:58:11.153 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 93/160 2023-07-12T01:58:11.323 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 94/160 2023-07-12T01:58:11.532 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : fuse-2.9.7-17.el8.x86_64 95/160 2023-07-12T01:58:11.699 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 96/160 2023-07-12T01:58:11.887 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : uuid-1.6.2-43.el8.x86_64 97/160 2023-07-12T01:58:11.994 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 97/160 2023-07-12T01:58:12.172 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 98/160 2023-07-12T01:58:12.354 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 99/160 2023-07-12T01:58:13.247 INFO:teuthology.orchestra.run.smithi174.stdout:(1/144): ceph-18.0.0-4828.gb5891ed6.el8.x86_64. 45 kB/s | 6.4 kB 00:00 2023-07-12T01:58:13.848 INFO:teuthology.orchestra.run.smithi174.stdout:(2/144): ceph-fuse-18.0.0-4828.gb5891ed6.el8.x8 1.4 MB/s | 848 kB 00:00 2023-07-12T01:58:14.006 INFO:teuthology.orchestra.run.smithi174.stdout:(3/144): ceph-immutable-object-cache-18.0.0-482 1.0 MB/s | 165 kB 00:00 2023-07-12T01:58:14.865 INFO:teuthology.orchestra.run.smithi174.stdout:(4/144): ceph-mds-18.0.0-4828.gb5891ed6.el8.x86 2.7 MB/s | 2.3 MB 00:00 2023-07-12T01:58:15.084 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 100/160 2023-07-12T01:58:15.515 INFO:teuthology.orchestra.run.smithi174.stdout:(5/144): ceph-mgr-18.0.0-4828.gb5891ed6.el8.x86 2.4 MB/s | 1.5 MB 00:00 2023-07-12T01:58:15.687 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 100/160 2023-07-12T01:58:16.057 INFO:teuthology.orchestra.run.smithi174.stdout:(6/144): ceph-base-18.0.0-4828.gb5891ed6.el8.x8 1.8 MB/s | 5.4 MB 00:02 2023-07-12T01:58:16.310 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 100/160 2023-07-12T01:58:16.625 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-base-2:18.0.0-4828.gb5891ed6.el8.x86_64 101/160 2023-07-12T01:58:16.728 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-base-2:18.0.0-4828.gb5891ed6.el8.x86_64 101/160 2023-07-12T01:58:16.873 INFO:teuthology.orchestra.run.smithi174.stdout:(7/144): ceph-common-18.0.0-4828.gb5891ed6.el8. 5.9 MB/s | 22 MB 00:03 2023-07-12T01:58:16.928 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-selinux-2:18.0.0-4828.gb5891ed6.el8.x86_64 102/160 2023-07-12T01:58:17.199 INFO:teuthology.orchestra.run.smithi174.stdout:(8/144): ceph-mon-18.0.0-4828.gb5891ed6.el8.x86 2.7 MB/s | 4.6 MB 00:01 2023-07-12T01:58:17.249 INFO:teuthology.orchestra.run.smithi174.stdout:(9/144): ceph-selinux-18.0.0-4828.gb5891ed6.el8 486 kB/s | 24 kB 00:00 2023-07-12T01:58:17.816 INFO:teuthology.orchestra.run.smithi174.stdout:(10/144): ceph-radosgw-18.0.0-4828.gb5891ed6.el 14 MB/s | 13 MB 00:00 2023-07-12T01:58:17.866 INFO:teuthology.orchestra.run.smithi174.stdout:(11/144): cephfs-mirror-18.0.0-4828.gb5891ed6.e 5.1 MB/s | 258 kB 00:00 2023-07-12T01:58:17.908 INFO:teuthology.orchestra.run.smithi174.stdout:(12/144): libcephfs-devel-18.0.0-4828.gb5891ed6 748 kB/s | 31 kB 00:00 2023-07-12T01:58:17.983 INFO:teuthology.orchestra.run.smithi174.stdout:(13/144): libcephfs2-18.0.0-4828.gb5891ed6.el8. 10 MB/s | 771 kB 00:00 2023-07-12T01:58:18.025 INFO:teuthology.orchestra.run.smithi174.stdout:(14/144): libcephsqlite-18.0.0-4828.gb5891ed6.e 3.2 MB/s | 137 kB 00:00 2023-07-12T01:58:18.075 INFO:teuthology.orchestra.run.smithi174.stdout:(15/144): librados-devel-18.0.0-4828.gb5891ed6. 2.7 MB/s | 139 kB 00:00 2023-07-12T01:58:18.134 INFO:teuthology.orchestra.run.smithi174.stdout:(16/144): libradosstriper1-18.0.0-4828.gb5891ed 7.9 MB/s | 473 kB 00:00 2023-07-12T01:58:18.601 INFO:teuthology.orchestra.run.smithi174.stdout:(17/144): librgw2-18.0.0-4828.gb5891ed6.el8.x86 14 MB/s | 6.7 MB 00:00 2023-07-12T01:58:18.643 INFO:teuthology.orchestra.run.smithi174.stdout:(18/144): python3-ceph-argparse-18.0.0-4828.gb5 1.1 MB/s | 45 kB 00:00 2023-07-12T01:58:18.693 INFO:teuthology.orchestra.run.smithi174.stdout:(19/144): python3-ceph-common-18.0.0-4828.gb589 2.4 MB/s | 122 kB 00:00 2023-07-12T01:58:18.735 INFO:teuthology.orchestra.run.smithi174.stdout:(20/144): python3-cephfs-18.0.0-4828.gb5891ed6. 4.6 MB/s | 197 kB 00:00 2023-07-12T01:58:18.785 INFO:teuthology.orchestra.run.smithi174.stdout:(21/144): python3-rados-18.0.0-4828.gb5891ed6.e 7.3 MB/s | 371 kB 00:00 2023-07-12T01:58:18.844 INFO:teuthology.orchestra.run.smithi174.stdout:(22/144): python3-rbd-18.0.0-4828.gb5891ed6.el8 6.1 MB/s | 364 kB 00:00 2023-07-12T01:58:18.886 INFO:teuthology.orchestra.run.smithi174.stdout:(23/144): python3-rgw-18.0.0-4828.gb5891ed6.el8 2.5 MB/s | 107 kB 00:00 2023-07-12T01:58:18.936 INFO:teuthology.orchestra.run.smithi174.stdout:(24/144): rbd-fuse-18.0.0-4828.gb5891ed6.el8.x8 1.8 MB/s | 94 kB 00:00 2023-07-12T01:58:19.203 INFO:teuthology.orchestra.run.smithi174.stdout:(25/144): rbd-mirror-18.0.0-4828.gb5891ed6.el8. 13 MB/s | 3.4 MB 00:00 2023-07-12T01:58:19.245 INFO:teuthology.orchestra.run.smithi174.stdout:(26/144): rbd-nbd-18.0.0-4828.gb5891ed6.el8.x86 4.2 MB/s | 180 kB 00:00 2023-07-12T01:58:19.287 INFO:teuthology.orchestra.run.smithi174.stdout:(27/144): ceph-grafana-dashboards-18.0.0-4828.g 558 kB/s | 23 kB 00:00 2023-07-12T01:58:19.329 INFO:teuthology.orchestra.run.smithi174.stdout:(28/144): ceph-mgr-cephadm-18.0.0-4828.gb5891ed 3.0 MB/s | 129 kB 00:00 2023-07-12T01:58:19.487 INFO:teuthology.orchestra.run.smithi174.stdout:(29/144): ceph-mgr-dashboard-18.0.0-4828.gb5891 11 MB/s | 1.7 MB 00:00 2023-07-12T01:58:20.046 INFO:teuthology.orchestra.run.smithi174.stdout:(30/144): ceph-mgr-diskprediction-local-18.0.0- 13 MB/s | 7.4 MB 00:00 2023-07-12T01:58:20.105 INFO:teuthology.orchestra.run.smithi174.stdout:(31/144): ceph-mgr-modules-core-18.0.0-4828.gb5 4.0 MB/s | 240 kB 00:00 2023-07-12T01:58:20.155 INFO:teuthology.orchestra.run.smithi174.stdout:(32/144): ceph-mgr-rook-18.0.0-4828.gb5891ed6.e 954 kB/s | 47 kB 00:00 2023-07-12T01:58:20.205 INFO:teuthology.orchestra.run.smithi174.stdout:(33/144): ceph-prometheus-alerts-18.0.0-4828.gb 291 kB/s | 15 kB 00:00 2023-07-12T01:58:20.256 INFO:teuthology.orchestra.run.smithi174.stdout:(34/144): ceph-volume-18.0.0-4828.gb5891ed6.el8 5.1 MB/s | 258 kB 00:00 2023-07-12T01:58:20.298 INFO:teuthology.orchestra.run.smithi174.stdout:(35/144): cephadm-18.0.0-4828.gb5891ed6.el8.noa 3.9 MB/s | 164 kB 00:00 2023-07-12T01:58:20.348 INFO:teuthology.orchestra.run.smithi174.stdout:(36/144): cephfs-top-18.0.0-4828.gb5891ed6.el8. 359 kB/s | 18 kB 00:00 2023-07-12T01:58:21.607 INFO:teuthology.orchestra.run.smithi174.stdout:(37/144): ceph-osd-18.0.0-4828.gb5891ed6.el8.x8 3.2 MB/s | 18 MB 00:05 2023-07-12T01:58:23.340 INFO:teuthology.orchestra.run.smithi174.stdout:(38/144): ceph-test-18.0.0-4828.gb5891ed6.el8.x 7.8 MB/s | 48 MB 00:06 2023-07-12T01:58:23.832 INFO:teuthology.orchestra.run.smithi174.stdout:(39/144): bison-3.0.4-10.el8.x86_64.rpm 309 kB/s | 688 kB 00:02 2023-07-12T01:58:24.516 INFO:teuthology.orchestra.run.smithi174.stdout:(40/144): jq-1.6-7.el8.x86_64.rpm 296 kB/s | 202 kB 00:00 2023-07-12T01:58:25.857 INFO:teuthology.orchestra.run.smithi174.stdout:(41/144): automake-1.16.1-7.el8.noarch.rpm 130 kB/s | 713 kB 00:05 2023-07-12T01:58:26.874 INFO:teuthology.orchestra.run.smithi174.stdout:(42/144): libpq-13.5-1.el8.x86_64.rpm 84 kB/s | 198 kB 00:02 2023-07-12T01:58:26.899 INFO:teuthology.orchestra.run.smithi174.stdout:(43/144): flex-2.6.1-9.el8.x86_64.rpm 90 kB/s | 320 kB 00:03 2023-07-12T01:58:27.666 INFO:teuthology.orchestra.run.smithi174.stdout:(44/144): lttng-ust-2.8.1-11.el8.x86_64.rpm 339 kB/s | 259 kB 00:00 2023-07-12T01:58:28.341 INFO:teuthology.orchestra.run.smithi174.stdout:(45/144): librdkafka-0.11.4-3.el8.x86_64.rpm 142 kB/s | 354 kB 00:02 2023-07-12T01:58:29.341 INFO:teuthology.orchestra.run.smithi174.stdout:(46/144): oniguruma-6.8.2-2.el8.x86_64.rpm 112 kB/s | 187 kB 00:01 2023-07-12T01:58:29.892 INFO:teuthology.orchestra.run.smithi174.stdout:(47/144): libtool-2.4.6-25.el8.x86_64.rpm 235 kB/s | 709 kB 00:03 2023-07-12T01:58:34.567 INFO:teuthology.orchestra.run.smithi174.stdout:(48/144): postgresql-10.23-1.module_el8+300+2c5 342 kB/s | 1.6 MB 00:04 2023-07-12T01:58:36.664 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4828.gb5891ed6.el8.x86_64 102/160 2023-07-12T01:58:36.664 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /sys 2023-07-12T01:58:36.664 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /proc 2023-07-12T01:58:36.664 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /dev 2023-07-12T01:58:36.665 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /run 2023-07-12T01:58:36.665 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /mnt 2023-07-12T01:58:36.665 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /var/tmp 2023-07-12T01:58:36.665 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /home 2023-07-12T01:58:36.665 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /tmp 2023-07-12T01:58:36.665 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /dev 2023-07-12T01:58:36.665 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T01:58:37.076 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-volume-2:18.0.0-4828.gb5891ed6.el8.noarch 103/160 2023-07-12T01:58:37.133 INFO:teuthology.orchestra.run.smithi174.stdout:(49/144): postgresql-contrib-10.23-1.module_el8 352 kB/s | 903 kB 00:02 2023-07-12T01:58:38.747 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-volume-2:18.0.0-4828.gb5891ed6.el8.noarch 103/160 2023-07-12T01:58:39.006 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-osd-2:18.0.0-4828.gb5891ed6.el8.x86_64 104/160 2023-07-12T01:58:39.239 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-osd-2:18.0.0-4828.gb5891ed6.el8.x86_64 104/160 2023-07-12T01:58:39.417 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mds-2:18.0.0-4828.gb5891ed6.el8.x86_64 105/160 2023-07-12T01:58:39.900 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mds-2:18.0.0-4828.gb5891ed6.el8.x86_64 105/160 2023-07-12T01:58:40.100 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mon-2:18.0.0-4828.gb5891ed6.el8.x86_64 106/160 2023-07-12T01:58:40.125 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mon-2:18.0.0-4828.gb5891ed6.el8.x86_64 106/160 2023-07-12T01:58:40.358 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 107/160 2023-07-12T01:58:40.604 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 108/160 2023-07-12T01:58:40.725 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 109/160 2023-07-12T01:58:40.805 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 109/160 2023-07-12T01:58:41.129 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : jq-1.6-7.el8.x86_64 110/160 2023-07-12T01:58:41.392 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : automake-1.16.1-7.el8.noarch 111/160 2023-07-12T01:58:41.741 INFO:teuthology.orchestra.run.smithi174.stdout:(50/144): openblas-0.3.15-4.el8.x86_64.rpm 361 kB/s | 4.7 MB 00:13 2023-07-12T01:58:41.929 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 112/160 2023-07-12T01:58:42.142 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 112/160 2023-07-12T01:58:42.266 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4828.gb5891ed6.e 113/160 2023-07-12T01:58:42.488 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4828.gb5891ed6. 114/160 2023-07-12T01:58:42.675 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4828.gb5891ed6.el8.noa 115/160 2023-07-12T01:58:42.906 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4828.gb5891ed6.el8.noa 115/160 2023-07-12T01:58:43.155 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4828.gb5891ed6.el8.n 116/160 2023-07-12T01:58:44.066 INFO:teuthology.orchestra.run.smithi174.stdout:(51/144): openblas-threads-0.3.15-4.el8.x86_64. 338 kB/s | 4.9 MB 00:14 2023-07-12T01:58:44.180 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4828.gb5891ed6.el8.n 116/160 2023-07-12T01:58:44.374 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4828.gb58 117/160 2023-07-12T01:58:44.474 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4828.gb58 117/160 2023-07-12T01:58:44.909 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4828.gb5891ed6.el 118/160 2023-07-12T01:58:45.139 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-2:18.0.0-4828.gb5891ed6.el8.x86_64 119/160 2023-07-12T01:58:45.175 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4828.gb5891ed6.el8.x86_64 119/160 2023-07-12T01:58:45.382 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-rook-2:18.0.0-4828.gb5891ed6.el8.noarch 120/160 2023-07-12T01:58:45.394 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4828.gb5891ed6.el8.noarch 120/160 2023-07-12T01:58:45.597 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-2:18.0.0-4828.gb5891ed6.el8.x86_64 121/160 2023-07-12T01:58:45.741 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libtool-2.4.6-25.el8.x86_64 122/160 2023-07-12T01:58:49.799 INFO:teuthology.orchestra.run.smithi174.stdout:(52/144): python3-jinja2-2.10.1-3.el8.noarch.rp 94 kB/s | 538 kB 00:05 2023-07-12T01:58:50.191 INFO:teuthology.orchestra.run.smithi174.stdout:(53/144): python3-jsonpatch-1.21-2.el8.noarch.r 68 kB/s | 27 kB 00:00 2023-07-12T01:58:50.535 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 122/160 2023-07-12T01:58:50.574 INFO:teuthology.orchestra.run.smithi174.stdout:(54/144): python3-jsonpointer-1.10-11.el8.noarc 52 kB/s | 20 kB 00:00 2023-07-12T01:58:51.608 INFO:teuthology.orchestra.run.smithi174.stdout:(55/144): python3-mako-1.0.6-14.el8.noarch.rpm 152 kB/s | 157 kB 00:01 2023-07-12T01:58:52.033 INFO:teuthology.orchestra.run.smithi174.stdout:(56/144): python3-markupsafe-0.23-19.el8.x86_64 91 kB/s | 39 kB 00:00 2023-07-12T01:58:52.106 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-test-2:18.0.0-4828.gb5891ed6.el8.x86_64 123/160 2023-07-12T01:58:52.354 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-radosgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 124/160 2023-07-12T01:58:52.390 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 124/160 2023-07-12T01:58:52.565 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4828.gb5891 125/160 2023-07-12T01:58:52.609 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4828.gb5891 125/160 2023-07-12T01:58:52.808 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephfs-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 126/160 2023-07-12T01:58:53.175 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 126/160 2023-07-12T01:58:53.349 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 127/160 2023-07-12T01:58:53.525 INFO:teuthology.orchestra.run.smithi174.stdout:(57/144): postgresql-server-10.23-1.module_el8+ 319 kB/s | 5.1 MB 00:16 2023-07-12T01:58:53.569 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 127/160 2023-07-12T01:58:53.935 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : postgresql-contrib-10.23-1.module_el8+300+2c5300 128/160 2023-07-12T01:58:54.242 INFO:teuthology.orchestra.run.smithi174.stdout:(58/144): python3-numpy-f2py-1.14.3-10.el8.x86_ 314 kB/s | 225 kB 00:00 2023-07-12T01:58:54.725 INFO:teuthology.orchestra.run.smithi174.stdout:(59/144): python3-prettytable-0.7.2-14.el8.noar 91 kB/s | 44 kB 00:00 2023-07-12T01:58:54.896 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 129/160 2023-07-12T01:58:55.109 INFO:teuthology.orchestra.run.smithi174.stdout:(60/144): python3-pyOpenSSL-19.0.0-1.el8.noarch 270 kB/s | 103 kB 00:00 2023-07-12T01:58:55.178 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 130/160 2023-07-12T01:58:55.404 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 131/160 2023-07-12T01:58:55.576 INFO:teuthology.orchestra.run.smithi174.stdout:(61/144): python3-pyasn1-0.3.7-6.el8.noarch.rpm 271 kB/s | 126 kB 00:00 2023-07-12T01:58:55.586 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 132/160 2023-07-12T01:58:55.770 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/160 2023-07-12T01:58:55.941 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephfs-devel-2:18.0.0-4828.gb5891ed6.el8.x86_ 134/160 2023-07-12T01:58:56.034 INFO:teuthology.orchestra.run.smithi174.stdout:(62/144): python3-babel-2.5.1-7.el8.noarch.rpm 343 kB/s | 4.8 MB 00:14 2023-07-12T01:58:56.243 INFO:teuthology.orchestra.run.smithi174.stdout:(63/144): python3-pyasn1-modules-0.3.7-6.el8.no 165 kB/s | 110 kB 00:00 2023-07-12T01:58:56.526 INFO:teuthology.orchestra.run.smithi174.stdout:(64/144): python3-pytz-2017.2-9.el8.noarch.rpm 110 kB/s | 54 kB 00:00 2023-07-12T01:58:57.033 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-12T01:58:57.257 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-12T01:58:57.305 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-12T01:58:57.544 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 136/160 2023-07-12T01:58:57.741 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephfs-top-2:18.0.0-4828.gb5891ed6.el8.noarch 137/160 2023-07-12T01:58:57.885 INFO:teuthology.orchestra.run.smithi174.stdout:(65/144): python3-werkzeug-0.12.2-4.el8.noarch. 337 kB/s | 457 kB 00:01 2023-07-12T01:58:57.991 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 138/160 2023-07-12T01:58:58.376 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-nbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 139/160 2023-07-12T01:58:58.700 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 140/160 2023-07-12T01:58:58.863 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-07-12T01:58:58.889 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-07-12T01:58:58.918 INFO:teuthology.orchestra.run.smithi174.stdout:(66/144): socat-1.7.4.1-1.el8.x86_64.rpm 313 kB/s | 323 kB 00:01 2023-07-12T01:58:59.047 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 142/160 2023-07-12T01:58:59.331 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/160 2023-07-12T01:58:59.414 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/160 2023-07-12T01:58:59.435 INFO:teuthology.orchestra.run.smithi174.stdout:(67/144): uuid-1.6.2-43.el8.x86_64.rpm 124 kB/s | 64 kB 00:00 2023-07-12T01:58:59.656 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/160 2023-07-12T01:58:59.670 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/160 2023-07-12T01:58:59.850 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 145/160 2023-07-12T01:59:00.072 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 146/160 2023-07-12T01:59:00.252 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 147/160 2023-07-12T01:59:00.252 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-07-12T01:59:00.552 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-07-12T01:59:00.552 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-07-12T01:59:00.834 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-07-12T01:59:00.839 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-07-12T01:59:00.935 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-07-12T01:59:00.935 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 151/160 2023-07-12T01:59:01.213 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 151/160 2023-07-12T01:59:01.441 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 152/160 2023-07-12T01:59:01.577 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 153/160 2023-07-12T01:59:01.833 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 154/160 2023-07-12T01:59:01.833 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 155/160 2023-07-12T01:59:02.042 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 155/160 2023-07-12T01:59:02.042 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 156/160 2023-07-12T01:59:02.102 INFO:teuthology.orchestra.run.smithi174.stdout:(68/144): xmlstarlet-1.6.1-20.el8.x86_64.rpm 26 kB/s | 71 kB 00:02 2023-07-12T01:59:02.267 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 156/160 2023-07-12T01:59:02.267 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 157/160 2023-07-12T01:59:02.484 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 157/160 2023-07-12T01:59:02.484 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 158/160 2023-07-12T01:59:02.667 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 158/160 2023-07-12T01:59:02.667 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-07-12T01:59:02.677 INFO:teuthology.orchestra.run.smithi174.stdout:(69/144): elfutils-libelf-devel-0.189-2.el8.x86 107 kB/s | 61 kB 00:00 2023-07-12T01:59:02.892 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-07-12T01:59:03.074 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-07-12T01:59:03.260 INFO:teuthology.orchestra.run.smithi174.stdout:(70/144): python3-numpy-1.14.3-10.el8.x86_64.rp 340 kB/s | 3.7 MB 00:11 2023-07-12T01:59:03.286 INFO:teuthology.orchestra.run.smithi174.stdout:(71/144): fuse-2.9.7-17.el8.x86_64.rpm 136 kB/s | 83 kB 00:00 2023-07-12T01:59:03.453 INFO:teuthology.orchestra.run.smithi174.stdout:(72/144): keyutils-libs-devel-1.5.10-9.el8.x86_ 251 kB/s | 48 kB 00:00 2023-07-12T01:59:03.528 INFO:teuthology.orchestra.run.smithi174.stdout:(73/144): libaio-devel-0.3.112-1.el8.x86_64.rpm 250 kB/s | 19 kB 00:00 2023-07-12T01:59:03.595 INFO:teuthology.orchestra.run.smithi174.stdout:(74/144): libcom_err-devel-1.45.6-5.el8.x86_64. 582 kB/s | 39 kB 00:00 2023-07-12T01:59:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-07-12T01:59:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-2:18.0.0-4828.gb5891ed6.el8.x86_64 1/160 2023-07-12T01:59:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-base-2:18.0.0-4828.gb5891ed6.el8.x86_64 2/160 2023-07-12T01:59:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 3/160 2023-07-12T01:59:03.732 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 4/160 2023-07-12T01:59:03.732 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4828.gb5891 5/160 2023-07-12T01:59:03.732 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mds-2:18.0.0-4828.gb5891ed6.el8.x86_64 6/160 2023-07-12T01:59:03.732 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-2:18.0.0-4828.gb5891ed6.el8.x86_64 7/160 2023-07-12T01:59:03.732 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mon-2:18.0.0-4828.gb5891ed6.el8.x86_64 8/160 2023-07-12T01:59:03.732 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-osd-2:18.0.0-4828.gb5891ed6.el8.x86_64 9/160 2023-07-12T01:59:03.732 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-radosgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 10/160 2023-07-12T01:59:03.733 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-selinux-2:18.0.0-4828.gb5891ed6.el8.x86_64 11/160 2023-07-12T01:59:03.733 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-test-2:18.0.0-4828.gb5891ed6.el8.x86_64 12/160 2023-07-12T01:59:03.733 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephfs-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 13/160 2023-07-12T01:59:03.733 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephfs-devel-2:18.0.0-4828.gb5891ed6.el8.x86_ 14/160 2023-07-12T01:59:03.733 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephfs2-2:18.0.0-4828.gb5891ed6.el8.x86_64 15/160 2023-07-12T01:59:03.733 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephsqlite-2:18.0.0-4828.gb5891ed6.el8.x86_64 16/160 2023-07-12T01:59:03.733 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados-devel-2:18.0.0-4828.gb5891ed6.el8.x86_6 17/160 2023-07-12T01:59:03.734 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libradosstriper1-2:18.0.0-4828.gb5891ed6.el8.x86 18/160 2023-07-12T01:59:03.734 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librgw2-2:18.0.0-4828.gb5891ed6.el8.x86_64 19/160 2023-07-12T01:59:03.734 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4828.gb5891ed6.el 20/160 2023-07-12T01:59:03.734 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ceph-common-2:18.0.0-4828.gb5891ed6.el8. 21/160 2023-07-12T01:59:03.734 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cephfs-2:18.0.0-4828.gb5891ed6.el8.x86_6 22/160 2023-07-12T01:59:03.734 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rados-2:18.0.0-4828.gb5891ed6.el8.x86_64 23/160 2023-07-12T01:59:03.734 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 24/160 2023-07-12T01:59:03.735 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 25/160 2023-07-12T01:59:03.735 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 26/160 2023-07-12T01:59:03.735 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 27/160 2023-07-12T01:59:03.735 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-nbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 28/160 2023-07-12T01:59:03.735 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4828.gb5891ed6. 29/160 2023-07-12T01:59:03.744 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4828.gb5891ed6.el8.noa 30/160 2023-07-12T01:59:03.744 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4828.gb5891ed6.el8.n 31/160 2023-07-12T01:59:03.744 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4828.gb58 32/160 2023-07-12T01:59:03.745 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4828.gb5891ed6.el 33/160 2023-07-12T01:59:03.745 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4828.gb5891ed6.el8.noarch 34/160 2023-07-12T01:59:03.745 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4828.gb5891ed6.e 35/160 2023-07-12T01:59:03.745 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-volume-2:18.0.0-4828.gb5891ed6.el8.noarch 36/160 2023-07-12T01:59:03.745 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 37/160 2023-07-12T01:59:03.745 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephfs-top-2:18.0.0-4828.gb5891ed6.el8.noarch 38/160 2023-07-12T01:59:03.745 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/160 2023-07-12T01:59:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/160 2023-07-12T01:59:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/160 2023-07-12T01:59:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : jq-1.6-7.el8.x86_64 42/160 2023-07-12T01:59:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/160 2023-07-12T01:59:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/160 2023-07-12T01:59:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/160 2023-07-12T01:59:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/160 2023-07-12T01:59:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/160 2023-07-12T01:59:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/160 2023-07-12T01:59:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/160 2023-07-12T01:59:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 50/160 2023-07-12T01:59:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : postgresql-contrib-10.23-1.module_el8+300+2c5300 51/160 2023-07-12T01:59:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : postgresql-server-10.23-1.module_el8+300+2c53004 52/160 2023-07-12T01:59:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/160 2023-07-12T01:59:03.748 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/160 2023-07-12T01:59:03.748 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/160 2023-07-12T01:59:03.748 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/160 2023-07-12T01:59:03.748 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/160 2023-07-12T01:59:03.748 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/160 2023-07-12T01:59:03.748 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/160 2023-07-12T01:59:03.748 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/160 2023-07-12T01:59:03.749 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/160 2023-07-12T01:59:03.749 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/160 2023-07-12T01:59:03.749 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/160 2023-07-12T01:59:03.749 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/160 2023-07-12T01:59:03.749 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/160 2023-07-12T01:59:03.749 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/160 2023-07-12T01:59:03.749 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/160 2023-07-12T01:59:03.750 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/160 2023-07-12T01:59:03.750 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/160 2023-07-12T01:59:03.750 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/160 2023-07-12T01:59:03.750 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 71/160 2023-07-12T01:59:03.750 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 72/160 2023-07-12T01:59:03.750 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/160 2023-07-12T01:59:03.750 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/160 2023-07-12T01:59:03.751 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/160 2023-07-12T01:59:03.751 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/160 2023-07-12T01:59:03.751 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 77/160 2023-07-12T01:59:03.751 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 78/160 2023-07-12T01:59:03.751 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 79/160 2023-07-12T01:59:03.751 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/160 2023-07-12T01:59:03.751 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/160 2023-07-12T01:59:03.752 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 82/160 2023-07-12T01:59:03.752 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/160 2023-07-12T01:59:03.752 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/160 2023-07-12T01:59:03.752 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 85/160 2023-07-12T01:59:03.752 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/160 2023-07-12T01:59:03.752 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/160 2023-07-12T01:59:03.752 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/160 2023-07-12T01:59:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 89/160 2023-07-12T01:59:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 90/160 2023-07-12T01:59:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/160 2023-07-12T01:59:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/160 2023-07-12T01:59:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/160 2023-07-12T01:59:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/160 2023-07-12T01:59:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 95/160 2023-07-12T01:59:03.754 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/160 2023-07-12T01:59:03.754 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 97/160 2023-07-12T01:59:03.754 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/160 2023-07-12T01:59:03.754 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/160 2023-07-12T01:59:03.754 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 100/160 2023-07-12T01:59:03.754 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/160 2023-07-12T01:59:03.754 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/160 2023-07-12T01:59:03.754 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/160 2023-07-12T01:59:03.755 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/160 2023-07-12T01:59:03.755 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/160 2023-07-12T01:59:03.755 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/160 2023-07-12T01:59:03.755 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/160 2023-07-12T01:59:03.755 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/160 2023-07-12T01:59:03.755 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/160 2023-07-12T01:59:03.755 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/160 2023-07-12T01:59:03.756 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/160 2023-07-12T01:59:03.756 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/160 2023-07-12T01:59:03.756 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 113/160 2023-07-12T01:59:03.756 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 114/160 2023-07-12T01:59:03.756 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-portend-2.6-1.el8.noarch 115/160 2023-07-12T01:59:03.756 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/160 2023-07-12T01:59:03.756 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/160 2023-07-12T01:59:03.757 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 118/160 2023-07-12T01:59:03.757 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/160 2023-07-12T01:59:03.757 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/160 2023-07-12T01:59:03.757 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/160 2023-07-12T01:59:03.757 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/160 2023-07-12T01:59:03.757 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 123/160 2023-07-12T01:59:03.757 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/160 2023-07-12T01:59:03.758 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/160 2023-07-12T01:59:03.758 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/160 2023-07-12T01:59:03.758 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/160 2023-07-12T01:59:03.758 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 128/160 2023-07-12T01:59:03.758 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados2-2:18.0.0-4828.gb5891ed6.el8.x86_64 129/160 2023-07-12T01:59:03.758 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/160 2023-07-12T01:59:03.758 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librbd1-2:18.0.0-4828.gb5891ed6.el8.x86_64 131/160 2023-07-12T01:59:03.759 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/160 2023-07-12T01:59:03.759 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-8.el 133/160 2023-07-12T01:59:03.759 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 134/160 2023-07-12T01:59:03.759 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 135/160 2023-07-12T01:59:03.759 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 136/160 2023-07-12T01:59:03.759 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 137/160 2023-07-12T01:59:03.759 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 138/160 2023-07-12T01:59:03.760 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 139/160 2023-07-12T01:59:03.760 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 140/160 2023-07-12T01:59:03.760 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 141/160 2023-07-12T01:59:03.760 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 142/160 2023-07-12T01:59:03.760 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 143/160 2023-07-12T01:59:03.760 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 144/160 2023-07-12T01:59:03.760 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 145/160 2023-07-12T01:59:03.761 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 146/160 2023-07-12T01:59:03.761 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 147/160 2023-07-12T01:59:03.761 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 148/160 2023-07-12T01:59:03.761 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 149/160 2023-07-12T01:59:03.761 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 150/160 2023-07-12T01:59:03.761 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 151/160 2023-07-12T01:59:03.761 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 152/160 2023-07-12T01:59:03.761 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 153/160 2023-07-12T01:59:03.762 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 154/160 2023-07-12T01:59:03.762 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 155/160 2023-07-12T01:59:03.762 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 156/160 2023-07-12T01:59:03.762 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 157/160 2023-07-12T01:59:03.762 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 158/160 2023-07-12T01:59:03.762 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 159/160 2023-07-12T01:59:03.870 INFO:teuthology.orchestra.run.smithi174.stdout:(75/144): libgfortran-8.5.0-20.el8.x86_64.rpm 2.3 MB/s | 645 kB 00:00 2023-07-12T01:59:03.895 INFO:teuthology.orchestra.run.smithi174.stdout:(76/144): krb5-devel-1.18.2-22.el8.x86_64.rpm 920 kB/s | 561 kB 00:00 2023-07-12T01:59:03.979 INFO:teuthology.orchestra.run.smithi174.stdout:(77/144): librabbitmq-0.9.0-4.el8.x86_64.rpm 563 kB/s | 47 kB 00:00 2023-07-12T01:59:03.996 INFO:teuthology.orchestra.run.smithi174.stdout:(78/144): libquadmath-8.5.0-20.el8.x86_64.rpm 1.3 MB/s | 172 kB 00:00 2023-07-12T01:59:04.055 INFO:teuthology.orchestra.run.smithi174.stdout:(79/144): libsepol-devel-2.9-3.el8.x86_64.rpm 1.5 MB/s | 87 kB 00:00 2023-07-12T01:59:04.138 INFO:teuthology.orchestra.run.smithi174.stdout:(80/144): libuuid-devel-2.32.1-42.el8.x86_64.rp 1.2 MB/s | 99 kB 00:00 2023-07-12T01:59:04.222 INFO:teuthology.orchestra.run.smithi174.stdout:(81/144): libverto-devel-0.3.2-2.el8.x86_64.rpm 217 kB/s | 18 kB 00:00 2023-07-12T01:59:04.247 INFO:teuthology.orchestra.run.smithi174.stdout:(82/144): libselinux-devel-2.9-8.el8.x86_64.rpm 748 kB/s | 200 kB 00:00 2023-07-12T01:59:04.339 INFO:teuthology.orchestra.run.smithi174.stdout:(83/144): libzstd-devel-1.4.4-1.el8.x86_64.rpm 376 kB/s | 44 kB 00:00 2023-07-12T01:59:04.581 INFO:teuthology.orchestra.run.smithi174.stdout:(84/144): pcre2-devel-10.32-3.el8.x86_64.rpm 2.4 MB/s | 605 kB 00:00 2023-07-12T01:59:04.689 INFO:teuthology.orchestra.run.smithi174.stdout:(85/144): pcre2-utf16-10.32-3.el8.x86_64.rpm 2.1 MB/s | 229 kB 00:00 2023-07-12T01:59:04.781 INFO:teuthology.orchestra.run.smithi174.stdout:(86/144): pcre2-utf32-10.32-3.el8.x86_64.rpm 2.4 MB/s | 220 kB 00:00 2023-07-12T01:59:04.907 INFO:teuthology.orchestra.run.smithi174.stdout:(87/144): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.9 MB/s | 249 kB 00:00 2023-07-12T01:59:05.165 INFO:teuthology.orchestra.run.smithi174.stdout:(88/144): python3-cryptography-3.2.1-6.el8.x86_ 2.4 MB/s | 641 kB 00:00 2023-07-12T01:59:05.257 INFO:teuthology.orchestra.run.smithi174.stdout:(89/144): python3-jwt-1.6.1-2.el8.noarch.rpm 466 kB/s | 43 kB 00:00 2023-07-12T01:59:05.332 INFO:teuthology.orchestra.run.smithi174.stdout:(90/144): python3-oauthlib-2.1.0-1.el8.noarch.r 2.0 MB/s | 155 kB 00:00 2023-07-12T01:59:05.416 INFO:teuthology.orchestra.run.smithi174.stdout:(91/144): python3-pycparser-2.14-14.el8.noarch. 1.3 MB/s | 109 kB 00:00 2023-07-12T01:59:05.483 INFO:teuthology.orchestra.run.smithi174.stdout:(92/144): python3-requests-oauthlib-1.0.0-1.el8 642 kB/s | 43 kB 00:00 2023-07-12T01:59:05.542 INFO:teuthology.orchestra.run.smithi174.stdout:(93/144): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 1.2 MB/s | 74 kB 00:00 2023-07-12T01:59:05.609 INFO:teuthology.orchestra.run.smithi174.stdout:(94/144): zlib-devel-1.2.11-21.el8.x86_64.rpm 874 kB/s | 58 kB 00:00 2023-07-12T01:59:06.112 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 160/160 2023-07-12T01:59:06.113 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T01:59:06.113 INFO:teuthology.orchestra.run.smithi060.stdout:Upgraded: 2023-07-12T01:59:06.113 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-initscripts-updown-1:1.40.16-8.el8.noarch 2023-07-12T01:59:06.113 INFO:teuthology.orchestra.run.smithi060.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-07-12T01:59:06.113 INFO:teuthology.orchestra.run.smithi060.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-07-12T01:59:06.113 INFO:teuthology.orchestra.run.smithi060.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-07-12T01:59:06.113 INFO:teuthology.orchestra.run.smithi060.stdout: iproute-6.2.0-2.el8.x86_64 2023-07-12T01:59:06.114 INFO:teuthology.orchestra.run.smithi060.stdout: libblkid-2.32.1-42.el8.x86_64 2023-07-12T01:59:06.114 INFO:teuthology.orchestra.run.smithi060.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-07-12T01:59:06.114 INFO:teuthology.orchestra.run.smithi060.stdout: libmount-2.32.1-42.el8.x86_64 2023-07-12T01:59:06.114 INFO:teuthology.orchestra.run.smithi060.stdout: librados2-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:06.114 INFO:teuthology.orchestra.run.smithi060.stdout: librbd1-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:06.114 INFO:teuthology.orchestra.run.smithi060.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-07-12T01:59:06.114 INFO:teuthology.orchestra.run.smithi060.stdout: libuuid-2.32.1-42.el8.x86_64 2023-07-12T01:59:06.115 INFO:teuthology.orchestra.run.smithi060.stdout: util-linux-2.32.1-42.el8.x86_64 2023-07-12T01:59:06.115 INFO:teuthology.orchestra.run.smithi060.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-07-12T01:59:06.115 INFO:teuthology.orchestra.run.smithi060.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-07-12T01:59:06.115 INFO:teuthology.orchestra.run.smithi060.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-07-12T01:59:06.115 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2023-07-12T01:59:06.115 INFO:teuthology.orchestra.run.smithi060.stdout: automake-1.16.1-7.el8.noarch 2023-07-12T01:59:06.115 INFO:teuthology.orchestra.run.smithi060.stdout: bison-3.0.4-10.el8.x86_64 2023-07-12T01:59:06.116 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:06.116 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-base-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:06.116 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:06.116 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:06.116 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-grafana-dashboards-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T01:59:06.116 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-immutable-object-cache-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:06.116 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mds-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:06.117 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:06.117 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T01:59:06.117 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-dashboard-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T01:59:06.117 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T01:59:06.117 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-modules-core-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T01:59:06.117 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-rook-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T01:59:06.117 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mon-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:06.118 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-osd-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:06.118 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-prometheus-alerts-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T01:59:06.118 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-radosgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:06.118 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-selinux-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:06.118 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-test-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:06.118 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-volume-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T01:59:06.118 INFO:teuthology.orchestra.run.smithi060.stdout: cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T01:59:06.119 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:06.119 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-top-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T01:59:06.119 INFO:teuthology.orchestra.run.smithi060.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-07-12T01:59:06.119 INFO:teuthology.orchestra.run.smithi060.stdout: flex-2.6.1-9.el8.x86_64 2023-07-12T01:59:06.119 INFO:teuthology.orchestra.run.smithi060.stdout: fuse-2.9.7-17.el8.x86_64 2023-07-12T01:59:06.119 INFO:teuthology.orchestra.run.smithi060.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-12T01:59:06.119 INFO:teuthology.orchestra.run.smithi060.stdout: jq-1.6-7.el8.x86_64 2023-07-12T01:59:06.120 INFO:teuthology.orchestra.run.smithi060.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-12T01:59:06.120 INFO:teuthology.orchestra.run.smithi060.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-07-12T01:59:06.120 INFO:teuthology.orchestra.run.smithi060.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-12T01:59:06.120 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs-devel-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:06.120 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs2-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:06.120 INFO:teuthology.orchestra.run.smithi060.stdout: libcephsqlite-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:06.120 INFO:teuthology.orchestra.run.smithi060.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-07-12T01:59:06.121 INFO:teuthology.orchestra.run.smithi060.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-07-12T01:59:06.121 INFO:teuthology.orchestra.run.smithi060.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-12T01:59:06.121 INFO:teuthology.orchestra.run.smithi060.stdout: libpq-13.5-1.el8.x86_64 2023-07-12T01:59:06.121 INFO:teuthology.orchestra.run.smithi060.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-07-12T01:59:06.121 INFO:teuthology.orchestra.run.smithi060.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-07-12T01:59:06.121 INFO:teuthology.orchestra.run.smithi060.stdout: librados-devel-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:06.121 INFO:teuthology.orchestra.run.smithi060.stdout: libradosstriper1-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:06.122 INFO:teuthology.orchestra.run.smithi060.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-12T01:59:06.122 INFO:teuthology.orchestra.run.smithi060.stdout: librgw2-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:06.122 INFO:teuthology.orchestra.run.smithi060.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-07-12T01:59:06.122 INFO:teuthology.orchestra.run.smithi060.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-12T01:59:06.122 INFO:teuthology.orchestra.run.smithi060.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-12T01:59:06.122 INFO:teuthology.orchestra.run.smithi060.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-12T01:59:06.122 INFO:teuthology.orchestra.run.smithi060.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-07-12T01:59:06.123 INFO:teuthology.orchestra.run.smithi060.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-07-12T01:59:06.123 INFO:teuthology.orchestra.run.smithi060.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-07-12T01:59:06.123 INFO:teuthology.orchestra.run.smithi060.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-12T01:59:06.123 INFO:teuthology.orchestra.run.smithi060.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-12T01:59:06.123 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-0.3.15-4.el8.x86_64 2023-07-12T01:59:06.123 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-07-12T01:59:06.123 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-07-12T01:59:06.124 INFO:teuthology.orchestra.run.smithi060.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-07-12T01:59:06.124 INFO:teuthology.orchestra.run.smithi060.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-07-12T01:59:06.124 INFO:teuthology.orchestra.run.smithi060.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-07-12T01:59:06.124 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-12T01:59:06.124 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-contrib-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-12T01:59:06.124 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-server-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-12T01:59:06.125 INFO:teuthology.orchestra.run.smithi060.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-12T01:59:06.125 INFO:teuthology.orchestra.run.smithi060.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-12T01:59:06.125 INFO:teuthology.orchestra.run.smithi060.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-12T01:59:06.125 INFO:teuthology.orchestra.run.smithi060.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-12T01:59:06.125 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-12T01:59:06.125 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-argparse-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:06.125 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:06.126 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cephfs-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:06.126 INFO:teuthology.orchestra.run.smithi060.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-12T01:59:06.126 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-07-12T01:59:06.126 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-12T01:59:06.126 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-12T01:59:06.126 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-07-12T01:59:06.126 INFO:teuthology.orchestra.run.smithi060.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-12T01:59:06.126 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-12T01:59:06.127 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-12T01:59:06.127 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-12T01:59:06.127 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-12T01:59:06.127 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-12T01:59:06.127 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-12T01:59:06.127 INFO:teuthology.orchestra.run.smithi060.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-12T01:59:06.128 INFO:teuthology.orchestra.run.smithi060.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-12T01:59:06.128 INFO:teuthology.orchestra.run.smithi060.stdout: python3-mako-1.0.6-14.el8.noarch 2023-07-12T01:59:06.128 INFO:teuthology.orchestra.run.smithi060.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-12T01:59:06.128 INFO:teuthology.orchestra.run.smithi060.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-12T01:59:06.128 INFO:teuthology.orchestra.run.smithi060.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-12T01:59:06.128 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-12T01:59:06.128 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-12T01:59:06.129 INFO:teuthology.orchestra.run.smithi060.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-12T01:59:06.129 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-12T01:59:06.129 INFO:teuthology.orchestra.run.smithi060.stdout: python3-portend-2.6-1.el8.noarch 2023-07-12T01:59:06.129 INFO:teuthology.orchestra.run.smithi060.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-12T01:59:06.129 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-12T01:59:06.129 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-12T01:59:06.129 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-12T01:59:06.129 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-12T01:59:06.130 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-12T01:59:06.130 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rados-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:06.130 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:06.130 INFO:teuthology.orchestra.run.smithi060.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-12T01:59:06.130 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-12T01:59:06.130 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:06.130 INFO:teuthology.orchestra.run.smithi060.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-12T01:59:06.131 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-12T01:59:06.131 INFO:teuthology.orchestra.run.smithi060.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-07-12T01:59:06.131 INFO:teuthology.orchestra.run.smithi060.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-12T01:59:06.131 INFO:teuthology.orchestra.run.smithi060.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-12T01:59:06.131 INFO:teuthology.orchestra.run.smithi060.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-12T01:59:06.131 INFO:teuthology.orchestra.run.smithi060.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-12T01:59:06.131 INFO:teuthology.orchestra.run.smithi060.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-12T01:59:06.132 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-12T01:59:06.132 INFO:teuthology.orchestra.run.smithi060.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-12T01:59:06.132 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-12T01:59:06.132 INFO:teuthology.orchestra.run.smithi060.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-12T01:59:06.132 INFO:teuthology.orchestra.run.smithi060.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-12T01:59:06.132 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:06.132 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:06.133 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-nbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T01:59:06.133 INFO:teuthology.orchestra.run.smithi060.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-12T01:59:06.133 INFO:teuthology.orchestra.run.smithi060.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-12T01:59:06.133 INFO:teuthology.orchestra.run.smithi060.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-12T01:59:06.133 INFO:teuthology.orchestra.run.smithi060.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-07-12T01:59:06.133 INFO:teuthology.orchestra.run.smithi060.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-12T01:59:06.134 INFO:teuthology.orchestra.run.smithi060.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-07-12T01:59:06.134 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T01:59:06.134 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2023-07-12T01:59:06.159 INFO:teuthology.orchestra.run.smithi174.stdout:(95/144): gperftools-libs-2.7-9.el8.x86_64.rpm 557 kB/s | 306 kB 00:00 2023-07-12T01:59:06.284 INFO:teuthology.orchestra.run.smithi174.stdout:(96/144): liboath-2.6.2-3.el8.x86_64.rpm 471 kB/s | 59 kB 00:00 2023-07-12T01:59:06.311 DEBUG:teuthology.parallel:result is None 2023-07-12T01:59:06.409 INFO:teuthology.orchestra.run.smithi174.stdout:(97/144): libunwind-1.3.1-3.el8.x86_64.rpm 601 kB/s | 75 kB 00:00 2023-07-12T01:59:06.718 INFO:teuthology.orchestra.run.smithi174.stdout:(98/144): python3-asyncssh-2.7.0-2.el8.noarch.r 1.5 MB/s | 476 kB 00:00 2023-07-12T01:59:06.835 INFO:teuthology.orchestra.run.smithi174.stdout:(99/144): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 374 kB/s | 44 kB 00:00 2023-07-12T01:59:06.935 INFO:teuthology.orchestra.run.smithi174.stdout:(100/144): python3-beautifulsoup4-4.6.3-2.el8.1 1.8 MB/s | 185 kB 00:00 2023-07-12T01:59:06.994 INFO:teuthology.orchestra.run.smithi174.stdout:(101/144): openssl-devel-1.1.1k-9.el8.x86_64.rp 1.2 MB/s | 3.2 MB 00:02 2023-07-12T01:59:07.036 INFO:teuthology.orchestra.run.smithi174.stdout:(102/144): python3-cachetools-3.1.1-4.el8.noarc 330 kB/s | 33 kB 00:00 2023-07-12T01:59:07.158 INFO:teuthology.orchestra.run.smithi174.stdout:(103/144): python3-cheroot-8.5.2-1.el8.noarch.r 1.4 MB/s | 173 kB 00:00 2023-07-12T01:59:07.253 INFO:teuthology.orchestra.run.smithi174.stdout:(104/144): python3-certifi-2018.10.15-7.el8.noa 63 kB/s | 16 kB 00:00 2023-07-12T01:59:07.353 INFO:teuthology.orchestra.run.smithi174.stdout:(105/144): python3-cherrypy-18.4.0-1.el8.noarch 1.9 MB/s | 384 kB 00:00 2023-07-12T01:59:07.412 INFO:teuthology.orchestra.run.smithi174.stdout:(106/144): python3-google-auth-1.1.1-10.el8.noa 515 kB/s | 81 kB 00:00 2023-07-12T01:59:07.454 INFO:teuthology.orchestra.run.smithi174.stdout:(107/144): python3-jaraco-6.2-6.el8.noarch.rpm 111 kB/s | 11 kB 00:00 2023-07-12T01:59:07.504 INFO:teuthology.orchestra.run.smithi174.stdout:(108/144): python3-jaraco-functools-2.0-4.el8.n 191 kB/s | 18 kB 00:00 2023-07-12T01:59:07.596 INFO:teuthology.orchestra.run.smithi174.stdout:(109/144): python3-logutils-0.3.5-11.el8.noarch 532 kB/s | 49 kB 00:00 2023-07-12T01:59:07.688 INFO:teuthology.orchestra.run.smithi174.stdout:(110/144): python3-more-itertools-7.2.0-3.el8.n 640 kB/s | 59 kB 00:00 2023-07-12T01:59:07.780 INFO:teuthology.orchestra.run.smithi174.stdout:(111/144): python3-natsort-7.1.1-2.el8.noarch.r 660 kB/s | 60 kB 00:00 2023-07-12T01:59:07.897 INFO:teuthology.orchestra.run.smithi174.stdout:(112/144): python3-kubernetes-11.0.0-6.el8.noar 2.6 MB/s | 1.2 MB 00:00 2023-07-12T01:59:07.964 INFO:teuthology.orchestra.run.smithi174.stdout:(113/144): python3-pecan-1.3.2-9.el8.noarch.rpm 1.5 MB/s | 283 kB 00:00 2023-07-12T01:59:07.997 INFO:teuthology.orchestra.run.smithi174.stdout:(114/144): python3-portend-2.6-1.el8.noarch.rpm 155 kB/s | 16 kB 00:00 2023-07-12T01:59:08.081 INFO:teuthology.orchestra.run.smithi174.stdout:(115/144): python3-repoze-lru-0.7-6.el8.noarch. 287 kB/s | 34 kB 00:00 2023-07-12T01:59:08.115 INFO:teuthology.orchestra.run.smithi174.stdout:(116/144): python3-routes-2.4.1-12.el8.noarch.r 1.6 MB/s | 196 kB 00:00 2023-07-12T01:59:08.182 INFO:teuthology.orchestra.run.smithi174.stdout:(117/144): python3-rsa-4.8-1.el8.noarch.rpm 613 kB/s | 61 kB 00:00 2023-07-12T01:59:08.224 INFO:teuthology.orchestra.run.smithi174.stdout:(118/144): python3-simplegeneric-0.8.1-17.el8.n 172 kB/s | 19 kB 00:00 2023-07-12T01:59:08.316 INFO:teuthology.orchestra.run.smithi174.stdout:(119/144): python3-singledispatch-3.4.0.3-18.el 179 kB/s | 24 kB 00:00 2023-07-12T01:59:08.366 INFO:teuthology.orchestra.run.smithi174.stdout:(120/144): python3-tempora-1.14.1-5.el8.noarch. 206 kB/s | 29 kB 00:00 2023-07-12T01:59:08.424 INFO:teuthology.orchestra.run.smithi174.stdout:(121/144): python3-trustme-0.6.0-4.el8.noarch.r 253 kB/s | 27 kB 00:00 2023-07-12T01:59:08.466 INFO:teuthology.orchestra.run.smithi174.stdout:(122/144): python3-waitress-1.4.3-1.el8.noarch. 2.5 MB/s | 255 kB 00:00 2023-07-12T01:59:08.533 INFO:teuthology.orchestra.run.smithi174.stdout:(123/144): python3-webob-1.8.5-1.el8.1.noarch.r 2.3 MB/s | 251 kB 00:00 2023-07-12T01:59:08.567 INFO:teuthology.orchestra.run.smithi174.stdout:(124/144): python3-websocket-client-0.56.0-5.el 611 kB/s | 61 kB 00:00 2023-07-12T01:59:08.626 INFO:teuthology.orchestra.run.smithi174.stdout:(125/144): python3-webtest-2.0.33-1.el8.noarch. 927 kB/s | 85 kB 00:00 2023-07-12T01:59:08.668 INFO:teuthology.orchestra.run.smithi174.stdout:(126/144): python3-zc-lockfile-2.0-2.el8.noarch 229 kB/s | 23 kB 00:00 2023-07-12T01:59:09.060 INFO:teuthology.orchestra.run.smithi174.stdout:(127/144): librados2-18.0.0-4828.gb5891ed6.el8. 9.4 MB/s | 3.7 MB 00:00 2023-07-12T01:59:09.110 INFO:teuthology.orchestra.run.smithi174.stdout:(128/144): thrift-0.13.0-2.el8.x86_64.rpm 3.6 MB/s | 1.7 MB 00:00 2023-07-12T01:59:09.277 INFO:teuthology.orchestra.run.smithi174.stdout:(129/144): NetworkManager-initscripts-updown-1. 862 kB/s | 143 kB 00:00 2023-07-12T01:59:09.369 INFO:teuthology.orchestra.run.smithi174.stdout:(130/144): elfutils-debuginfod-client-0.189-2.e 831 kB/s | 76 kB 00:00 2023-07-12T01:59:09.427 INFO:teuthology.orchestra.run.smithi174.stdout:(131/144): librbd1-18.0.0-4828.gb5891ed6.el8.x8 9.7 MB/s | 3.6 MB 00:00 2023-07-12T01:59:09.553 INFO:teuthology.orchestra.run.smithi174.stdout:(132/144): elfutils-libelf-0.189-2.el8.x86_64.r 1.2 MB/s | 232 kB 00:00 2023-07-12T01:59:09.678 INFO:teuthology.orchestra.run.smithi174.stdout:(133/144): elfutils-libs-0.189-2.el8.x86_64.rpm 1.2 MB/s | 302 kB 00:00 2023-07-12T01:59:09.770 INFO:teuthology.orchestra.run.smithi174.stdout:(134/144): libblkid-2.32.1-42.el8.x86_64.rpm 2.3 MB/s | 220 kB 00:00 2023-07-12T01:59:09.895 INFO:teuthology.orchestra.run.smithi174.stdout:(135/144): libfdisk-2.32.1-42.el8.x86_64.rpm 2.0 MB/s | 253 kB 00:00 2023-07-12T01:59:09.978 INFO:teuthology.orchestra.run.smithi174.stdout:(136/144): iproute-6.2.0-2.el8.x86_64.rpm 2.0 MB/s | 880 kB 00:00 2023-07-12T01:59:10.004 INFO:teuthology.orchestra.run.smithi174.stdout:(137/144): libmount-2.32.1-42.el8.x86_64.rpm 2.1 MB/s | 236 kB 00:00 2023-07-12T01:59:10.063 INFO:teuthology.orchestra.run.smithi174.stdout:(138/144): libuuid-2.32.1-42.el8.x86_64.rpm 1.7 MB/s | 98 kB 00:00 2023-07-12T01:59:10.088 INFO:teuthology.orchestra.run.smithi174.stdout:(139/144): libsmartcols-2.32.1-42.el8.x86_64.rp 1.6 MB/s | 179 kB 00:00 2023-07-12T01:59:10.188 INFO:teuthology.orchestra.run.smithi174.stdout:(140/144): util-linux-user-2.32.1-42.el8.x86_64 1.0 MB/s | 102 kB 00:00 2023-07-12T01:59:10.355 INFO:teuthology.orchestra.run.smithi174.stdout:(141/144): xfsdump-3.1.8-6.el8.x86_64.rpm 2.0 MB/s | 334 kB 00:00 2023-07-12T01:59:10.788 INFO:teuthology.orchestra.run.smithi174.stdout:(142/144): xfsprogs-5.0.0-12.el8.x86_64.rpm 2.5 MB/s | 1.1 MB 00:00 2023-07-12T01:59:10.830 INFO:teuthology.orchestra.run.smithi174.stdout:(143/144): util-linux-2.32.1-42.el8.x86_64.rpm 3.4 MB/s | 2.6 MB 00:00 2023-07-12T01:59:39.377 INFO:teuthology.orchestra.run.smithi174.stdout:(144/144): python3-scipy-1.0.0-21.module_el8.5. 325 kB/s | 14 MB 00:43 2023-07-12T01:59:39.381 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2023-07-12T01:59:39.381 INFO:teuthology.orchestra.run.smithi174.stdout:Total 2.3 MB/s | 212 MB 01:31 2023-07-12T01:59:41.181 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2023-07-12T01:59:41.592 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction check succeeded. 2023-07-12T01:59:41.592 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2023-07-12T01:59:43.132 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded. 2023-07-12T01:59:43.136 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2023-07-12T01:59:48.521 INFO:teuthology.orchestra.run.smithi174.stdout: Preparing : 1/1 2023-07-12T01:59:48.758 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-07-12T01:59:48.952 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/160 2023-07-12T01:59:49.113 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 2/160 2023-07-12T01:59:49.214 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 2/160 2023-07-12T01:59:49.371 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 3/160 2023-07-12T01:59:49.443 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 3/160 2023-07-12T01:59:49.622 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/160 2023-07-12T01:59:49.834 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 5/160 2023-07-12T01:59:50.048 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/160 2023-07-12T01:59:50.212 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-07-12T01:59:50.704 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-07-12T01:59:50.904 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : librados2-2:18.0.0-4828.gb5891ed6.el8.x86_64 8/160 2023-07-12T01:59:51.331 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librados2-2:18.0.0-4828.gb5891ed6.el8.x86_64 8/160 2023-07-12T01:59:51.504 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : librbd1-2:18.0.0-4828.gb5891ed6.el8.x86_64 9/160 2023-07-12T01:59:51.634 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librbd1-2:18.0.0-4828.gb5891ed6.el8.x86_64 9/160 2023-07-12T01:59:51.804 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcephfs2-2:18.0.0-4828.gb5891ed6.el8.x86_64 10/160 2023-07-12T01:59:51.920 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libcephfs2-2:18.0.0-4828.gb5891ed6.el8.x86_64 10/160 2023-07-12T01:59:52.114 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rados-2:18.0.0-4828.gb5891ed6.el8.x86_64 11/160 2023-07-12T01:59:52.271 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/160 2023-07-12T01:59:52.496 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/160 2023-07-12T01:59:52.679 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-07-12T01:59:52.765 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-07-12T01:59:52.987 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/160 2023-07-12T01:59:53.180 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/160 2023-07-12T01:59:53.653 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libpq-13.5-1.el8.x86_64 16/160 2023-07-12T01:59:53.851 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 17/160 2023-07-12T01:59:53.995 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcephsqlite-2:18.0.0-4828.gb5891ed6.el8.x86_64 18/160 2023-07-12T01:59:54.120 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4828.gb5891ed6.el8.x86_64 18/160 2023-07-12T01:59:54.270 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libradosstriper1-2:18.0.0-4828.gb5891ed6.el8.x86 19/160 2023-07-12T01:59:54.417 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4828.gb5891ed6.el8.x86 19/160 2023-07-12T01:59:54.649 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/160 2023-07-12T01:59:54.815 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 21/160 2023-07-12T01:59:54.937 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 22/160 2023-07-12T01:59:55.098 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 22/160 2023-07-12T01:59:55.236 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 23/160 2023-07-12T01:59:55.901 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 23/160 2023-07-12T01:59:56.095 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : openblas-0.3.15-4.el8.x86_64 24/160 2023-07-12T01:59:56.780 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 24/160 2023-07-12T01:59:56.970 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-07-12T01:59:57.788 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-07-12T01:59:58.128 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 26/160 2023-07-12T01:59:58.337 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 27/160 2023-07-12T01:59:58.510 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 28/160 2023-07-12T01:59:58.723 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 29/160 2023-07-12T01:59:58.952 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-ceph-common-2:18.0.0-4828.gb5891ed6.el8. 30/160 2023-07-12T01:59:59.099 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-ceph-argparse-2:18.0.0-4828.gb5891ed6.el 31/160 2023-07-12T01:59:59.317 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cephfs-2:18.0.0-4828.gb5891ed6.el8.x86_6 32/160 2023-07-12T02:00:00.360 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 33/160 2023-07-12T02:00:00.723 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 34/160 2023-07-12T02:00:01.029 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 35/160 2023-07-12T02:00:01.236 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-07-12T02:00:03.291 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-07-12T02:00:03.581 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 37/160 2023-07-12T02:00:03.801 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/160 2023-07-12T02:00:04.024 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rsa-4.8-1.el8.noarch 39/160 2023-07-12T02:00:04.213 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 40/160 2023-07-12T02:00:04.405 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librados-devel-2:18.0.0-4828.gb5891ed6.el8.x86_6 41/160 2023-07-12T02:00:04.587 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 42/160 2023-07-12T02:00:04.770 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 43/160 2023-07-12T02:00:05.002 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 44/160 2023-07-12T02:00:05.100 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 44/160 2023-07-12T02:00:05.277 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 45/160 2023-07-12T02:00:05.366 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 45/160 2023-07-12T02:00:05.523 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 46/160 2023-07-12T02:00:05.710 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-07-12T02:00:06.294 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-07-12T02:00:06.553 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 48/160 2023-07-12T02:00:06.581 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 48/160 2023-07-12T02:00:06.801 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/160 2023-07-12T02:00:07.142 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/160 2023-07-12T02:00:07.364 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/160 2023-07-12T02:00:07.515 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/160 2023-07-12T02:00:07.673 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/160 2023-07-12T02:00:07.874 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/160 2023-07-12T02:00:08.067 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/160 2023-07-12T02:00:08.273 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/160 2023-07-12T02:00:08.480 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/160 2023-07-12T02:00:08.650 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/160 2023-07-12T02:00:08.815 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/160 2023-07-12T02:00:09.025 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/160 2023-07-12T02:00:09.186 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/160 2023-07-12T02:00:09.362 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/160 2023-07-12T02:00:09.600 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/160 2023-07-12T02:00:09.830 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/160 2023-07-12T02:00:10.048 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/160 2023-07-12T02:00:10.422 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/160 2023-07-12T02:00:10.645 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/160 2023-07-12T02:00:10.831 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/160 2023-07-12T02:00:11.649 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/160 2023-07-12T02:00:11.859 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librgw2-2:18.0.0-4828.gb5891ed6.el8.x86_64 70/160 2023-07-12T02:00:11.951 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librgw2-2:18.0.0-4828.gb5891ed6.el8.x86_64 70/160 2023-07-12T02:00:12.162 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 71/160 2023-07-12T02:00:12.413 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 72/160 2023-07-12T02:00:12.813 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 73/160 2023-07-12T02:00:13.066 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 74/160 2023-07-12T02:00:13.256 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 75/160 2023-07-12T02:00:13.485 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 76/160 2023-07-12T02:00:13.803 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 77/160 2023-07-12T02:00:15.081 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/160 2023-07-12T02:00:15.449 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/160 2023-07-12T02:00:15.660 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 80/160 2023-07-12T02:00:15.910 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 81/160 2023-07-12T02:00:16.215 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 82/160 2023-07-12T02:00:16.477 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 83/160 2023-07-12T02:00:16.705 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 84/160 2023-07-12T02:00:16.948 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 85/160 2023-07-12T02:00:17.299 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 86/160 2023-07-12T02:00:17.514 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 87/160 2023-07-12T02:00:17.686 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 88/160 2023-07-12T02:00:17.870 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 89/160 2023-07-12T02:00:18.202 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 90/160 2023-07-12T02:00:18.430 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 91/160 2023-07-12T02:00:18.583 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 92/160 2023-07-12T02:00:18.776 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 93/160 2023-07-12T02:00:19.061 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 94/160 2023-07-12T02:00:19.292 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : fuse-2.9.7-17.el8.x86_64 95/160 2023-07-12T02:00:19.504 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 96/160 2023-07-12T02:00:19.683 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : uuid-1.6.2-43.el8.x86_64 97/160 2023-07-12T02:00:19.812 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 97/160 2023-07-12T02:00:20.010 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 98/160 2023-07-12T02:00:20.184 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 99/160 2023-07-12T02:00:23.048 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 100/160 2023-07-12T02:00:23.300 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 100/160 2023-07-12T02:00:24.008 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 100/160 2023-07-12T02:00:24.886 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-base-2:18.0.0-4828.gb5891ed6.el8.x86_64 101/160 2023-07-12T02:00:25.092 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-base-2:18.0.0-4828.gb5891ed6.el8.x86_64 101/160 2023-07-12T02:00:25.324 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-selinux-2:18.0.0-4828.gb5891ed6.el8.x86_64 102/160 2023-07-12T02:00:45.874 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4828.gb5891ed6.el8.x86_64 102/160 2023-07-12T02:00:45.875 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /sys 2023-07-12T02:00:45.875 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /proc 2023-07-12T02:00:45.875 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /dev 2023-07-12T02:00:45.875 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /run 2023-07-12T02:00:45.875 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /mnt 2023-07-12T02:00:45.875 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /var/tmp 2023-07-12T02:00:45.876 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /home 2023-07-12T02:00:45.876 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /tmp 2023-07-12T02:00:45.876 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /dev 2023-07-12T02:00:45.876 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T02:00:46.300 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-volume-2:18.0.0-4828.gb5891ed6.el8.noarch 103/160 2023-07-12T02:00:48.016 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-volume-2:18.0.0-4828.gb5891ed6.el8.noarch 103/160 2023-07-12T02:00:48.248 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-osd-2:18.0.0-4828.gb5891ed6.el8.x86_64 104/160 2023-07-12T02:00:48.515 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-osd-2:18.0.0-4828.gb5891ed6.el8.x86_64 104/160 2023-07-12T02:00:48.679 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mds-2:18.0.0-4828.gb5891ed6.el8.x86_64 105/160 2023-07-12T02:00:49.203 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mds-2:18.0.0-4828.gb5891ed6.el8.x86_64 105/160 2023-07-12T02:00:49.370 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mon-2:18.0.0-4828.gb5891ed6.el8.x86_64 106/160 2023-07-12T02:00:49.419 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mon-2:18.0.0-4828.gb5891ed6.el8.x86_64 106/160 2023-07-12T02:00:49.596 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 107/160 2023-07-12T02:00:49.820 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 108/160 2023-07-12T02:00:49.995 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 109/160 2023-07-12T02:00:50.087 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 109/160 2023-07-12T02:00:50.453 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : jq-1.6-7.el8.x86_64 110/160 2023-07-12T02:00:50.687 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : automake-1.16.1-7.el8.noarch 111/160 2023-07-12T02:00:51.269 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 112/160 2023-07-12T02:00:51.451 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 112/160 2023-07-12T02:00:51.586 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4828.gb5891ed6.e 113/160 2023-07-12T02:00:51.800 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4828.gb5891ed6. 114/160 2023-07-12T02:00:52.028 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4828.gb5891ed6.el8.noa 115/160 2023-07-12T02:00:52.283 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4828.gb5891ed6.el8.noa 115/160 2023-07-12T02:00:52.514 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4828.gb5891ed6.el8.n 116/160 2023-07-12T02:00:53.616 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4828.gb5891ed6.el8.n 116/160 2023-07-12T02:00:53.811 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4828.gb58 117/160 2023-07-12T02:00:53.939 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4828.gb58 117/160 2023-07-12T02:00:54.329 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4828.gb5891ed6.el 118/160 2023-07-12T02:00:54.539 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-2:18.0.0-4828.gb5891ed6.el8.x86_64 119/160 2023-07-12T02:00:54.604 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4828.gb5891ed6.el8.x86_64 119/160 2023-07-12T02:00:54.761 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-rook-2:18.0.0-4828.gb5891ed6.el8.noarch 120/160 2023-07-12T02:00:54.787 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4828.gb5891ed6.el8.noarch 120/160 2023-07-12T02:00:54.990 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-2:18.0.0-4828.gb5891ed6.el8.x86_64 121/160 2023-07-12T02:00:55.153 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libtool-2.4.6-25.el8.x86_64 122/160 2023-07-12T02:01:00.193 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 122/160 2023-07-12T02:01:01.731 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-test-2:18.0.0-4828.gb5891ed6.el8.x86_64 123/160 2023-07-12T02:01:02.046 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-radosgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 124/160 2023-07-12T02:01:02.108 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 124/160 2023-07-12T02:01:02.269 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4828.gb5891 125/160 2023-07-12T02:01:02.339 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4828.gb5891 125/160 2023-07-12T02:01:02.519 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephfs-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 126/160 2023-07-12T02:01:02.925 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 126/160 2023-07-12T02:01:03.110 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 127/160 2023-07-12T02:01:03.428 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 127/160 2023-07-12T02:01:03.756 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : postgresql-contrib-10.23-1.module_el8+300+2c5300 128/160 2023-07-12T02:01:04.936 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 129/160 2023-07-12T02:01:05.232 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 130/160 2023-07-12T02:01:05.416 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 131/160 2023-07-12T02:01:05.590 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 132/160 2023-07-12T02:01:05.749 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/160 2023-07-12T02:01:05.952 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcephfs-devel-2:18.0.0-4828.gb5891ed6.el8.x86_ 134/160 2023-07-12T02:01:07.115 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-12T02:01:07.360 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-12T02:01:07.443 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-12T02:01:07.647 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 136/160 2023-07-12T02:01:07.885 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephfs-top-2:18.0.0-4828.gb5891ed6.el8.noarch 137/160 2023-07-12T02:01:08.118 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 138/160 2023-07-12T02:01:08.502 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-nbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 139/160 2023-07-12T02:01:08.811 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 140/160 2023-07-12T02:01:08.967 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-07-12T02:01:08.992 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-07-12T02:01:09.191 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 142/160 2023-07-12T02:01:09.442 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/160 2023-07-12T02:01:09.549 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/160 2023-07-12T02:01:09.776 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/160 2023-07-12T02:01:09.801 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/160 2023-07-12T02:01:09.977 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 145/160 2023-07-12T02:01:10.230 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 146/160 2023-07-12T02:01:10.405 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 147/160 2023-07-12T02:01:10.405 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-07-12T02:01:10.680 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-07-12T02:01:10.680 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-07-12T02:01:10.920 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-07-12T02:01:10.936 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-07-12T02:01:11.065 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-07-12T02:01:11.065 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 151/160 2023-07-12T02:01:11.352 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 151/160 2023-07-12T02:01:11.536 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 152/160 2023-07-12T02:01:11.714 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 153/160 2023-07-12T02:01:11.944 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 154/160 2023-07-12T02:01:11.944 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 155/160 2023-07-12T02:01:12.178 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 155/160 2023-07-12T02:01:12.179 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 156/160 2023-07-12T02:01:12.403 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 156/160 2023-07-12T02:01:12.404 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 157/160 2023-07-12T02:01:12.629 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 157/160 2023-07-12T02:01:12.629 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 158/160 2023-07-12T02:01:12.845 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 158/160 2023-07-12T02:01:12.845 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-07-12T02:01:13.053 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-07-12T02:01:13.235 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-07-12T02:01:13.452 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-07-12T02:01:13.452 INFO:teuthology.orchestra.run.smithi174.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-07-12T02:01:13.452 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T02:01:14.158 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-2:18.0.0-4828.gb5891ed6.el8.x86_64 1/160 2023-07-12T02:01:14.158 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-base-2:18.0.0-4828.gb5891ed6.el8.x86_64 2/160 2023-07-12T02:01:14.158 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 3/160 2023-07-12T02:01:14.159 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 4/160 2023-07-12T02:01:14.159 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4828.gb5891 5/160 2023-07-12T02:01:14.159 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mds-2:18.0.0-4828.gb5891ed6.el8.x86_64 6/160 2023-07-12T02:01:14.159 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-2:18.0.0-4828.gb5891ed6.el8.x86_64 7/160 2023-07-12T02:01:14.159 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mon-2:18.0.0-4828.gb5891ed6.el8.x86_64 8/160 2023-07-12T02:01:14.159 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-osd-2:18.0.0-4828.gb5891ed6.el8.x86_64 9/160 2023-07-12T02:01:14.160 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-radosgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 10/160 2023-07-12T02:01:14.160 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-selinux-2:18.0.0-4828.gb5891ed6.el8.x86_64 11/160 2023-07-12T02:01:14.160 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-test-2:18.0.0-4828.gb5891ed6.el8.x86_64 12/160 2023-07-12T02:01:14.160 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephfs-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 13/160 2023-07-12T02:01:14.160 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcephfs-devel-2:18.0.0-4828.gb5891ed6.el8.x86_ 14/160 2023-07-12T02:01:14.160 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcephfs2-2:18.0.0-4828.gb5891ed6.el8.x86_64 15/160 2023-07-12T02:01:14.161 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcephsqlite-2:18.0.0-4828.gb5891ed6.el8.x86_64 16/160 2023-07-12T02:01:14.161 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados-devel-2:18.0.0-4828.gb5891ed6.el8.x86_6 17/160 2023-07-12T02:01:14.161 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libradosstriper1-2:18.0.0-4828.gb5891ed6.el8.x86 18/160 2023-07-12T02:01:14.161 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librgw2-2:18.0.0-4828.gb5891ed6.el8.x86_64 19/160 2023-07-12T02:01:14.161 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4828.gb5891ed6.el 20/160 2023-07-12T02:01:14.161 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-ceph-common-2:18.0.0-4828.gb5891ed6.el8. 21/160 2023-07-12T02:01:14.161 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cephfs-2:18.0.0-4828.gb5891ed6.el8.x86_6 22/160 2023-07-12T02:01:14.162 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rados-2:18.0.0-4828.gb5891ed6.el8.x86_64 23/160 2023-07-12T02:01:14.162 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 24/160 2023-07-12T02:01:14.162 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 25/160 2023-07-12T02:01:14.162 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 26/160 2023-07-12T02:01:14.162 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 27/160 2023-07-12T02:01:14.162 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-nbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 28/160 2023-07-12T02:01:14.162 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4828.gb5891ed6. 29/160 2023-07-12T02:01:14.163 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4828.gb5891ed6.el8.noa 30/160 2023-07-12T02:01:14.172 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4828.gb5891ed6.el8.n 31/160 2023-07-12T02:01:14.172 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4828.gb58 32/160 2023-07-12T02:01:14.172 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4828.gb5891ed6.el 33/160 2023-07-12T02:01:14.172 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4828.gb5891ed6.el8.noarch 34/160 2023-07-12T02:01:14.172 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4828.gb5891ed6.e 35/160 2023-07-12T02:01:14.173 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-volume-2:18.0.0-4828.gb5891ed6.el8.noarch 36/160 2023-07-12T02:01:14.173 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 37/160 2023-07-12T02:01:14.173 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephfs-top-2:18.0.0-4828.gb5891ed6.el8.noarch 38/160 2023-07-12T02:01:14.173 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/160 2023-07-12T02:01:14.173 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/160 2023-07-12T02:01:14.173 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/160 2023-07-12T02:01:14.174 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : jq-1.6-7.el8.x86_64 42/160 2023-07-12T02:01:14.174 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/160 2023-07-12T02:01:14.174 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/160 2023-07-12T02:01:14.174 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/160 2023-07-12T02:01:14.174 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/160 2023-07-12T02:01:14.174 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/160 2023-07-12T02:01:14.174 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/160 2023-07-12T02:01:14.175 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/160 2023-07-12T02:01:14.175 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 50/160 2023-07-12T02:01:14.175 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : postgresql-contrib-10.23-1.module_el8+300+2c5300 51/160 2023-07-12T02:01:14.175 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : postgresql-server-10.23-1.module_el8+300+2c53004 52/160 2023-07-12T02:01:14.175 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/160 2023-07-12T02:01:14.175 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/160 2023-07-12T02:01:14.175 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/160 2023-07-12T02:01:14.176 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/160 2023-07-12T02:01:14.176 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/160 2023-07-12T02:01:14.176 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/160 2023-07-12T02:01:14.176 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/160 2023-07-12T02:01:14.176 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/160 2023-07-12T02:01:14.176 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/160 2023-07-12T02:01:14.176 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/160 2023-07-12T02:01:14.177 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/160 2023-07-12T02:01:14.177 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/160 2023-07-12T02:01:14.177 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/160 2023-07-12T02:01:14.177 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/160 2023-07-12T02:01:14.177 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/160 2023-07-12T02:01:14.177 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/160 2023-07-12T02:01:14.177 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/160 2023-07-12T02:01:14.178 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/160 2023-07-12T02:01:14.178 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 71/160 2023-07-12T02:01:14.178 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 72/160 2023-07-12T02:01:14.178 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/160 2023-07-12T02:01:14.178 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/160 2023-07-12T02:01:14.178 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/160 2023-07-12T02:01:14.178 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/160 2023-07-12T02:01:14.179 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 77/160 2023-07-12T02:01:14.179 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 78/160 2023-07-12T02:01:14.179 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 79/160 2023-07-12T02:01:14.179 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/160 2023-07-12T02:01:14.179 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/160 2023-07-12T02:01:14.179 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 82/160 2023-07-12T02:01:14.179 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/160 2023-07-12T02:01:14.180 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/160 2023-07-12T02:01:14.180 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 85/160 2023-07-12T02:01:14.180 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/160 2023-07-12T02:01:14.180 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/160 2023-07-12T02:01:14.180 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/160 2023-07-12T02:01:14.180 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 89/160 2023-07-12T02:01:14.181 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 90/160 2023-07-12T02:01:14.181 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/160 2023-07-12T02:01:14.181 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/160 2023-07-12T02:01:14.181 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/160 2023-07-12T02:01:14.181 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/160 2023-07-12T02:01:14.181 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 95/160 2023-07-12T02:01:14.181 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/160 2023-07-12T02:01:14.182 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 97/160 2023-07-12T02:01:14.182 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/160 2023-07-12T02:01:14.182 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/160 2023-07-12T02:01:14.182 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 100/160 2023-07-12T02:01:14.182 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/160 2023-07-12T02:01:14.182 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/160 2023-07-12T02:01:14.182 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/160 2023-07-12T02:01:14.183 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/160 2023-07-12T02:01:14.183 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/160 2023-07-12T02:01:14.183 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/160 2023-07-12T02:01:14.183 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/160 2023-07-12T02:01:14.183 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/160 2023-07-12T02:01:14.183 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/160 2023-07-12T02:01:14.183 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/160 2023-07-12T02:01:14.183 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/160 2023-07-12T02:01:14.184 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/160 2023-07-12T02:01:14.184 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 113/160 2023-07-12T02:01:14.184 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 114/160 2023-07-12T02:01:14.184 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-portend-2.6-1.el8.noarch 115/160 2023-07-12T02:01:14.184 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/160 2023-07-12T02:01:14.184 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/160 2023-07-12T02:01:14.184 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 118/160 2023-07-12T02:01:14.185 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/160 2023-07-12T02:01:14.185 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/160 2023-07-12T02:01:14.185 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/160 2023-07-12T02:01:14.185 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/160 2023-07-12T02:01:14.185 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 123/160 2023-07-12T02:01:14.185 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/160 2023-07-12T02:01:14.185 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/160 2023-07-12T02:01:14.186 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/160 2023-07-12T02:01:14.186 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/160 2023-07-12T02:01:14.186 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 128/160 2023-07-12T02:01:14.186 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados2-2:18.0.0-4828.gb5891ed6.el8.x86_64 129/160 2023-07-12T02:01:14.186 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/160 2023-07-12T02:01:14.186 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librbd1-2:18.0.0-4828.gb5891ed6.el8.x86_64 131/160 2023-07-12T02:01:14.186 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/160 2023-07-12T02:01:14.187 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-8.el 133/160 2023-07-12T02:01:14.187 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 134/160 2023-07-12T02:01:14.187 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 135/160 2023-07-12T02:01:14.187 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 136/160 2023-07-12T02:01:14.187 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 137/160 2023-07-12T02:01:14.187 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 138/160 2023-07-12T02:01:14.187 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 139/160 2023-07-12T02:01:14.188 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 140/160 2023-07-12T02:01:14.188 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 141/160 2023-07-12T02:01:14.188 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 142/160 2023-07-12T02:01:14.188 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 143/160 2023-07-12T02:01:14.188 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 144/160 2023-07-12T02:01:14.188 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 145/160 2023-07-12T02:01:14.188 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 146/160 2023-07-12T02:01:14.189 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 147/160 2023-07-12T02:01:14.189 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 148/160 2023-07-12T02:01:14.189 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 149/160 2023-07-12T02:01:14.189 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 150/160 2023-07-12T02:01:14.189 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 151/160 2023-07-12T02:01:14.189 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 152/160 2023-07-12T02:01:14.189 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 153/160 2023-07-12T02:01:14.190 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 154/160 2023-07-12T02:01:14.190 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 155/160 2023-07-12T02:01:14.190 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 156/160 2023-07-12T02:01:14.190 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 157/160 2023-07-12T02:01:14.190 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 158/160 2023-07-12T02:01:14.190 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 159/160 2023-07-12T02:01:16.265 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 160/160 2023-07-12T02:01:16.266 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T02:01:16.266 INFO:teuthology.orchestra.run.smithi174.stdout:Upgraded: 2023-07-12T02:01:16.266 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-initscripts-updown-1:1.40.16-8.el8.noarch 2023-07-12T02:01:16.266 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-07-12T02:01:16.266 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-07-12T02:01:16.267 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-07-12T02:01:16.267 INFO:teuthology.orchestra.run.smithi174.stdout: iproute-6.2.0-2.el8.x86_64 2023-07-12T02:01:16.267 INFO:teuthology.orchestra.run.smithi174.stdout: libblkid-2.32.1-42.el8.x86_64 2023-07-12T02:01:16.267 INFO:teuthology.orchestra.run.smithi174.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-07-12T02:01:16.267 INFO:teuthology.orchestra.run.smithi174.stdout: libmount-2.32.1-42.el8.x86_64 2023-07-12T02:01:16.267 INFO:teuthology.orchestra.run.smithi174.stdout: librados2-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:01:16.267 INFO:teuthology.orchestra.run.smithi174.stdout: librbd1-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:01:16.268 INFO:teuthology.orchestra.run.smithi174.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-07-12T02:01:16.268 INFO:teuthology.orchestra.run.smithi174.stdout: libuuid-2.32.1-42.el8.x86_64 2023-07-12T02:01:16.268 INFO:teuthology.orchestra.run.smithi174.stdout: util-linux-2.32.1-42.el8.x86_64 2023-07-12T02:01:16.268 INFO:teuthology.orchestra.run.smithi174.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-07-12T02:01:16.268 INFO:teuthology.orchestra.run.smithi174.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-07-12T02:01:16.268 INFO:teuthology.orchestra.run.smithi174.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-07-12T02:01:16.269 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2023-07-12T02:01:16.269 INFO:teuthology.orchestra.run.smithi174.stdout: automake-1.16.1-7.el8.noarch 2023-07-12T02:01:16.269 INFO:teuthology.orchestra.run.smithi174.stdout: bison-3.0.4-10.el8.x86_64 2023-07-12T02:01:16.269 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:01:16.269 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-base-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:01:16.269 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:01:16.269 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:01:16.269 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-grafana-dashboards-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T02:01:16.270 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-immutable-object-cache-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:01:16.270 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mds-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:01:16.270 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:01:16.270 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T02:01:16.270 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-dashboard-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T02:01:16.270 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T02:01:16.270 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-modules-core-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T02:01:16.270 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-rook-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T02:01:16.271 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mon-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:01:16.271 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-osd-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:01:16.271 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-prometheus-alerts-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T02:01:16.271 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-radosgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:01:16.271 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-selinux-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:01:16.271 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-test-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:01:16.271 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-volume-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T02:01:16.272 INFO:teuthology.orchestra.run.smithi174.stdout: cephadm-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T02:01:16.272 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:01:16.272 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-top-2:18.0.0-4828.gb5891ed6.el8.noarch 2023-07-12T02:01:16.272 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-07-12T02:01:16.272 INFO:teuthology.orchestra.run.smithi174.stdout: flex-2.6.1-9.el8.x86_64 2023-07-12T02:01:16.272 INFO:teuthology.orchestra.run.smithi174.stdout: fuse-2.9.7-17.el8.x86_64 2023-07-12T02:01:16.272 INFO:teuthology.orchestra.run.smithi174.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-12T02:01:16.272 INFO:teuthology.orchestra.run.smithi174.stdout: jq-1.6-7.el8.x86_64 2023-07-12T02:01:16.273 INFO:teuthology.orchestra.run.smithi174.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-12T02:01:16.273 INFO:teuthology.orchestra.run.smithi174.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-07-12T02:01:16.273 INFO:teuthology.orchestra.run.smithi174.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-12T02:01:16.273 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs-devel-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:01:16.273 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs2-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:01:16.273 INFO:teuthology.orchestra.run.smithi174.stdout: libcephsqlite-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:01:16.273 INFO:teuthology.orchestra.run.smithi174.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-07-12T02:01:16.273 INFO:teuthology.orchestra.run.smithi174.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-07-12T02:01:16.274 INFO:teuthology.orchestra.run.smithi174.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-12T02:01:16.274 INFO:teuthology.orchestra.run.smithi174.stdout: libpq-13.5-1.el8.x86_64 2023-07-12T02:01:16.274 INFO:teuthology.orchestra.run.smithi174.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-07-12T02:01:16.274 INFO:teuthology.orchestra.run.smithi174.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-07-12T02:01:16.274 INFO:teuthology.orchestra.run.smithi174.stdout: librados-devel-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:01:16.274 INFO:teuthology.orchestra.run.smithi174.stdout: libradosstriper1-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:01:16.274 INFO:teuthology.orchestra.run.smithi174.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-12T02:01:16.275 INFO:teuthology.orchestra.run.smithi174.stdout: librgw2-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:01:16.275 INFO:teuthology.orchestra.run.smithi174.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-07-12T02:01:16.275 INFO:teuthology.orchestra.run.smithi174.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-12T02:01:16.275 INFO:teuthology.orchestra.run.smithi174.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-12T02:01:16.275 INFO:teuthology.orchestra.run.smithi174.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-12T02:01:16.275 INFO:teuthology.orchestra.run.smithi174.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-07-12T02:01:16.275 INFO:teuthology.orchestra.run.smithi174.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-07-12T02:01:16.275 INFO:teuthology.orchestra.run.smithi174.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-07-12T02:01:16.276 INFO:teuthology.orchestra.run.smithi174.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-12T02:01:16.276 INFO:teuthology.orchestra.run.smithi174.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-12T02:01:16.276 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-0.3.15-4.el8.x86_64 2023-07-12T02:01:16.276 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-07-12T02:01:16.276 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-07-12T02:01:16.276 INFO:teuthology.orchestra.run.smithi174.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-07-12T02:01:16.276 INFO:teuthology.orchestra.run.smithi174.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-07-12T02:01:16.277 INFO:teuthology.orchestra.run.smithi174.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-07-12T02:01:16.277 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-12T02:01:16.277 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-contrib-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-12T02:01:16.277 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-server-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-12T02:01:16.277 INFO:teuthology.orchestra.run.smithi174.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-12T02:01:16.277 INFO:teuthology.orchestra.run.smithi174.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-12T02:01:16.277 INFO:teuthology.orchestra.run.smithi174.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-12T02:01:16.278 INFO:teuthology.orchestra.run.smithi174.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-12T02:01:16.278 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-12T02:01:16.278 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-argparse-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:01:16.278 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-common-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:01:16.278 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cephfs-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:01:16.278 INFO:teuthology.orchestra.run.smithi174.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-12T02:01:16.278 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-07-12T02:01:16.278 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-12T02:01:16.279 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-12T02:01:16.279 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-07-12T02:01:16.279 INFO:teuthology.orchestra.run.smithi174.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-12T02:01:16.279 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-12T02:01:16.279 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-12T02:01:16.279 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-12T02:01:16.279 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-12T02:01:16.279 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-12T02:01:16.280 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-12T02:01:16.280 INFO:teuthology.orchestra.run.smithi174.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-12T02:01:16.280 INFO:teuthology.orchestra.run.smithi174.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-12T02:01:16.280 INFO:teuthology.orchestra.run.smithi174.stdout: python3-mako-1.0.6-14.el8.noarch 2023-07-12T02:01:16.280 INFO:teuthology.orchestra.run.smithi174.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-12T02:01:16.280 INFO:teuthology.orchestra.run.smithi174.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-12T02:01:16.280 INFO:teuthology.orchestra.run.smithi174.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-12T02:01:16.281 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-12T02:01:16.281 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-12T02:01:16.281 INFO:teuthology.orchestra.run.smithi174.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-12T02:01:16.281 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-12T02:01:16.281 INFO:teuthology.orchestra.run.smithi174.stdout: python3-portend-2.6-1.el8.noarch 2023-07-12T02:01:16.281 INFO:teuthology.orchestra.run.smithi174.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-12T02:01:16.281 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-12T02:01:16.281 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-12T02:01:16.282 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-12T02:01:16.282 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-12T02:01:16.282 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-12T02:01:16.282 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rados-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:01:16.282 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:01:16.282 INFO:teuthology.orchestra.run.smithi174.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-12T02:01:16.282 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-12T02:01:16.283 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rgw-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:01:16.283 INFO:teuthology.orchestra.run.smithi174.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-12T02:01:16.283 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-12T02:01:16.283 INFO:teuthology.orchestra.run.smithi174.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-07-12T02:01:16.283 INFO:teuthology.orchestra.run.smithi174.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-12T02:01:16.283 INFO:teuthology.orchestra.run.smithi174.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-12T02:01:16.283 INFO:teuthology.orchestra.run.smithi174.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-12T02:01:16.283 INFO:teuthology.orchestra.run.smithi174.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-12T02:01:16.284 INFO:teuthology.orchestra.run.smithi174.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-12T02:01:16.284 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-12T02:01:16.284 INFO:teuthology.orchestra.run.smithi174.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-12T02:01:16.284 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-12T02:01:16.284 INFO:teuthology.orchestra.run.smithi174.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-12T02:01:16.284 INFO:teuthology.orchestra.run.smithi174.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-12T02:01:16.285 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-fuse-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:01:16.285 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-mirror-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:01:16.285 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-nbd-2:18.0.0-4828.gb5891ed6.el8.x86_64 2023-07-12T02:01:16.285 INFO:teuthology.orchestra.run.smithi174.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-12T02:01:16.285 INFO:teuthology.orchestra.run.smithi174.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-12T02:01:16.285 INFO:teuthology.orchestra.run.smithi174.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-12T02:01:16.285 INFO:teuthology.orchestra.run.smithi174.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-07-12T02:01:16.285 INFO:teuthology.orchestra.run.smithi174.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-12T02:01:16.286 INFO:teuthology.orchestra.run.smithi174.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-07-12T02:01:16.286 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T02:01:16.286 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2023-07-12T02:01:16.596 DEBUG:teuthology.parallel:result is None 2023-07-12T02:01:16.597 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b5891ed62e7aba6227aed8ab09a4dd0853a1caf2 2023-07-12T02:01:16.737 DEBUG:teuthology.orchestra.run.smithi060:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-12T02:01:16.769 INFO:teuthology.orchestra.run.smithi060.stdout:18.0.0-4828.gb5891ed6.el8 2023-07-12T02:01:16.769 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4828.gb5891ed6.el8 2023-07-12T02:01:16.770 INFO:teuthology.task.install:The correct ceph version 18.0.0-4828.gb5891ed6 is installed. 2023-07-12T02:01:16.770 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b5891ed62e7aba6227aed8ab09a4dd0853a1caf2 2023-07-12T02:01:17.043 DEBUG:teuthology.orchestra.run.smithi079:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-12T02:01:17.073 INFO:teuthology.orchestra.run.smithi079.stdout:18.0.0-4828.gb5891ed6.el8 2023-07-12T02:01:17.073 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4828.gb5891ed6.el8 2023-07-12T02:01:17.073 INFO:teuthology.task.install:The correct ceph version 18.0.0-4828.gb5891ed6 is installed. 2023-07-12T02:01:17.074 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b5891ed62e7aba6227aed8ab09a4dd0853a1caf2 2023-07-12T02:01:17.371 DEBUG:teuthology.orchestra.run.smithi174:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-12T02:01:17.429 INFO:teuthology.orchestra.run.smithi174.stdout:18.0.0-4828.gb5891ed6.el8 2023-07-12T02:01:17.429 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4828.gb5891ed6.el8 2023-07-12T02:01:17.430 INFO:teuthology.task.install:The correct ceph version 18.0.0-4828.gb5891ed6 is installed. 2023-07-12T02:01:17.430 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-07-12T02:01:17.431 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-07-12T02:01:17.431 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-12T02:01:17.469 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-07-12T02:01:17.469 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-12T02:01:17.506 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-07-12T02:01:17.506 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-12T02:01:17.578 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-07-12T02:01:17.579 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-07-12T02:01:17.579 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/daemon-helper 2023-07-12T02:01:17.612 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-12T02:01:17.683 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-07-12T02:01:17.683 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/daemon-helper 2023-07-12T02:01:17.716 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-12T02:01:17.786 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-07-12T02:01:17.786 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/daemon-helper 2023-07-12T02:01:17.858 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-12T02:01:17.968 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-07-12T02:01:17.969 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-07-12T02:01:17.969 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-12T02:01:18.002 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-12T02:01:18.074 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-07-12T02:01:18.074 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-12T02:01:18.106 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-12T02:01:18.179 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-07-12T02:01:18.179 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-12T02:01:18.250 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-12T02:01:18.364 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-07-12T02:01:18.365 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-07-12T02:01:18.365 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/stdin-killer 2023-07-12T02:01:18.398 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-12T02:01:18.471 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-07-12T02:01:18.472 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/stdin-killer 2023-07-12T02:01:18.504 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-12T02:01:18.575 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-07-12T02:01:18.576 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/stdin-killer 2023-07-12T02:01:18.648 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-12T02:01:18.758 INFO:teuthology.run_tasks:Running task ceph... 2023-07-12T02:01:18.829 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-07-12T02:01:18.829 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 777 /var/log/ceph 2023-07-12T02:01:18.832 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 777 /var/log/ceph 2023-07-12T02:01:18.835 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 777 /var/log/ceph 2023-07-12T02:01:18.904 INFO:tasks.ceph:Disabling ceph logrotate... 2023-07-12T02:01:18.904 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-12T02:01:18.907 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-12T02:01:18.909 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-12T02:01:18.977 INFO:tasks.ceph:Creating extra log directories... 2023-07-12T02:01:18.977 DEBUG:teuthology.orchestra.run.smithi060:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-12T02:01:18.980 DEBUG:teuthology.orchestra.run.smithi079:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-12T02:01:18.982 DEBUG:teuthology.orchestra.run.smithi174:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-12T02:01:19.061 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-07-12T02:01:19.061 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-07-12T02:01:19.062 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-07-12T02:01:19.062 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-07-12T02:01:19.062 DEBUG:teuthology.orchestra.run.smithi060:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-12T02:01:19.082 DEBUG:teuthology.orchestra.run.smithi060:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-12T02:01:19.205 DEBUG:teuthology.orchestra.run.smithi060:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-07-12T02:01:19.235 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-07-12T02:01:19.236 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-12T02:01:19.257 DEBUG:teuthology.orchestra.run.smithi079:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-12T02:01:19.380 DEBUG:teuthology.orchestra.run.smithi079:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-07-12T02:01:19.409 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-07-12T02:01:19.409 DEBUG:teuthology.orchestra.run.smithi174:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-12T02:01:19.455 DEBUG:teuthology.orchestra.run.smithi174:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-12T02:01:19.891 DEBUG:teuthology.orchestra.run.smithi174:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-07-12T02:01:19.968 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-07-12T02:01:19.968 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-07-12T02:01:19.969 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2023-07-12_01:23:58-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7334513', 'branch': 'wip-pdonnell-testing-20230710.195410', 'description': 'fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/{0-client 1-tests/fscrypt-common}}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7334513', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2023-07-12_01:23:58-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20230710.195410'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'b5891ed62e7aba6227aed8ab09a4dd0853a1caf2'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b5891ed62e7aba6227aed8ab09a4dd0853a1caf2'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20230710.195410', 'sha1': '6a59b159e6baf6cc2ce7ca365bda9e61847ec2a4'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0']], 'seed': 948, 'sha1': 'b5891ed62e7aba6227aed8ab09a4dd0853a1caf2', 'sleep_before_teardown': 0, 'subset': '199/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20230710.195410', 'suite_path': '/home/teuthworker/src/github.com_batrick_ceph_6a59b159e6baf6cc2ce7ca365bda9e61847ec2a4/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/batrick/ceph.git', 'suite_sha1': '6a59b159e6baf6cc2ce7ca365bda9e61847ec2a4', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi060.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDi0gW8fKNAmfO+Czc2MKPviQypxSRgt8xo4Cf1byQ076IU2aJi9Y2x+cQvjy5NVGipT4KmiHlS5dZekXpriL6sxvyCQp3FvHixH8YvtYL106ID8eWABhf2VZjaDtnRN6F8QYWMtrZm6sDElHHdn6MgmEg3OqwDDfR/2nu2oTF5Clh/hVwbaBs4V8R2A0F8FSIQX7xYU9RVUBvc5mns7tGmy5T96QlsUv+LR4VIyZ+G97cPQA4c/czn8AUEilp/4994shrby+nq8vZ8FP4hKSbX26YxPrijXaYmeT2ogZh0zn6P1K+fc/3hRxT0UmuHsRglY+69Hkm6SBHFHsFlWkVuFt3hOYbDXBbYRFccW5JH1GmTF1Z7L/WzEttp279B5tcxj1H4/iBWb0UhmuBh9PTbHG0+CCc803Ou5TOk8sHEwSgJa+aij33oldLAS7lOsT++DB1whb7Yiovb35xRzYCSNCWmEc/o0G9V5kcoAnMZPH9TpwUdu4BgpyP5Op7Qjws=', 'smithi079.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBYfcqXGTix8QIOpQtWZvohRlu8E6L5qdq8i2SPaD7y1R4bFLRDex36I+V761l7e8eo/EsWioP3bfNX+zNF5xAwES6eCA58nhraj68RXGvC6E+VfAZ93mgF43/Zdg+OBd+v7TRofbr9k5C+/o5meuU7pHUoOm6y08ATK1sqE9fKEuYjgkmKzThfWI/7BMzmCCOvRhaVpk0nA0mOrutwsz0NkX8KddCeuS1x5TB9H03V1zlNWI1WGqg7ZaBrOXSQo86HyW94+NFG7OdVvqmULRcao3CXYw5OIGgTDqtYsibEqxvrsZSTs7A6KMly0aif4cZ1r+b6CkTfwl4d/UD+ba/4UawsSQe6RQ+KRg/HUmhM+uf3c1TJqSJm5h8X4zHSdg+8J71MntFHPsfDcnepOx6c9s9TPKD5R62cdmgu+rq8nwvlHZyhF1GwHTvPvcIYMzc8hbZjGbx95F9SD1NMB9wR8DgZugH+nsTg3c4OYt81LYc9RiN2hwLKeP/OeauYbM=', 'smithi174.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzej4BpwgudJfKlAIH0ciWIQRXO5umxqHSYk7zwtChJczy6QCZVBO8QR1TruR1wEidvdfwjNgKPZHCQXGgBvXFLMxFQw638x8mNfEZq427q39/hKePGMlVbngywH4pRRPMuFnwwJhFiufswdAfOYTTvaQoZV1VyQYcOf3DOEvkqVAlbuEpWzmFgDvO4tZaUpHKeQBC0W2Y65mVwm8QorJSdeFlPTptFQfg7kCT1NQHXq3480mpaKeUW7NaxzgPCTlybGGGkGaMqGyt5qT9K4cfbXay/KNa85xAOV5Uwie7/3sctvZlXbz7YAbbNUnh/ALin+aBQOi7DOpqevTMNu1PIhZUCmeKfZbeNSqGH9N6tEB/mDL+B4DtQku8UtOUV89tp/Ps2vVTBK7xSDTyYHMteLvgVIhj2OFU4DVjCfJ3ptKVXykotpL1UnnINLFsAGxJPRALYEUdYJ43CVDL0uv0CqNM+aR/lkC126r6LlSu5Ai6BfJX+PrSDDTMtAbMkhk='}, 'task': None, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b5891ed62e7aba6227aed8ab09a4dd0853a1caf2'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_fscrypt']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end', 'if not is_kupstream() then reject() end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'b53f236c1077f1d295baafb9e0ca9a4b447019d7', 'timestamp': '2023-07-12_01:23:58', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-07-12T02:01:19.969 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-12T02:01:19.972 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-12T02:01:19.974 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-12T02:01:20.019 DEBUG:teuthology.orchestra.run.smithi060:> sudo install -d -m0777 -- /var/run/ceph 2023-07-12T02:01:20.033 DEBUG:teuthology.orchestra.run.smithi079:> sudo install -d -m0777 -- /var/run/ceph 2023-07-12T02:01:20.037 DEBUG:teuthology.orchestra.run.smithi174:> sudo install -d -m0777 -- /var/run/ceph 2023-07-12T02:01:20.129 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-07-12T02:01:20.129 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/scratch_devs of=/dev/stdout 2023-07-12T02:01:20.150 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-12T02:01:20.151 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_1 2023-07-12T02:01:20.211 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-12T02:01:20.211 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-12T02:01:20.211 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 6h/6d Inode: 418825 Links: 1 2023-07-12T02:01:20.211 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-12T02:01:20.212 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2023-07-12T02:01:20.212 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2023-07-12 01:59:03.353276850 +0000 2023-07-12T02:01:20.212 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2023-07-12 01:50:36.093748856 +0000 2023-07-12T02:01:20.212 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2023-07-12 01:50:36.093748856 +0000 2023-07-12T02:01:20.212 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: - 2023-07-12T02:01:20.212 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-12T02:01:20.280 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2023-07-12T02:01:20.280 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2023-07-12T02:01:20.280 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000114992 s, 4.5 MB/s 2023-07-12T02:01:20.281 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-12T02:01:20.343 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_2 2023-07-12T02:01:20.404 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-12T02:01:20.404 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-12T02:01:20.404 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 6h/6d Inode: 418928 Links: 1 2023-07-12T02:01:20.405 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-12T02:01:20.405 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2023-07-12T02:01:20.405 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2023-07-12 01:59:03.354276839 +0000 2023-07-12T02:01:20.405 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2023-07-12 01:50:36.630743210 +0000 2023-07-12T02:01:20.405 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2023-07-12 01:50:36.630743210 +0000 2023-07-12T02:01:20.405 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: - 2023-07-12T02:01:20.405 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-12T02:01:20.473 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2023-07-12T02:01:20.474 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2023-07-12T02:01:20.474 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000115899 s, 4.4 MB/s 2023-07-12T02:01:20.474 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-12T02:01:20.535 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_3 2023-07-12T02:01:20.596 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-12T02:01:20.596 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-12T02:01:20.596 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 6h/6d Inode: 411531 Links: 1 2023-07-12T02:01:20.596 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-12T02:01:20.596 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2023-07-12T02:01:20.597 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2023-07-12 01:59:03.354276839 +0000 2023-07-12T02:01:20.597 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2023-07-12 01:50:37.148737763 +0000 2023-07-12T02:01:20.597 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2023-07-12 01:50:37.148737763 +0000 2023-07-12T02:01:20.597 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: - 2023-07-12T02:01:20.597 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-12T02:01:20.663 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2023-07-12T02:01:20.663 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2023-07-12T02:01:20.664 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000102246 s, 5.0 MB/s 2023-07-12T02:01:20.664 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-12T02:01:20.724 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_4 2023-07-12T02:01:20.783 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-12T02:01:20.783 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-12T02:01:20.784 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 6h/6d Inode: 420011 Links: 1 2023-07-12T02:01:20.784 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-12T02:01:20.784 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2023-07-12T02:01:20.784 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2023-07-12 01:59:03.354276839 +0000 2023-07-12T02:01:20.784 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2023-07-12 01:50:37.774731181 +0000 2023-07-12T02:01:20.784 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2023-07-12 01:50:37.774731181 +0000 2023-07-12T02:01:20.784 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: - 2023-07-12T02:01:20.785 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-12T02:01:20.850 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2023-07-12T02:01:20.851 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2023-07-12T02:01:20.851 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 8.8254e-05 s, 5.8 MB/s 2023-07-12T02:01:20.852 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-12T02:01:20.911 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-12T02:01:20.911 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-07-12T02:01:20.911 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/scratch_devs of=/dev/stdout 2023-07-12T02:01:20.933 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-12T02:01:20.933 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_1 2023-07-12T02:01:20.994 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-12T02:01:20.994 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-12T02:01:20.994 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 6h/6d Inode: 389160 Links: 1 2023-07-12T02:01:20.994 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-12T02:01:20.995 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2023-07-12T02:01:20.995 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2023-07-12 01:57:56.387929479 +0000 2023-07-12T02:01:20.995 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2023-07-12 01:50:03.400230080 +0000 2023-07-12T02:01:20.995 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2023-07-12 01:50:03.400230080 +0000 2023-07-12T02:01:20.995 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2023-07-12T02:01:20.995 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-12T02:01:21.064 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2023-07-12T02:01:21.065 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2023-07-12T02:01:21.065 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000238503 s, 2.1 MB/s 2023-07-12T02:01:21.066 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-12T02:01:21.126 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_2 2023-07-12T02:01:21.185 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-12T02:01:21.186 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-12T02:01:21.186 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 6h/6d Inode: 378571 Links: 1 2023-07-12T02:01:21.186 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-12T02:01:21.186 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2023-07-12T02:01:21.186 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2023-07-12 01:57:56.387929479 +0000 2023-07-12T02:01:21.186 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2023-07-12 01:50:03.923217626 +0000 2023-07-12T02:01:21.186 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2023-07-12 01:50:03.923217626 +0000 2023-07-12T02:01:21.187 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2023-07-12T02:01:21.187 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-12T02:01:21.253 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2023-07-12T02:01:21.253 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2023-07-12T02:01:21.253 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000223552 s, 2.3 MB/s 2023-07-12T02:01:21.254 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-12T02:01:21.314 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_3 2023-07-12T02:01:21.372 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-12T02:01:21.372 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-12T02:01:21.373 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 6h/6d Inode: 378704 Links: 1 2023-07-12T02:01:21.373 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-12T02:01:21.373 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2023-07-12T02:01:21.373 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2023-07-12 01:57:56.387929479 +0000 2023-07-12T02:01:21.373 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2023-07-12 01:50:04.441205292 +0000 2023-07-12T02:01:21.373 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2023-07-12 01:50:04.441205292 +0000 2023-07-12T02:01:21.373 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2023-07-12T02:01:21.374 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-12T02:01:21.439 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2023-07-12T02:01:21.439 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2023-07-12T02:01:21.439 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000219312 s, 2.3 MB/s 2023-07-12T02:01:21.440 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-12T02:01:21.499 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_4 2023-07-12T02:01:21.557 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-12T02:01:21.557 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-12T02:01:21.557 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 6h/6d Inode: 389323 Links: 1 2023-07-12T02:01:21.558 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-12T02:01:21.558 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2023-07-12T02:01:21.558 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2023-07-12 01:57:56.387929479 +0000 2023-07-12T02:01:21.558 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2023-07-12 01:50:04.961192910 +0000 2023-07-12T02:01:21.558 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2023-07-12 01:50:04.961192910 +0000 2023-07-12T02:01:21.558 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2023-07-12T02:01:21.559 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-12T02:01:21.623 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2023-07-12T02:01:21.623 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2023-07-12T02:01:21.623 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000230423 s, 2.2 MB/s 2023-07-12T02:01:21.624 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-12T02:01:21.682 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-12T02:01:21.683 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi060.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi079.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-12T02:01:21.683 INFO:tasks.ceph:Generating config... 2023-07-12T02:01:21.684 INFO:tasks.ceph:[client] client mount timeout = 600 2023-07-12T02:01:21.685 INFO:tasks.ceph:[client] debug client = 20 2023-07-12T02:01:21.685 INFO:tasks.ceph:[client] debug ms = 1 2023-07-12T02:01:21.685 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-07-12T02:01:21.685 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-07-12T02:01:21.685 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2023-07-12T02:01:21.686 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-07-12T02:01:21.686 INFO:tasks.ceph:[mds] debug mds = 20 2023-07-12T02:01:21.686 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-07-12T02:01:21.686 INFO:tasks.ceph:[mds] debug ms = 1 2023-07-12T02:01:21.687 INFO:tasks.ceph:[mds] mds debug frag = True 2023-07-12T02:01:21.687 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-07-12T02:01:21.687 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-07-12T02:01:21.687 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-07-12T02:01:21.687 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-07-12T02:01:21.688 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-07-12T02:01:21.688 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-07-12T02:01:21.688 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-07-12T02:01:21.688 INFO:tasks.ceph:[mgr] debug ms = 1 2023-07-12T02:01:21.688 INFO:tasks.ceph:[mon] debug mon = 20 2023-07-12T02:01:21.689 INFO:tasks.ceph:[mon] debug ms = 1 2023-07-12T02:01:21.689 INFO:tasks.ceph:[mon] debug paxos = 20 2023-07-12T02:01:21.689 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-07-12T02:01:21.689 INFO:tasks.ceph:[osd] bdev async discard = True 2023-07-12T02:01:21.689 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-07-12T02:01:21.689 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-07-12T02:01:21.690 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-07-12T02:01:21.690 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-07-12T02:01:21.690 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-07-12T02:01:21.690 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-07-12T02:01:21.690 INFO:tasks.ceph:[osd] debug ms = 1 2023-07-12T02:01:21.691 INFO:tasks.ceph:[osd] debug osd = 20 2023-07-12T02:01:21.691 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-07-12T02:01:21.691 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-07-12T02:01:21.691 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-07-12T02:01:21.691 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-07-12T02:01:21.692 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-07-12T02:01:21.692 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-07-12T02:01:21.692 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-07-12T02:01:21.692 INFO:tasks.ceph:Setting up mon.a... 2023-07-12T02:01:21.693 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-07-12T02:01:21.763 INFO:teuthology.orchestra.run.smithi060.stdout:creating /etc/ceph/ceph.keyring 2023-07-12T02:01:21.766 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-07-12T02:01:21.817 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-12T02:01:21.846 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.60'), ('mon.b', '172.21.15.79'), ('mon.c', '[v2:172.21.15.79:3301,v1:172.21.15.79:6790]')] 2023-07-12T02:01:21.847 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.60,172.21.15.79,[v2:172.21.15.79:3301,v1:172.21.15.79:6790]', 'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-07-12T02:01:21.848 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-07-12T02:01:21.848 DEBUG:teuthology.orchestra.run.smithi060:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-07-12T02:01:21.905 DEBUG:teuthology.orchestra.run.smithi060:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.60 --add b 172.21.15.79 --addv c '[v2:172.21.15.79:3301,v1:172.21.15.79:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-07-12T02:01:21.995 INFO:teuthology.orchestra.run.smithi060.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-07-12T02:01:21.995 INFO:teuthology.orchestra.run.smithi060.stdout:monmaptool: generated fsid 97e7c909-e567-472e-a5aa-72fde15171f2 2023-07-12T02:01:21.995 INFO:teuthology.orchestra.run.smithi060.stdout:setting min_mon_release = pacific 2023-07-12T02:01:21.995 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 0 2023-07-12T02:01:21.996 INFO:teuthology.orchestra.run.smithi060.stdout:fsid 97e7c909-e567-472e-a5aa-72fde15171f2 2023-07-12T02:01:21.996 INFO:teuthology.orchestra.run.smithi060.stdout:last_changed 2023-07-12T02:01:21.993079+0000 2023-07-12T02:01:21.996 INFO:teuthology.orchestra.run.smithi060.stdout:created 2023-07-12T02:01:21.993079+0000 2023-07-12T02:01:21.996 INFO:teuthology.orchestra.run.smithi060.stdout:min_mon_release 16 (pacific) 2023-07-12T02:01:21.996 INFO:teuthology.orchestra.run.smithi060.stdout:election_strategy: 1 2023-07-12T02:01:21.996 INFO:teuthology.orchestra.run.smithi060.stdout:0: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.a 2023-07-12T02:01:21.996 INFO:teuthology.orchestra.run.smithi060.stdout:1: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.b 2023-07-12T02:01:21.997 INFO:teuthology.orchestra.run.smithi060.stdout:2: [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] mon.c 2023-07-12T02:01:21.997 INFO:teuthology.orchestra.run.smithi060.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-07-12T02:01:21.998 DEBUG:teuthology.orchestra.run.smithi060:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-07-12T02:01:22.015 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 97e7c909-e567-472e-a5aa-72fde15171f2... 2023-07-12T02:01:22.017 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-12T02:01:22.058 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-12T02:01:22.060 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-12T02:01:22.101 INFO:teuthology.orchestra.run.smithi060.stdout:[global] 2023-07-12T02:01:22.102 INFO:teuthology.orchestra.run.smithi060.stdout: chdir = "" 2023-07-12T02:01:22.102 INFO:teuthology.orchestra.run.smithi060.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-12T02:01:22.102 INFO:teuthology.orchestra.run.smithi060.stdout: auth supported = cephx 2023-07-12T02:01:22.102 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:01:22.102 INFO:teuthology.orchestra.run.smithi060.stdout: filestore xattr use omap = true 2023-07-12T02:01:22.102 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:01:22.102 INFO:teuthology.orchestra.run.smithi060.stdout: mon clock drift allowed = 1.000 2023-07-12T02:01:22.103 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:01:22.103 INFO:teuthology.orchestra.run.smithi060.stdout: osd crush chooseleaf type = 0 2023-07-12T02:01:22.103 INFO:teuthology.orchestra.run.smithi060.stdout: auth debug = true 2023-07-12T02:01:22.103 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:01:22.103 INFO:teuthology.orchestra.run.smithi060.stdout: ms die on old message = true 2023-07-12T02:01:22.103 INFO:teuthology.orchestra.run.smithi060.stdout: ms die on bug = true 2023-07-12T02:01:22.103 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:01:22.103 INFO:teuthology.orchestra.run.smithi060.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-12T02:01:22.104 INFO:teuthology.orchestra.run.smithi060.stdout: mon pg warn max object skew = 0 2023-07-12T02:01:22.104 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:01:22.104 INFO:teuthology.orchestra.run.smithi060.stdout: # disable pg_autoscaler by default for new pools 2023-07-12T02:01:22.104 INFO:teuthology.orchestra.run.smithi060.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-12T02:01:22.104 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:01:22.104 INFO:teuthology.orchestra.run.smithi060.stdout: osd pool default size = 2 2023-07-12T02:01:22.104 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:01:22.105 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd allow primary affinity = true 2023-07-12T02:01:22.105 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd allow pg remap = true 2023-07-12T02:01:22.105 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on legacy crush tunables = false 2023-07-12T02:01:22.105 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on crush straw calc version zero = false 2023-07-12T02:01:22.105 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on no sortbitwise = false 2023-07-12T02:01:22.105 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on osd down out interval zero = false 2023-07-12T02:01:22.105 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on too few osds = false 2023-07-12T02:01:22.106 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-12T02:01:22.106 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-12T02:01:22.106 INFO:teuthology.orchestra.run.smithi060.stdout: mon_allow_pool_size_one = true 2023-07-12T02:01:22.106 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:01:22.106 INFO:teuthology.orchestra.run.smithi060.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-12T02:01:22.106 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:01:22.106 INFO:teuthology.orchestra.run.smithi060.stdout: osd default data pool replay window = 5 2023-07-12T02:01:22.106 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:01:22.107 INFO:teuthology.orchestra.run.smithi060.stdout: mon allow pool delete = true 2023-07-12T02:01:22.107 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:01:22.107 INFO:teuthology.orchestra.run.smithi060.stdout: mon cluster log file level = debug 2023-07-12T02:01:22.107 INFO:teuthology.orchestra.run.smithi060.stdout: debug asserts on shutdown = true 2023-07-12T02:01:22.107 INFO:teuthology.orchestra.run.smithi060.stdout: mon health detail to clog = false 2023-07-12T02:01:22.107 INFO:teuthology.orchestra.run.smithi060.stdout: mon host = "172.21.15.60,172.21.15.79,[v2:172.21.15.79:3301,v1:172.21.15.79:6790]" 2023-07-12T02:01:22.107 INFO:teuthology.orchestra.run.smithi060.stdout: mon pg warn min per osd = 0 2023-07-12T02:01:22.107 INFO:teuthology.orchestra.run.smithi060.stdout: ms die on skipped message = False 2023-07-12T02:01:22.108 INFO:teuthology.orchestra.run.smithi060.stdout: fsid = 97e7c909-e567-472e-a5aa-72fde15171f2 2023-07-12T02:01:22.108 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:01:22.108 INFO:teuthology.orchestra.run.smithi060.stdout:[osd] 2023-07-12T02:01:22.108 INFO:teuthology.orchestra.run.smithi060.stdout: osd journal size = 100 2023-07-12T02:01:22.108 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:01:22.108 INFO:teuthology.orchestra.run.smithi060.stdout: osd scrub load threshold = 5.0 2023-07-12T02:01:22.108 INFO:teuthology.orchestra.run.smithi060.stdout: osd scrub max interval = 600 2023-07-12T02:01:22.109 INFO:teuthology.orchestra.run.smithi060.stdout: osd mclock profile = high_recovery_ops 2023-07-12T02:01:22.109 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:01:22.109 INFO:teuthology.orchestra.run.smithi060.stdout: osd recover clone overlap = true 2023-07-12T02:01:22.109 INFO:teuthology.orchestra.run.smithi060.stdout: osd recovery max chunk = 1048576 2023-07-12T02:01:22.109 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:01:22.109 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug shutdown = true 2023-07-12T02:01:22.109 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug op order = true 2023-07-12T02:01:22.109 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug verify stray on activate = true 2023-07-12T02:01:22.110 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:01:22.110 INFO:teuthology.orchestra.run.smithi060.stdout: osd open classes on start = true 2023-07-12T02:01:22.110 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug pg log writeout = true 2023-07-12T02:01:22.110 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:01:22.110 INFO:teuthology.orchestra.run.smithi060.stdout: osd deep scrub update digest min age = 30 2023-07-12T02:01:22.110 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:01:22.110 INFO:teuthology.orchestra.run.smithi060.stdout: osd map max advance = 10 2023-07-12T02:01:22.111 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:01:22.111 INFO:teuthology.orchestra.run.smithi060.stdout: journal zero on create = true 2023-07-12T02:01:22.111 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:01:22.111 INFO:teuthology.orchestra.run.smithi060.stdout: filestore ondisk finisher threads = 3 2023-07-12T02:01:22.111 INFO:teuthology.orchestra.run.smithi060.stdout: filestore apply finisher threads = 3 2023-07-12T02:01:22.111 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:01:22.111 INFO:teuthology.orchestra.run.smithi060.stdout: bdev debug aio = true 2023-07-12T02:01:22.111 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug misdirected ops = true 2023-07-12T02:01:22.112 INFO:teuthology.orchestra.run.smithi060.stdout: bdev async discard = True 2023-07-12T02:01:22.112 INFO:teuthology.orchestra.run.smithi060.stdout: bdev enable discard = True 2023-07-12T02:01:22.112 INFO:teuthology.orchestra.run.smithi060.stdout: bluestore allocator = bitmap 2023-07-12T02:01:22.112 INFO:teuthology.orchestra.run.smithi060.stdout: bluestore block size = 96636764160 2023-07-12T02:01:22.112 INFO:teuthology.orchestra.run.smithi060.stdout: bluestore fsck on mount = True 2023-07-12T02:01:22.112 INFO:teuthology.orchestra.run.smithi060.stdout: debug bluefs = 1/20 2023-07-12T02:01:22.112 INFO:teuthology.orchestra.run.smithi060.stdout: debug bluestore = 1/20 2023-07-12T02:01:22.112 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2023-07-12T02:01:22.113 INFO:teuthology.orchestra.run.smithi060.stdout: debug osd = 20 2023-07-12T02:01:22.113 INFO:teuthology.orchestra.run.smithi060.stdout: debug rocksdb = 4/10 2023-07-12T02:01:22.113 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd backfillfull_ratio = 0.85 2023-07-12T02:01:22.113 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd full ratio = 0.9 2023-07-12T02:01:22.113 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd nearfull ratio = 0.8 2023-07-12T02:01:22.113 INFO:teuthology.orchestra.run.smithi060.stdout: osd failsafe full ratio = 0.95 2023-07-12T02:01:22.113 INFO:teuthology.orchestra.run.smithi060.stdout: osd objectstore = bluestore 2023-07-12T02:01:22.113 INFO:teuthology.orchestra.run.smithi060.stdout: osd op complaint time = 180 2023-07-12T02:01:22.114 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:01:22.114 INFO:teuthology.orchestra.run.smithi060.stdout:[mgr] 2023-07-12T02:01:22.114 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2023-07-12T02:01:22.114 INFO:teuthology.orchestra.run.smithi060.stdout: debug mgr = 20 2023-07-12T02:01:22.114 INFO:teuthology.orchestra.run.smithi060.stdout: debug mon = 20 2023-07-12T02:01:22.114 INFO:teuthology.orchestra.run.smithi060.stdout: debug auth = 20 2023-07-12T02:01:22.114 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min pgs per osd = 4 2023-07-12T02:01:22.114 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min bytes per osd = 10 2023-07-12T02:01:22.115 INFO:teuthology.orchestra.run.smithi060.stdout: mgr/telemetry/nag = false 2023-07-12T02:01:22.115 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:01:22.115 INFO:teuthology.orchestra.run.smithi060.stdout:[mon] 2023-07-12T02:01:22.115 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2023-07-12T02:01:22.115 INFO:teuthology.orchestra.run.smithi060.stdout: debug mon = 20 2023-07-12T02:01:22.115 INFO:teuthology.orchestra.run.smithi060.stdout: debug paxos = 20 2023-07-12T02:01:22.115 INFO:teuthology.orchestra.run.smithi060.stdout: debug auth = 20 2023-07-12T02:01:22.115 INFO:teuthology.orchestra.run.smithi060.stdout: mon data avail warn = 5 2023-07-12T02:01:22.116 INFO:teuthology.orchestra.run.smithi060.stdout: mon mgr mkfs grace = 240 2023-07-12T02:01:22.116 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min pgs per osd = 4 2023-07-12T02:01:22.116 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd reporter subtree level = osd 2023-07-12T02:01:22.116 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd prime pg temp = true 2023-07-12T02:01:22.116 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min bytes per osd = 10 2023-07-12T02:01:22.116 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:01:22.117 INFO:teuthology.orchestra.run.smithi060.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-12T02:01:22.117 INFO:teuthology.orchestra.run.smithi060.stdout: auth mon ticket ttl = 660 # 11m 2023-07-12T02:01:22.117 INFO:teuthology.orchestra.run.smithi060.stdout: auth service ticket ttl = 240 # 4m 2023-07-12T02:01:22.117 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:01:22.117 INFO:teuthology.orchestra.run.smithi060.stdout: # don't complain about insecure global_id in the test suite 2023-07-12T02:01:22.117 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-12T02:01:22.117 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-12T02:01:22.117 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:01:22.118 INFO:teuthology.orchestra.run.smithi060.stdout: # 1m isn't quite enough 2023-07-12T02:01:22.118 INFO:teuthology.orchestra.run.smithi060.stdout: mon_down_mkfs_grace = 2m 2023-07-12T02:01:22.118 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:01:22.118 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_filestore_osds = false 2023-07-12T02:01:22.118 INFO:teuthology.orchestra.run.smithi060.stdout: mon op complaint time = 120 2023-07-12T02:01:22.118 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:01:22.118 INFO:teuthology.orchestra.run.smithi060.stdout:[client] 2023-07-12T02:01:22.119 INFO:teuthology.orchestra.run.smithi060.stdout: rgw cache enabled = true 2023-07-12T02:01:22.119 INFO:teuthology.orchestra.run.smithi060.stdout: rgw enable ops log = true 2023-07-12T02:01:22.119 INFO:teuthology.orchestra.run.smithi060.stdout: rgw enable usage log = true 2023-07-12T02:01:22.119 INFO:teuthology.orchestra.run.smithi060.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-12T02:01:22.119 INFO:teuthology.orchestra.run.smithi060.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-12T02:01:22.119 INFO:teuthology.orchestra.run.smithi060.stdout: client mount timeout = 600 2023-07-12T02:01:22.119 INFO:teuthology.orchestra.run.smithi060.stdout: debug client = 20 2023-07-12T02:01:22.119 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2023-07-12T02:01:22.120 INFO:teuthology.orchestra.run.smithi060.stdout: rados mon op timeout = 900 2023-07-12T02:01:22.120 INFO:teuthology.orchestra.run.smithi060.stdout: rados osd op timeout = 900 2023-07-12T02:01:22.120 INFO:teuthology.orchestra.run.smithi060.stdout:[mon.a] 2023-07-12T02:01:22.120 INFO:teuthology.orchestra.run.smithi060.stdout:[mon.b] 2023-07-12T02:01:22.120 INFO:teuthology.orchestra.run.smithi060.stdout:[mon.c] 2023-07-12T02:01:22.120 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.a] 2023-07-12T02:01:22.120 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.c] 2023-07-12T02:01:22.121 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.b] 2023-07-12T02:01:22.121 INFO:teuthology.orchestra.run.smithi060.stdout:[mds] 2023-07-12T02:01:22.121 INFO:teuthology.orchestra.run.smithi060.stdout: debug mds = 20 2023-07-12T02:01:22.121 INFO:teuthology.orchestra.run.smithi060.stdout: debug mds balancer = 20 2023-07-12T02:01:22.121 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2023-07-12T02:01:22.121 INFO:teuthology.orchestra.run.smithi060.stdout: mds debug frag = True 2023-07-12T02:01:22.121 INFO:teuthology.orchestra.run.smithi060.stdout: mds debug scatterstat = True 2023-07-12T02:01:22.121 INFO:teuthology.orchestra.run.smithi060.stdout: mds op complaint time = 180 2023-07-12T02:01:22.122 INFO:teuthology.orchestra.run.smithi060.stdout: mds verify scatter = True 2023-07-12T02:01:22.122 INFO:teuthology.orchestra.run.smithi060.stdout: osd op complaint time = 180 2023-07-12T02:01:22.122 INFO:teuthology.orchestra.run.smithi060.stdout: rados mon op timeout = 900 2023-07-12T02:01:22.122 INFO:teuthology.orchestra.run.smithi060.stdout: rados osd op timeout = 900 2023-07-12T02:01:22.123 INFO:teuthology.orchestra.run.smithi079.stdout:[global] 2023-07-12T02:01:22.123 INFO:teuthology.orchestra.run.smithi079.stdout: chdir = "" 2023-07-12T02:01:22.123 INFO:teuthology.orchestra.run.smithi079.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-12T02:01:22.123 INFO:teuthology.orchestra.run.smithi079.stdout: auth supported = cephx 2023-07-12T02:01:22.124 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-07-12T02:01:22.124 INFO:teuthology.orchestra.run.smithi079.stdout: filestore xattr use omap = true 2023-07-12T02:01:22.124 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-07-12T02:01:22.124 INFO:teuthology.orchestra.run.smithi079.stdout: mon clock drift allowed = 1.000 2023-07-12T02:01:22.124 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-07-12T02:01:22.124 INFO:teuthology.orchestra.run.smithi079.stdout: osd crush chooseleaf type = 0 2023-07-12T02:01:22.124 INFO:teuthology.orchestra.run.smithi079.stdout: auth debug = true 2023-07-12T02:01:22.125 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-07-12T02:01:22.125 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on old message = true 2023-07-12T02:01:22.125 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on bug = true 2023-07-12T02:01:22.125 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-07-12T02:01:22.125 INFO:teuthology.orchestra.run.smithi079.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-12T02:01:22.125 INFO:teuthology.orchestra.run.smithi079.stdout: mon pg warn max object skew = 0 2023-07-12T02:01:22.125 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-07-12T02:01:22.125 INFO:teuthology.orchestra.run.smithi079.stdout: # disable pg_autoscaler by default for new pools 2023-07-12T02:01:22.126 INFO:teuthology.orchestra.run.smithi079.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-12T02:01:22.126 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-07-12T02:01:22.126 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default size = 2 2023-07-12T02:01:22.126 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-07-12T02:01:22.126 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow primary affinity = true 2023-07-12T02:01:22.126 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow pg remap = true 2023-07-12T02:01:22.126 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on legacy crush tunables = false 2023-07-12T02:01:22.127 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on crush straw calc version zero = false 2023-07-12T02:01:22.127 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on no sortbitwise = false 2023-07-12T02:01:22.127 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on osd down out interval zero = false 2023-07-12T02:01:22.127 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on too few osds = false 2023-07-12T02:01:22.127 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-12T02:01:22.127 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-12T02:01:22.127 INFO:teuthology.orchestra.run.smithi079.stdout: mon_allow_pool_size_one = true 2023-07-12T02:01:22.127 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-07-12T02:01:22.128 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-12T02:01:22.128 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-07-12T02:01:22.128 INFO:teuthology.orchestra.run.smithi079.stdout: osd default data pool replay window = 5 2023-07-12T02:01:22.128 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-07-12T02:01:22.128 INFO:teuthology.orchestra.run.smithi079.stdout: mon allow pool delete = true 2023-07-12T02:01:22.128 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-07-12T02:01:22.128 INFO:teuthology.orchestra.run.smithi079.stdout: mon cluster log file level = debug 2023-07-12T02:01:22.129 INFO:teuthology.orchestra.run.smithi079.stdout: debug asserts on shutdown = true 2023-07-12T02:01:22.129 INFO:teuthology.orchestra.run.smithi079.stdout: mon health detail to clog = false 2023-07-12T02:01:22.129 INFO:teuthology.orchestra.run.smithi079.stdout: mon host = "172.21.15.60,172.21.15.79,[v2:172.21.15.79:3301,v1:172.21.15.79:6790]" 2023-07-12T02:01:22.129 INFO:teuthology.orchestra.run.smithi079.stdout: mon pg warn min per osd = 0 2023-07-12T02:01:22.129 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on skipped message = False 2023-07-12T02:01:22.129 INFO:teuthology.orchestra.run.smithi079.stdout: fsid = 97e7c909-e567-472e-a5aa-72fde15171f2 2023-07-12T02:01:22.129 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-07-12T02:01:22.129 INFO:teuthology.orchestra.run.smithi079.stdout:[osd] 2023-07-12T02:01:22.130 INFO:teuthology.orchestra.run.smithi079.stdout: osd journal size = 100 2023-07-12T02:01:22.130 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-07-12T02:01:22.130 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub load threshold = 5.0 2023-07-12T02:01:22.130 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub max interval = 600 2023-07-12T02:01:22.130 INFO:teuthology.orchestra.run.smithi079.stdout: osd mclock profile = high_recovery_ops 2023-07-12T02:01:22.130 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-07-12T02:01:22.130 INFO:teuthology.orchestra.run.smithi079.stdout: osd recover clone overlap = true 2023-07-12T02:01:22.130 INFO:teuthology.orchestra.run.smithi079.stdout: osd recovery max chunk = 1048576 2023-07-12T02:01:22.131 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-07-12T02:01:22.131 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug shutdown = true 2023-07-12T02:01:22.131 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug op order = true 2023-07-12T02:01:22.131 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug verify stray on activate = true 2023-07-12T02:01:22.131 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-07-12T02:01:22.131 INFO:teuthology.orchestra.run.smithi079.stdout: osd open classes on start = true 2023-07-12T02:01:22.131 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug pg log writeout = true 2023-07-12T02:01:22.131 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-07-12T02:01:22.132 INFO:teuthology.orchestra.run.smithi079.stdout: osd deep scrub update digest min age = 30 2023-07-12T02:01:22.132 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-07-12T02:01:22.132 INFO:teuthology.orchestra.run.smithi079.stdout: osd map max advance = 10 2023-07-12T02:01:22.132 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-07-12T02:01:22.132 INFO:teuthology.orchestra.run.smithi079.stdout: journal zero on create = true 2023-07-12T02:01:22.132 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-07-12T02:01:22.132 INFO:teuthology.orchestra.run.smithi079.stdout: filestore ondisk finisher threads = 3 2023-07-12T02:01:22.132 INFO:teuthology.orchestra.run.smithi079.stdout: filestore apply finisher threads = 3 2023-07-12T02:01:22.133 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-07-12T02:01:22.133 INFO:teuthology.orchestra.run.smithi079.stdout: bdev debug aio = true 2023-07-12T02:01:22.133 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug misdirected ops = true 2023-07-12T02:01:22.133 INFO:teuthology.orchestra.run.smithi079.stdout: bdev async discard = True 2023-07-12T02:01:22.133 INFO:teuthology.orchestra.run.smithi079.stdout: bdev enable discard = True 2023-07-12T02:01:22.133 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore allocator = bitmap 2023-07-12T02:01:22.133 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore block size = 96636764160 2023-07-12T02:01:22.133 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore fsck on mount = True 2023-07-12T02:01:22.134 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluefs = 1/20 2023-07-12T02:01:22.134 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluestore = 1/20 2023-07-12T02:01:22.134 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2023-07-12T02:01:22.134 INFO:teuthology.orchestra.run.smithi079.stdout: debug osd = 20 2023-07-12T02:01:22.134 INFO:teuthology.orchestra.run.smithi079.stdout: debug rocksdb = 4/10 2023-07-12T02:01:22.134 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd backfillfull_ratio = 0.85 2023-07-12T02:01:22.134 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd full ratio = 0.9 2023-07-12T02:01:22.134 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd nearfull ratio = 0.8 2023-07-12T02:01:22.135 INFO:teuthology.orchestra.run.smithi079.stdout: osd failsafe full ratio = 0.95 2023-07-12T02:01:22.135 INFO:teuthology.orchestra.run.smithi079.stdout: osd objectstore = bluestore 2023-07-12T02:01:22.135 INFO:teuthology.orchestra.run.smithi079.stdout: osd op complaint time = 180 2023-07-12T02:01:22.135 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-07-12T02:01:22.135 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr] 2023-07-12T02:01:22.135 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2023-07-12T02:01:22.135 INFO:teuthology.orchestra.run.smithi079.stdout: debug mgr = 20 2023-07-12T02:01:22.135 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2023-07-12T02:01:22.136 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2023-07-12T02:01:22.136 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2023-07-12T02:01:22.136 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2023-07-12T02:01:22.136 INFO:teuthology.orchestra.run.smithi079.stdout: mgr/telemetry/nag = false 2023-07-12T02:01:22.136 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-07-12T02:01:22.136 INFO:teuthology.orchestra.run.smithi079.stdout:[mon] 2023-07-12T02:01:22.136 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2023-07-12T02:01:22.136 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2023-07-12T02:01:22.137 INFO:teuthology.orchestra.run.smithi079.stdout: debug paxos = 20 2023-07-12T02:01:22.137 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2023-07-12T02:01:22.137 INFO:teuthology.orchestra.run.smithi079.stdout: mon data avail warn = 5 2023-07-12T02:01:22.137 INFO:teuthology.orchestra.run.smithi079.stdout: mon mgr mkfs grace = 240 2023-07-12T02:01:22.137 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2023-07-12T02:01:22.137 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd reporter subtree level = osd 2023-07-12T02:01:22.137 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd prime pg temp = true 2023-07-12T02:01:22.137 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2023-07-12T02:01:22.138 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-07-12T02:01:22.138 INFO:teuthology.orchestra.run.smithi079.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-12T02:01:22.138 INFO:teuthology.orchestra.run.smithi079.stdout: auth mon ticket ttl = 660 # 11m 2023-07-12T02:01:22.138 INFO:teuthology.orchestra.run.smithi079.stdout: auth service ticket ttl = 240 # 4m 2023-07-12T02:01:22.138 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-07-12T02:01:22.138 INFO:teuthology.orchestra.run.smithi079.stdout: # don't complain about insecure global_id in the test suite 2023-07-12T02:01:22.138 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-12T02:01:22.138 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-12T02:01:22.139 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-07-12T02:01:22.139 INFO:teuthology.orchestra.run.smithi079.stdout: # 1m isn't quite enough 2023-07-12T02:01:22.139 INFO:teuthology.orchestra.run.smithi079.stdout: mon_down_mkfs_grace = 2m 2023-07-12T02:01:22.139 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-07-12T02:01:22.139 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_filestore_osds = false 2023-07-12T02:01:22.139 INFO:teuthology.orchestra.run.smithi079.stdout: mon op complaint time = 120 2023-07-12T02:01:22.139 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-07-12T02:01:22.139 INFO:teuthology.orchestra.run.smithi079.stdout:[client] 2023-07-12T02:01:22.140 INFO:teuthology.orchestra.run.smithi079.stdout: rgw cache enabled = true 2023-07-12T02:01:22.140 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable ops log = true 2023-07-12T02:01:22.140 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable usage log = true 2023-07-12T02:01:22.140 INFO:teuthology.orchestra.run.smithi079.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-12T02:01:22.140 INFO:teuthology.orchestra.run.smithi079.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-12T02:01:22.140 INFO:teuthology.orchestra.run.smithi079.stdout: client mount timeout = 600 2023-07-12T02:01:22.140 INFO:teuthology.orchestra.run.smithi079.stdout: debug client = 20 2023-07-12T02:01:22.141 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2023-07-12T02:01:22.141 INFO:teuthology.orchestra.run.smithi079.stdout: rados mon op timeout = 900 2023-07-12T02:01:22.141 INFO:teuthology.orchestra.run.smithi079.stdout: rados osd op timeout = 900 2023-07-12T02:01:22.141 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.a] 2023-07-12T02:01:22.141 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.b] 2023-07-12T02:01:22.141 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.c] 2023-07-12T02:01:22.141 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.a] 2023-07-12T02:01:22.141 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.c] 2023-07-12T02:01:22.141 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.b] 2023-07-12T02:01:22.142 INFO:teuthology.orchestra.run.smithi079.stdout:[mds] 2023-07-12T02:01:22.142 INFO:teuthology.orchestra.run.smithi079.stdout: debug mds = 20 2023-07-12T02:01:22.142 INFO:teuthology.orchestra.run.smithi079.stdout: debug mds balancer = 20 2023-07-12T02:01:22.142 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2023-07-12T02:01:22.142 INFO:teuthology.orchestra.run.smithi079.stdout: mds debug frag = True 2023-07-12T02:01:22.142 INFO:teuthology.orchestra.run.smithi079.stdout: mds debug scatterstat = True 2023-07-12T02:01:22.142 INFO:teuthology.orchestra.run.smithi079.stdout: mds op complaint time = 180 2023-07-12T02:01:22.143 INFO:teuthology.orchestra.run.smithi079.stdout: mds verify scatter = True 2023-07-12T02:01:22.143 INFO:teuthology.orchestra.run.smithi079.stdout: osd op complaint time = 180 2023-07-12T02:01:22.143 INFO:teuthology.orchestra.run.smithi079.stdout: rados mon op timeout = 900 2023-07-12T02:01:22.143 INFO:teuthology.orchestra.run.smithi079.stdout: rados osd op timeout = 900 2023-07-12T02:01:22.178 INFO:teuthology.orchestra.run.smithi174.stdout:[global] 2023-07-12T02:01:22.179 INFO:teuthology.orchestra.run.smithi174.stdout: chdir = "" 2023-07-12T02:01:22.179 INFO:teuthology.orchestra.run.smithi174.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-12T02:01:22.179 INFO:teuthology.orchestra.run.smithi174.stdout: auth supported = cephx 2023-07-12T02:01:22.179 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T02:01:22.179 INFO:teuthology.orchestra.run.smithi174.stdout: filestore xattr use omap = true 2023-07-12T02:01:22.179 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T02:01:22.179 INFO:teuthology.orchestra.run.smithi174.stdout: mon clock drift allowed = 1.000 2023-07-12T02:01:22.180 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T02:01:22.180 INFO:teuthology.orchestra.run.smithi174.stdout: osd crush chooseleaf type = 0 2023-07-12T02:01:22.180 INFO:teuthology.orchestra.run.smithi174.stdout: auth debug = true 2023-07-12T02:01:22.180 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T02:01:22.180 INFO:teuthology.orchestra.run.smithi174.stdout: ms die on old message = true 2023-07-12T02:01:22.180 INFO:teuthology.orchestra.run.smithi174.stdout: ms die on bug = true 2023-07-12T02:01:22.180 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T02:01:22.181 INFO:teuthology.orchestra.run.smithi174.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-12T02:01:22.181 INFO:teuthology.orchestra.run.smithi174.stdout: mon pg warn max object skew = 0 2023-07-12T02:01:22.181 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T02:01:22.181 INFO:teuthology.orchestra.run.smithi174.stdout: # disable pg_autoscaler by default for new pools 2023-07-12T02:01:22.181 INFO:teuthology.orchestra.run.smithi174.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-12T02:01:22.181 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T02:01:22.181 INFO:teuthology.orchestra.run.smithi174.stdout: osd pool default size = 2 2023-07-12T02:01:22.181 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T02:01:22.182 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd allow primary affinity = true 2023-07-12T02:01:22.182 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd allow pg remap = true 2023-07-12T02:01:22.182 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on legacy crush tunables = false 2023-07-12T02:01:22.182 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on crush straw calc version zero = false 2023-07-12T02:01:22.182 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on no sortbitwise = false 2023-07-12T02:01:22.182 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on osd down out interval zero = false 2023-07-12T02:01:22.182 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on too few osds = false 2023-07-12T02:01:22.182 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-12T02:01:22.183 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-12T02:01:22.183 INFO:teuthology.orchestra.run.smithi174.stdout: mon_allow_pool_size_one = true 2023-07-12T02:01:22.183 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T02:01:22.183 INFO:teuthology.orchestra.run.smithi174.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-12T02:01:22.183 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T02:01:22.183 INFO:teuthology.orchestra.run.smithi174.stdout: osd default data pool replay window = 5 2023-07-12T02:01:22.183 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T02:01:22.184 INFO:teuthology.orchestra.run.smithi174.stdout: mon allow pool delete = true 2023-07-12T02:01:22.184 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T02:01:22.184 INFO:teuthology.orchestra.run.smithi174.stdout: mon cluster log file level = debug 2023-07-12T02:01:22.184 INFO:teuthology.orchestra.run.smithi174.stdout: debug asserts on shutdown = true 2023-07-12T02:01:22.184 INFO:teuthology.orchestra.run.smithi174.stdout: mon health detail to clog = false 2023-07-12T02:01:22.184 INFO:teuthology.orchestra.run.smithi174.stdout: mon host = "172.21.15.60,172.21.15.79,[v2:172.21.15.79:3301,v1:172.21.15.79:6790]" 2023-07-12T02:01:22.184 INFO:teuthology.orchestra.run.smithi174.stdout: mon pg warn min per osd = 0 2023-07-12T02:01:22.184 INFO:teuthology.orchestra.run.smithi174.stdout: ms die on skipped message = False 2023-07-12T02:01:22.185 INFO:teuthology.orchestra.run.smithi174.stdout: fsid = 97e7c909-e567-472e-a5aa-72fde15171f2 2023-07-12T02:01:22.185 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T02:01:22.185 INFO:teuthology.orchestra.run.smithi174.stdout:[osd] 2023-07-12T02:01:22.185 INFO:teuthology.orchestra.run.smithi174.stdout: osd journal size = 100 2023-07-12T02:01:22.185 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T02:01:22.185 INFO:teuthology.orchestra.run.smithi174.stdout: osd scrub load threshold = 5.0 2023-07-12T02:01:22.185 INFO:teuthology.orchestra.run.smithi174.stdout: osd scrub max interval = 600 2023-07-12T02:01:22.185 INFO:teuthology.orchestra.run.smithi174.stdout: osd mclock profile = high_recovery_ops 2023-07-12T02:01:22.186 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T02:01:22.186 INFO:teuthology.orchestra.run.smithi174.stdout: osd recover clone overlap = true 2023-07-12T02:01:22.186 INFO:teuthology.orchestra.run.smithi174.stdout: osd recovery max chunk = 1048576 2023-07-12T02:01:22.186 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T02:01:22.186 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug shutdown = true 2023-07-12T02:01:22.186 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug op order = true 2023-07-12T02:01:22.186 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug verify stray on activate = true 2023-07-12T02:01:22.186 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T02:01:22.187 INFO:teuthology.orchestra.run.smithi174.stdout: osd open classes on start = true 2023-07-12T02:01:22.187 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug pg log writeout = true 2023-07-12T02:01:22.187 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T02:01:22.187 INFO:teuthology.orchestra.run.smithi174.stdout: osd deep scrub update digest min age = 30 2023-07-12T02:01:22.187 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T02:01:22.187 INFO:teuthology.orchestra.run.smithi174.stdout: osd map max advance = 10 2023-07-12T02:01:22.187 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T02:01:22.187 INFO:teuthology.orchestra.run.smithi174.stdout: journal zero on create = true 2023-07-12T02:01:22.188 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T02:01:22.188 INFO:teuthology.orchestra.run.smithi174.stdout: filestore ondisk finisher threads = 3 2023-07-12T02:01:22.188 INFO:teuthology.orchestra.run.smithi174.stdout: filestore apply finisher threads = 3 2023-07-12T02:01:22.188 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T02:01:22.188 INFO:teuthology.orchestra.run.smithi174.stdout: bdev debug aio = true 2023-07-12T02:01:22.188 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug misdirected ops = true 2023-07-12T02:01:22.188 INFO:teuthology.orchestra.run.smithi174.stdout: bdev async discard = True 2023-07-12T02:01:22.189 INFO:teuthology.orchestra.run.smithi174.stdout: bdev enable discard = True 2023-07-12T02:01:22.189 INFO:teuthology.orchestra.run.smithi174.stdout: bluestore allocator = bitmap 2023-07-12T02:01:22.189 INFO:teuthology.orchestra.run.smithi174.stdout: bluestore block size = 96636764160 2023-07-12T02:01:22.189 INFO:teuthology.orchestra.run.smithi174.stdout: bluestore fsck on mount = True 2023-07-12T02:01:22.189 INFO:teuthology.orchestra.run.smithi174.stdout: debug bluefs = 1/20 2023-07-12T02:01:22.189 INFO:teuthology.orchestra.run.smithi174.stdout: debug bluestore = 1/20 2023-07-12T02:01:22.189 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2023-07-12T02:01:22.189 INFO:teuthology.orchestra.run.smithi174.stdout: debug osd = 20 2023-07-12T02:01:22.190 INFO:teuthology.orchestra.run.smithi174.stdout: debug rocksdb = 4/10 2023-07-12T02:01:22.190 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd backfillfull_ratio = 0.85 2023-07-12T02:01:22.190 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd full ratio = 0.9 2023-07-12T02:01:22.190 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd nearfull ratio = 0.8 2023-07-12T02:01:22.190 INFO:teuthology.orchestra.run.smithi174.stdout: osd failsafe full ratio = 0.95 2023-07-12T02:01:22.190 INFO:teuthology.orchestra.run.smithi174.stdout: osd objectstore = bluestore 2023-07-12T02:01:22.190 INFO:teuthology.orchestra.run.smithi174.stdout: osd op complaint time = 180 2023-07-12T02:01:22.190 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T02:01:22.191 INFO:teuthology.orchestra.run.smithi174.stdout:[mgr] 2023-07-12T02:01:22.191 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2023-07-12T02:01:22.191 INFO:teuthology.orchestra.run.smithi174.stdout: debug mgr = 20 2023-07-12T02:01:22.191 INFO:teuthology.orchestra.run.smithi174.stdout: debug mon = 20 2023-07-12T02:01:22.191 INFO:teuthology.orchestra.run.smithi174.stdout: debug auth = 20 2023-07-12T02:01:22.191 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min pgs per osd = 4 2023-07-12T02:01:22.191 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min bytes per osd = 10 2023-07-12T02:01:22.191 INFO:teuthology.orchestra.run.smithi174.stdout: mgr/telemetry/nag = false 2023-07-12T02:01:22.192 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T02:01:22.192 INFO:teuthology.orchestra.run.smithi174.stdout:[mon] 2023-07-12T02:01:22.192 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2023-07-12T02:01:22.192 INFO:teuthology.orchestra.run.smithi174.stdout: debug mon = 20 2023-07-12T02:01:22.192 INFO:teuthology.orchestra.run.smithi174.stdout: debug paxos = 20 2023-07-12T02:01:22.192 INFO:teuthology.orchestra.run.smithi174.stdout: debug auth = 20 2023-07-12T02:01:22.192 INFO:teuthology.orchestra.run.smithi174.stdout: mon data avail warn = 5 2023-07-12T02:01:22.192 INFO:teuthology.orchestra.run.smithi174.stdout: mon mgr mkfs grace = 240 2023-07-12T02:01:22.193 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min pgs per osd = 4 2023-07-12T02:01:22.193 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd reporter subtree level = osd 2023-07-12T02:01:22.193 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd prime pg temp = true 2023-07-12T02:01:22.193 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min bytes per osd = 10 2023-07-12T02:01:22.193 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T02:01:22.193 INFO:teuthology.orchestra.run.smithi174.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-12T02:01:22.193 INFO:teuthology.orchestra.run.smithi174.stdout: auth mon ticket ttl = 660 # 11m 2023-07-12T02:01:22.193 INFO:teuthology.orchestra.run.smithi174.stdout: auth service ticket ttl = 240 # 4m 2023-07-12T02:01:22.194 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T02:01:22.194 INFO:teuthology.orchestra.run.smithi174.stdout: # don't complain about insecure global_id in the test suite 2023-07-12T02:01:22.194 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-12T02:01:22.194 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-12T02:01:22.194 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T02:01:22.194 INFO:teuthology.orchestra.run.smithi174.stdout: # 1m isn't quite enough 2023-07-12T02:01:22.194 INFO:teuthology.orchestra.run.smithi174.stdout: mon_down_mkfs_grace = 2m 2023-07-12T02:01:22.194 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T02:01:22.195 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_filestore_osds = false 2023-07-12T02:01:22.195 INFO:teuthology.orchestra.run.smithi174.stdout: mon op complaint time = 120 2023-07-12T02:01:22.195 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T02:01:22.195 INFO:teuthology.orchestra.run.smithi174.stdout:[client] 2023-07-12T02:01:22.195 INFO:teuthology.orchestra.run.smithi174.stdout: rgw cache enabled = true 2023-07-12T02:01:22.195 INFO:teuthology.orchestra.run.smithi174.stdout: rgw enable ops log = true 2023-07-12T02:01:22.195 INFO:teuthology.orchestra.run.smithi174.stdout: rgw enable usage log = true 2023-07-12T02:01:22.195 INFO:teuthology.orchestra.run.smithi174.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-12T02:01:22.196 INFO:teuthology.orchestra.run.smithi174.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-12T02:01:22.196 INFO:teuthology.orchestra.run.smithi174.stdout: client mount timeout = 600 2023-07-12T02:01:22.196 INFO:teuthology.orchestra.run.smithi174.stdout: debug client = 20 2023-07-12T02:01:22.196 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2023-07-12T02:01:22.196 INFO:teuthology.orchestra.run.smithi174.stdout: rados mon op timeout = 900 2023-07-12T02:01:22.196 INFO:teuthology.orchestra.run.smithi174.stdout: rados osd op timeout = 900 2023-07-12T02:01:22.196 INFO:teuthology.orchestra.run.smithi174.stdout:[mon.a] 2023-07-12T02:01:22.196 INFO:teuthology.orchestra.run.smithi174.stdout:[mon.b] 2023-07-12T02:01:22.197 INFO:teuthology.orchestra.run.smithi174.stdout:[mon.c] 2023-07-12T02:01:22.197 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.a] 2023-07-12T02:01:22.197 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.c] 2023-07-12T02:01:22.197 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.b] 2023-07-12T02:01:22.197 INFO:teuthology.orchestra.run.smithi174.stdout:[mds] 2023-07-12T02:01:22.197 INFO:teuthology.orchestra.run.smithi174.stdout: debug mds = 20 2023-07-12T02:01:22.197 INFO:teuthology.orchestra.run.smithi174.stdout: debug mds balancer = 20 2023-07-12T02:01:22.197 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2023-07-12T02:01:22.198 INFO:teuthology.orchestra.run.smithi174.stdout: mds debug frag = True 2023-07-12T02:01:22.198 INFO:teuthology.orchestra.run.smithi174.stdout: mds debug scatterstat = True 2023-07-12T02:01:22.198 INFO:teuthology.orchestra.run.smithi174.stdout: mds op complaint time = 180 2023-07-12T02:01:22.198 INFO:teuthology.orchestra.run.smithi174.stdout: mds verify scatter = True 2023-07-12T02:01:22.198 INFO:teuthology.orchestra.run.smithi174.stdout: osd op complaint time = 180 2023-07-12T02:01:22.198 INFO:teuthology.orchestra.run.smithi174.stdout: rados mon op timeout = 900 2023-07-12T02:01:22.198 INFO:teuthology.orchestra.run.smithi174.stdout: rados osd op timeout = 900 2023-07-12T02:01:22.207 INFO:tasks.ceph:Creating admin key on mon.a... 2023-07-12T02:01:22.208 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-07-12T02:01:22.266 INFO:tasks.ceph:Copying monmap to all nodes... 2023-07-12T02:01:22.266 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-07-12T02:01:22.267 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-07-12T02:01:22.284 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-07-12T02:01:22.285 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-07-12T02:01:22.342 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi060.front.sepia.ceph.com 2023-07-12T02:01:22.343 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-07-12T02:01:22.343 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-12T02:01:22.343 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-12T02:01:22.420 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-07-12T02:01:22.420 DEBUG:teuthology.orchestra.run.smithi060:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-12T02:01:22.477 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi079.front.sepia.ceph.com 2023-07-12T02:01:22.478 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-07-12T02:01:22.478 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-12T02:01:22.478 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-12T02:01:22.516 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-07-12T02:01:22.516 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-12T02:01:22.574 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi174.front.sepia.ceph.com 2023-07-12T02:01:22.574 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-07-12T02:01:22.575 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-12T02:01:22.575 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-12T02:01:22.673 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-07-12T02:01:22.673 DEBUG:teuthology.orchestra.run.smithi174:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-12T02:01:22.758 INFO:tasks.ceph:Setting up mon nodes... 2023-07-12T02:01:22.759 INFO:tasks.ceph:Setting up mgr nodes... 2023-07-12T02:01:22.759 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-07-12T02:01:22.815 INFO:teuthology.orchestra.run.smithi060.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-07-12T02:01:22.818 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-07-12T02:01:22.877 INFO:teuthology.orchestra.run.smithi079.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-07-12T02:01:22.879 INFO:tasks.ceph:Setting up mds nodes... 2023-07-12T02:01:22.880 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-07-12T02:01:22.935 INFO:teuthology.orchestra.run.smithi060.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-07-12T02:01:22.938 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-07-12T02:01:22.966 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-07-12T02:01:23.061 INFO:teuthology.orchestra.run.smithi060.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-07-12T02:01:23.064 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-07-12T02:01:23.091 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-07-12T02:01:23.145 INFO:teuthology.orchestra.run.smithi079.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-07-12T02:01:23.148 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-07-12T02:01:23.174 INFO:tasks.ceph_client:Setting up client nodes... 2023-07-12T02:01:23.175 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-07-12T02:01:23.287 INFO:teuthology.orchestra.run.smithi174.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-07-12T02:01:23.317 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-07-12T02:01:23.318 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi060.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi079.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-12T02:01:23.318 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-07-12T02:01:23.346 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-12T02:01:23.346 INFO:tasks.ceph:role: osd.0 2023-07-12T02:01:23.347 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi060.front.sepia.ceph.com 2023-07-12T02:01:23.347 DEBUG:teuthology.orchestra.run.smithi060:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-12T02:01:23.414 INFO:teuthology.orchestra.run.smithi060.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-12T02:01:23.415 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-12T02:01:23.415 INFO:teuthology.orchestra.run.smithi060.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-12T02:01:23.415 INFO:teuthology.orchestra.run.smithi060.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-12T02:01:23.415 INFO:teuthology.orchestra.run.smithi060.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-12T02:01:23.415 INFO:teuthology.orchestra.run.smithi060.stdout: = sunit=0 swidth=0 blks 2023-07-12T02:01:23.415 INFO:teuthology.orchestra.run.smithi060.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-12T02:01:23.416 INFO:teuthology.orchestra.run.smithi060.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-12T02:01:23.416 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-12T02:01:23.416 INFO:teuthology.orchestra.run.smithi060.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-12T02:01:23.437 INFO:teuthology.orchestra.run.smithi060.stdout:Discarding blocks...Done. 2023-07-12T02:01:23.439 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi060.front.sepia.ceph.com -o noatime 2023-07-12T02:01:23.439 DEBUG:teuthology.orchestra.run.smithi060:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-07-12T02:01:23.520 DEBUG:teuthology.orchestra.run.smithi060:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-07-12T02:01:23.593 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-07-12T02:01:23.660 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-12T02:01:23.661 INFO:tasks.ceph:role: osd.1 2023-07-12T02:01:23.661 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi060.front.sepia.ceph.com 2023-07-12T02:01:23.661 DEBUG:teuthology.orchestra.run.smithi060:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-12T02:01:23.728 INFO:teuthology.orchestra.run.smithi060.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-12T02:01:23.728 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-12T02:01:23.728 INFO:teuthology.orchestra.run.smithi060.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-12T02:01:23.728 INFO:teuthology.orchestra.run.smithi060.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-12T02:01:23.729 INFO:teuthology.orchestra.run.smithi060.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-12T02:01:23.729 INFO:teuthology.orchestra.run.smithi060.stdout: = sunit=0 swidth=0 blks 2023-07-12T02:01:23.729 INFO:teuthology.orchestra.run.smithi060.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-12T02:01:23.729 INFO:teuthology.orchestra.run.smithi060.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-12T02:01:23.729 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-12T02:01:23.729 INFO:teuthology.orchestra.run.smithi060.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-12T02:01:23.753 INFO:teuthology.orchestra.run.smithi060.stdout:Discarding blocks...Done. 2023-07-12T02:01:23.755 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi060.front.sepia.ceph.com -o noatime 2023-07-12T02:01:23.755 DEBUG:teuthology.orchestra.run.smithi060:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-07-12T02:01:23.835 DEBUG:teuthology.orchestra.run.smithi060:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-07-12T02:01:23.906 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-07-12T02:01:23.975 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-12T02:01:23.975 INFO:tasks.ceph:role: osd.2 2023-07-12T02:01:23.975 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi060.front.sepia.ceph.com 2023-07-12T02:01:23.975 DEBUG:teuthology.orchestra.run.smithi060:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-12T02:01:24.042 INFO:teuthology.orchestra.run.smithi060.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-12T02:01:24.042 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-12T02:01:24.042 INFO:teuthology.orchestra.run.smithi060.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-12T02:01:24.042 INFO:teuthology.orchestra.run.smithi060.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-12T02:01:24.042 INFO:teuthology.orchestra.run.smithi060.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-12T02:01:24.042 INFO:teuthology.orchestra.run.smithi060.stdout: = sunit=0 swidth=0 blks 2023-07-12T02:01:24.043 INFO:teuthology.orchestra.run.smithi060.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-12T02:01:24.043 INFO:teuthology.orchestra.run.smithi060.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-12T02:01:24.043 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-12T02:01:24.043 INFO:teuthology.orchestra.run.smithi060.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-12T02:01:24.064 INFO:teuthology.orchestra.run.smithi060.stdout:Discarding blocks...Done. 2023-07-12T02:01:24.065 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi060.front.sepia.ceph.com -o noatime 2023-07-12T02:01:24.066 DEBUG:teuthology.orchestra.run.smithi060:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-07-12T02:01:24.145 DEBUG:teuthology.orchestra.run.smithi060:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-07-12T02:01:24.217 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-07-12T02:01:24.286 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-12T02:01:24.286 INFO:tasks.ceph:role: osd.3 2023-07-12T02:01:24.286 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi060.front.sepia.ceph.com 2023-07-12T02:01:24.287 DEBUG:teuthology.orchestra.run.smithi060:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-12T02:01:24.353 INFO:teuthology.orchestra.run.smithi060.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-12T02:01:24.353 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-12T02:01:24.353 INFO:teuthology.orchestra.run.smithi060.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-12T02:01:24.353 INFO:teuthology.orchestra.run.smithi060.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-12T02:01:24.354 INFO:teuthology.orchestra.run.smithi060.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-12T02:01:24.354 INFO:teuthology.orchestra.run.smithi060.stdout: = sunit=0 swidth=0 blks 2023-07-12T02:01:24.354 INFO:teuthology.orchestra.run.smithi060.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-12T02:01:24.354 INFO:teuthology.orchestra.run.smithi060.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-12T02:01:24.354 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-12T02:01:24.354 INFO:teuthology.orchestra.run.smithi060.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-12T02:01:24.376 INFO:teuthology.orchestra.run.smithi060.stdout:Discarding blocks...Done. 2023-07-12T02:01:24.377 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi060.front.sepia.ceph.com -o noatime 2023-07-12T02:01:24.377 DEBUG:teuthology.orchestra.run.smithi060:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-07-12T02:01:24.458 DEBUG:teuthology.orchestra.run.smithi060:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-07-12T02:01:24.529 DEBUG:teuthology.orchestra.run.smithi060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-12T02:01:24.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:24.613+0000 7f21e9234640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-07-12T02:01:24.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:24.613+0000 7f21e9234640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-07-12T02:01:24.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:24.613+0000 7f21e9234640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-12T02:01:24.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:24.613+0000 7f21e9234640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-12T02:01:24.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:24.613+0000 7f21e9234640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-12T02:01:24.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:24.614+0000 7f21e9234640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-07-12T02:01:27.467 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-07-12T02:01:27.501 DEBUG:teuthology.orchestra.run.smithi060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-12T02:01:27.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:27.592+0000 7f1c88151640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-07-12T02:01:27.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:27.593+0000 7f1c88151640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-07-12T02:01:27.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:27.593+0000 7f1c88151640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-12T02:01:27.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:27.593+0000 7f1c88151640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-12T02:01:27.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:27.593+0000 7f1c88151640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-12T02:01:27.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:27.593+0000 7f1c88151640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-07-12T02:01:30.446 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-07-12T02:01:30.480 DEBUG:teuthology.orchestra.run.smithi060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-12T02:01:30.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:30.570+0000 7f93ab270640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-07-12T02:01:30.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:30.570+0000 7f93ab270640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-07-12T02:01:30.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:30.570+0000 7f93ab270640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-12T02:01:30.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:30.570+0000 7f93ab270640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-12T02:01:30.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:30.570+0000 7f93ab270640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-12T02:01:30.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:30.571+0000 7f93ab270640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-07-12T02:01:33.418 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-07-12T02:01:33.451 DEBUG:teuthology.orchestra.run.smithi060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-12T02:01:33.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:33.541+0000 7f2e05707640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-07-12T02:01:33.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:33.542+0000 7f2e05707640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-07-12T02:01:33.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:33.542+0000 7f2e05707640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-12T02:01:33.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:33.542+0000 7f2e05707640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-12T02:01:33.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:33.542+0000 7f2e05707640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-12T02:01:33.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:33.542+0000 7f2e05707640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-07-12T02:01:36.392 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-07-12T02:01:36.426 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-07-12T02:01:36.459 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-12T02:01:36.460 INFO:tasks.ceph:role: osd.4 2023-07-12T02:01:36.460 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi079.front.sepia.ceph.com 2023-07-12T02:01:36.460 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-12T02:01:36.537 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-12T02:01:36.538 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-12T02:01:36.538 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-12T02:01:36.538 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-12T02:01:36.538 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-12T02:01:36.538 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2023-07-12T02:01:36.538 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-12T02:01:36.538 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-12T02:01:36.539 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-12T02:01:36.539 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-12T02:01:36.962 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2023-07-12T02:01:36.964 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2023-07-12T02:01:36.964 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-07-12T02:01:37.127 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-07-12T02:01:37.163 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-07-12T02:01:37.233 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-12T02:01:37.233 INFO:tasks.ceph:role: osd.5 2023-07-12T02:01:37.234 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi079.front.sepia.ceph.com 2023-07-12T02:01:37.234 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-12T02:01:37.310 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-12T02:01:37.310 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-12T02:01:37.310 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-12T02:01:37.310 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-12T02:01:37.311 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-12T02:01:37.311 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2023-07-12T02:01:37.311 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-12T02:01:37.311 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-12T02:01:37.311 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-12T02:01:37.311 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-12T02:01:37.741 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2023-07-12T02:01:37.743 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2023-07-12T02:01:37.743 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-07-12T02:01:37.857 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-07-12T02:01:37.891 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-07-12T02:01:37.961 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-12T02:01:37.961 INFO:tasks.ceph:role: osd.6 2023-07-12T02:01:37.961 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi079.front.sepia.ceph.com 2023-07-12T02:01:37.962 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-12T02:01:38.039 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-12T02:01:38.039 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-12T02:01:38.039 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-12T02:01:38.040 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-12T02:01:38.040 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-12T02:01:38.040 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2023-07-12T02:01:38.040 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-12T02:01:38.040 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-12T02:01:38.040 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-12T02:01:38.040 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-12T02:01:38.488 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2023-07-12T02:01:38.490 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2023-07-12T02:01:38.490 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-07-12T02:01:38.651 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-07-12T02:01:38.687 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-07-12T02:01:38.756 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-12T02:01:38.756 INFO:tasks.ceph:role: osd.7 2023-07-12T02:01:38.757 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi079.front.sepia.ceph.com 2023-07-12T02:01:38.757 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-12T02:01:38.832 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-12T02:01:38.832 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-12T02:01:38.832 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-12T02:01:38.833 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-12T02:01:38.833 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-12T02:01:38.833 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2023-07-12T02:01:38.833 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-12T02:01:38.833 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-12T02:01:38.833 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-12T02:01:38.833 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-12T02:01:39.273 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2023-07-12T02:01:39.275 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2023-07-12T02:01:39.275 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-07-12T02:01:39.448 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-07-12T02:01:39.486 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-12T02:01:39.576 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:39.572+0000 7f503cbf9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-07-12T02:01:39.576 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:39.573+0000 7f503cbf9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-07-12T02:01:39.577 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:39.573+0000 7f503cbf9640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-12T02:01:39.577 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:39.573+0000 7f503cbf9640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-12T02:01:39.577 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:39.573+0000 7f503cbf9640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-12T02:01:39.577 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:39.573+0000 7f503cbf9640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-07-12T02:01:42.418 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-07-12T02:01:42.450 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-12T02:01:42.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:42.538+0000 7fe524664640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-07-12T02:01:42.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:42.539+0000 7fe524664640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-07-12T02:01:42.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:42.539+0000 7fe524664640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-12T02:01:42.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:42.539+0000 7fe524664640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-12T02:01:42.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:42.539+0000 7fe524664640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-12T02:01:42.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:42.539+0000 7fe524664640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-07-12T02:01:45.386 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-07-12T02:01:45.418 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-12T02:01:45.511 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:45.508+0000 7f78347df640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-07-12T02:01:45.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:45.508+0000 7f78347df640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-07-12T02:01:45.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:45.508+0000 7f78347df640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-12T02:01:45.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:45.508+0000 7f78347df640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-12T02:01:45.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:45.508+0000 7f78347df640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-12T02:01:45.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:45.508+0000 7f78347df640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-07-12T02:01:48.360 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-07-12T02:01:48.392 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-12T02:01:48.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:48.480+0000 7faf2c8c7640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-07-12T02:01:48.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:48.481+0000 7faf2c8c7640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-07-12T02:01:48.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:48.481+0000 7faf2c8c7640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-12T02:01:48.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:48.481+0000 7faf2c8c7640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-12T02:01:48.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:48.481+0000 7faf2c8c7640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-12T02:01:48.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:48.481+0000 7faf2c8c7640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-07-12T02:01:49.971 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:01:49.973 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:01:49.976 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:01:51.326 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-07-12T02:01:51.358 INFO:tasks.ceph:Reading keys from all nodes... 2023-07-12T02:01:51.358 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-07-12T02:01:51.358 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-07-12T02:01:51.392 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-07-12T02:01:51.392 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-07-12T02:01:51.464 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-07-12T02:01:51.465 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-07-12T02:01:51.535 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-07-12T02:01:51.535 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-07-12T02:01:51.605 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-07-12T02:01:51.605 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-07-12T02:01:51.674 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-07-12T02:01:51.674 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-07-12T02:01:51.742 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-07-12T02:01:51.742 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-07-12T02:01:51.811 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-07-12T02:01:51.811 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-07-12T02:01:51.843 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-07-12T02:01:51.844 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-07-12T02:01:51.914 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-07-12T02:01:51.914 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-07-12T02:01:51.983 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-07-12T02:01:51.983 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-07-12T02:01:52.052 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-07-12T02:01:52.052 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-07-12T02:01:52.119 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-07-12T02:01:52.120 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-07-12T02:01:52.187 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-07-12T02:01:52.187 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-07-12T02:01:52.236 INFO:tasks.ceph:Adding keys to all mons... 2023-07-12T02:01:52.236 DEBUG:teuthology.orchestra.run.smithi060:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-12T02:01:52.238 DEBUG:teuthology.orchestra.run.smithi079:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-12T02:01:52.264 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr.y] 2023-07-12T02:01:52.264 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQByCa5kenx6MBAAg4ziV4x7CbquiiM1o2WcxA== 2023-07-12T02:01:52.264 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.a] 2023-07-12T02:01:52.265 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQByCa5k4kGoNxAAB0sc013e8ZS1czogTc4c0Q== 2023-07-12T02:01:52.265 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.c] 2023-07-12T02:01:52.265 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQBzCa5kltuNAxAA/7gpWdOo0eN8x9So4gYwhQ== 2023-07-12T02:01:52.265 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.0] 2023-07-12T02:01:52.265 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQB0Ca5krbesJBAAW2yrWAhl5kZG4G9zy/b3Fw== 2023-07-12T02:01:52.265 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.1] 2023-07-12T02:01:52.265 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQB3Ca5kbQlwIxAAu/GHmpykbQzoNfyOb5/6OQ== 2023-07-12T02:01:52.266 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.2] 2023-07-12T02:01:52.266 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQB6Ca5k5qoYIhAACprR3whRHZCqRBysgRE8Eg== 2023-07-12T02:01:52.266 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.3] 2023-07-12T02:01:52.266 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQB9Ca5kgt5kIBAAju9+pOfla//KjiB9IAZZrg== 2023-07-12T02:01:52.266 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr.x] 2023-07-12T02:01:52.266 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQByCa5kOpAmNBAAMrXkO02GwLyNMqUzhM7C4Q== 2023-07-12T02:01:52.266 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.b] 2023-07-12T02:01:52.266 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQBzCa5kxg+QCBAAPiVj0e6ZgTz6eIigWl8+qQ== 2023-07-12T02:01:52.267 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.4] 2023-07-12T02:01:52.267 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCDCa5kpqw2IhAAeTQ2LoJ9k2mgIRcjzE1yJA== 2023-07-12T02:01:52.267 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.5] 2023-07-12T02:01:52.267 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCGCa5k8PUuIBAA/iuLCQ7gjKyM9qfJJJRTOA== 2023-07-12T02:01:52.267 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.6] 2023-07-12T02:01:52.267 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCJCa5keGNbHhAAtq6cMhMcwij3e8N/qNWeQQ== 2023-07-12T02:01:52.267 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.7] 2023-07-12T02:01:52.267 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCMCa5kbgW6HBAA3m/y4pr8E0KX0b9A//nykw== 2023-07-12T02:01:52.268 INFO:teuthology.orchestra.run.smithi079.stdout:[client.0] 2023-07-12T02:01:52.268 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQBzCa5kvqP/EBAABFId+TiUCC5lJjpXOFAL7w== 2023-07-12T02:01:52.268 INFO:teuthology.orchestra.run.smithi060.stdout:[mgr.y] 2023-07-12T02:01:52.268 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQByCa5kenx6MBAAg4ziV4x7CbquiiM1o2WcxA== 2023-07-12T02:01:52.269 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.a] 2023-07-12T02:01:52.269 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQByCa5k4kGoNxAAB0sc013e8ZS1czogTc4c0Q== 2023-07-12T02:01:52.269 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.c] 2023-07-12T02:01:52.269 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQBzCa5kltuNAxAA/7gpWdOo0eN8x9So4gYwhQ== 2023-07-12T02:01:52.269 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.0] 2023-07-12T02:01:52.269 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQB0Ca5krbesJBAAW2yrWAhl5kZG4G9zy/b3Fw== 2023-07-12T02:01:52.269 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.1] 2023-07-12T02:01:52.269 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQB3Ca5kbQlwIxAAu/GHmpykbQzoNfyOb5/6OQ== 2023-07-12T02:01:52.270 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.2] 2023-07-12T02:01:52.270 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQB6Ca5k5qoYIhAACprR3whRHZCqRBysgRE8Eg== 2023-07-12T02:01:52.270 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.3] 2023-07-12T02:01:52.270 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQB9Ca5kgt5kIBAAju9+pOfla//KjiB9IAZZrg== 2023-07-12T02:01:52.270 INFO:teuthology.orchestra.run.smithi060.stdout:[mgr.x] 2023-07-12T02:01:52.270 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQByCa5kOpAmNBAAMrXkO02GwLyNMqUzhM7C4Q== 2023-07-12T02:01:52.270 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.b] 2023-07-12T02:01:52.270 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQBzCa5kxg+QCBAAPiVj0e6ZgTz6eIigWl8+qQ== 2023-07-12T02:01:52.271 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.4] 2023-07-12T02:01:52.271 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQCDCa5kpqw2IhAAeTQ2LoJ9k2mgIRcjzE1yJA== 2023-07-12T02:01:52.271 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.5] 2023-07-12T02:01:52.271 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQCGCa5k8PUuIBAA/iuLCQ7gjKyM9qfJJJRTOA== 2023-07-12T02:01:52.271 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.6] 2023-07-12T02:01:52.271 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQCJCa5keGNbHhAAtq6cMhMcwij3e8N/qNWeQQ== 2023-07-12T02:01:52.271 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.7] 2023-07-12T02:01:52.272 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQCMCa5kbgW6HBAA3m/y4pr8E0KX0b9A//nykw== 2023-07-12T02:01:52.272 INFO:teuthology.orchestra.run.smithi060.stdout:[client.0] 2023-07-12T02:01:52.272 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQBzCa5kvqP/EBAABFId+TiUCC5lJjpXOFAL7w== 2023-07-12T02:01:52.273 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-12T02:01:52.315 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-12T02:01:52.372 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-12T02:01:52.374 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-12T02:01:52.431 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-12T02:01:52.433 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-12T02:01:52.489 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-12T02:01:52.491 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-12T02:01:52.544 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-12T02:01:52.546 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-12T02:01:52.599 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-12T02:01:52.601 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-12T02:01:52.654 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-12T02:01:52.656 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-12T02:01:52.709 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-12T02:01:52.711 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-12T02:01:52.764 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-12T02:01:52.766 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-12T02:01:52.822 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-12T02:01:52.823 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-12T02:01:52.877 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-12T02:01:52.879 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-12T02:01:52.932 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-12T02:01:52.934 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-12T02:01:52.987 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-12T02:01:52.989 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-12T02:01:53.042 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-12T02:01:53.044 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-12T02:01:53.101 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-07-12T02:01:53.101 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-07-12T02:01:53.129 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-12T02:01:53.227 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-07-12T02:01:53.255 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-07-12T02:01:53.282 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-12T02:01:53.380 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-07-12T02:01:53.407 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-07-12T02:01:53.474 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-12T02:01:53.572 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-07-12T02:01:53.599 DEBUG:teuthology.orchestra.run.smithi060:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-12T02:01:53.601 DEBUG:teuthology.orchestra.run.smithi079:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-12T02:01:53.657 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-07-12T02:01:53.657 INFO:tasks.ceph.mon.a:Restarting daemon 2023-07-12T02:01:53.657 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-07-12T02:01:53.659 INFO:tasks.ceph.mon.a:Started 2023-07-12T02:01:53.660 INFO:tasks.ceph.mon.b:Restarting daemon 2023-07-12T02:01:53.660 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-07-12T02:01:53.698 INFO:tasks.ceph.mon.b:Started 2023-07-12T02:01:53.698 INFO:tasks.ceph.mon.c:Restarting daemon 2023-07-12T02:01:53.699 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-07-12T02:01:53.700 INFO:tasks.ceph.mon.c:Started 2023-07-12T02:01:53.701 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-07-12T02:01:53.701 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-07-12T02:01:53.701 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-07-12T02:01:53.703 INFO:tasks.ceph.mgr.y:Started 2023-07-12T02:01:53.703 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-07-12T02:01:53.704 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-07-12T02:01:53.705 INFO:tasks.ceph.mgr.x:Started 2023-07-12T02:01:53.706 INFO:tasks.ceph:Setting crush tunables to default 2023-07-12T02:01:53.706 DEBUG:teuthology.orchestra.run.smithi060:> sudo ceph --cluster ceph osd crush tunables default 2023-07-12T02:01:53.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:53.834+0000 7f9dbf119700 1 Processor -- start 2023-07-12T02:01:53.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:53.834+0000 7f9dbf119700 1 -- start start 2023-07-12T02:01:53.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:53.835+0000 7f9dbf119700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9db80721e0 0x7f9db8071130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:53.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:53.835+0000 7f9dbf119700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9db8071670 0x7f9db8154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:53.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:53.835+0000 7f9dbf119700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9db806a640 con 0x7f9db8147dc0 2023-07-12T02:01:53.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:53.835+0000 7f9dbf119700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9db8072630 con 0x7f9db8071670 2023-07-12T02:01:53.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:53.835+0000 7f9dbf119700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db8070950 con 0x7f9db80721e0 2023-07-12T02:01:53.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:53.835+0000 7f9db7fff700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9db80721e0 0x7f9db8071130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:53.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:53.835+0000 7f9dbd6b6700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9db8071670 0x7f9db8154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:53.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:53.835+0000 7f9dbceb5700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f9db8147dc0 0x7f9db8069f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.60:42958/0 (socket says 172.21.15.60:42958) 2023-07-12T02:01:53.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:53.835+0000 7f9db7fff700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9db80721e0 0x7f9db8071130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.60:59596/0 (socket says 172.21.15.60:59596) 2023-07-12T02:01:53.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:53.835+0000 7f9dbd6b6700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9db8071670 0x7f9db8154ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.60:38072/0 (socket says 172.21.15.60:38072) 2023-07-12T02:01:53.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:53.835+0000 7f9dbceb5700 1 -- 172.21.15.60:0/139245075 learned_addr learned my addr 172.21.15.60:0/139245075 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:01:53.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:53.835+0000 7f9dbd6b6700 1 -- 172.21.15.60:0/139245075 >> v2:172.21.15.79:3300/0 conn(0x7f9db8071670 msgr2=0x7f9db8154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-07-12T02:01:53.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:53.835+0000 7f9dbd6b6700 1 -- 172.21.15.60:0/139245075 >> v2:172.21.15.79:3300/0 conn(0x7f9db8071670 msgr2=0x7f9db8154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-12T02:01:53.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:53.835+0000 7f9dbd6b6700 1 --2- 172.21.15.60:0/139245075 >> v2:172.21.15.79:3300/0 conn(0x7f9db8071670 0x7f9db8154ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-12T02:01:53.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:53.835+0000 7f9dbd6b6700 1 --2- 172.21.15.60:0/139245075 >> v2:172.21.15.79:3300/0 conn(0x7f9db8071670 0x7f9db8154ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-12T02:01:53.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:53.835+0000 7f9db7fff700 1 -- 172.21.15.60:0/139245075 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9db80721e0 msgr2=0x7f9db8071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-07-12T02:01:53.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:53.835+0000 7f9db7fff700 1 -- 172.21.15.60:0/139245075 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9db80721e0 msgr2=0x7f9db8071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-12T02:01:53.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:53.835+0000 7f9db7fff700 1 --2- 172.21.15.60:0/139245075 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9db80721e0 0x7f9db8071130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-12T02:01:53.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:53.836+0000 7f9db7fff700 1 --2- 172.21.15.60:0/139245075 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9db80721e0 0x7f9db8071130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-12T02:01:54.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.003+0000 7f9db77fe700 1 -- 172.21.15.60:0/139245075 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 460210905 0 0) 0x7f9db806a640 con 0x7f9db8147dc0 2023-07-12T02:01:54.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.003+0000 7f9db77fe700 1 -- 172.21.15.60:0/139245075 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9da80035b0 con 0x7f9db8147dc0 2023-07-12T02:01:54.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.009+0000 7f9db77fe700 1 -- 172.21.15.60:0/139245075 <== mon.1 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2188046539 0 0) 0x7f9da80035b0 con 0x7f9db8147dc0 2023-07-12T02:01:54.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.009+0000 7f9db77fe700 1 -- 172.21.15.60:0/139245075 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9db80721e0 msgr2=0x7f9db8071130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-12T02:01:54.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.009+0000 7f9db77fe700 1 --2- 172.21.15.60:0/139245075 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9db80721e0 0x7f9db8071130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:54.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.009+0000 7f9db77fe700 1 -- 172.21.15.60:0/139245075 >> v2:172.21.15.79:3300/0 conn(0x7f9db8071670 msgr2=0x7f9db8154ff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-12T02:01:54.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.009+0000 7f9db77fe700 1 --2- 172.21.15.60:0/139245075 >> v2:172.21.15.79:3300/0 conn(0x7f9db8071670 0x7f9db8154ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:54.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.009+0000 7f9db77fe700 1 -- 172.21.15.60:0/139245075 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db806f680 con 0x7f9db8147dc0 2023-07-12T02:01:54.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.009+0000 7f9db77fe700 1 -- 172.21.15.60:0/139245075 <== mon.1 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1141905739 0 0) 0x7f9dac001670 con 0x7f9db8147dc0 2023-07-12T02:01:54.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.009+0000 7f9db77fe700 1 -- 172.21.15.60:0/139245075 >> v1:172.21.15.79:6789/0 conn(0x7f9db8147dc0 legacy=0x7f9db8069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:54.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.009+0000 7f9db77fe700 1 --2- 172.21.15.60:0/139245075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9da8003a00 0x7f9da8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:54.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.009+0000 7f9db77fe700 1 --2- 172.21.15.60:0/139245075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9da8004850 0x7f9da8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:54.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.009+0000 7f9db77fe700 1 --2- 172.21.15.60:0/139245075 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9db80721e0 0x7f9da80052b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:54.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.009+0000 7f9db77fe700 1 -- 172.21.15.60:0/139245075 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db8070950 con 0x7f9da8004850 2023-07-12T02:01:54.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.009+0000 7f9db77fe700 1 -- 172.21.15.60:0/139245075 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da800bba0 con 0x7f9da8003a00 2023-07-12T02:01:54.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.009+0000 7f9db77fe700 1 -- 172.21.15.60:0/139245075 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da800bd60 con 0x7f9db80721e0 2023-07-12T02:01:54.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.009+0000 7f9db7fff700 1 --2- 172.21.15.60:0/139245075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9da8004850 0x7f9da8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:54.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.009+0000 7f9dbceb5700 1 --2- 172.21.15.60:0/139245075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9da8003a00 0x7f9da8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:54.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.010+0000 7f9dbd6b6700 1 --2- 172.21.15.60:0/139245075 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9db80721e0 0x7f9da80052b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:54.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.010+0000 7f9db7fff700 1 -- 172.21.15.60:0/139245075 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9db80721e0 msgr2=0x7f9da80052b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:01:54.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.010+0000 7f9db7fff700 1 --2- 172.21.15.60:0/139245075 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9db80721e0 0x7f9da80052b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:54.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.010+0000 7f9db7fff700 1 -- 172.21.15.60:0/139245075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9da8003a00 msgr2=0x7f9da8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:01:54.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.010+0000 7f9db7fff700 1 --2- 172.21.15.60:0/139245075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9da8003a00 0x7f9da8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:54.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.010+0000 7f9db7fff700 1 -- 172.21.15.60:0/139245075 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da80035b0 con 0x7f9da8004850 2023-07-12T02:01:54.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.010+0000 7f9db7fff700 1 --2- 172.21.15.60:0/139245075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9da8004850 0x7f9da8004cc0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9da4009890 tx=0x7f9da8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fe51b40152c54ed server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:01:54.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.010+0000 7f9db77fe700 1 -- 172.21.15.60:0/139245075 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da400c070 con 0x7f9da8004850 2023-07-12T02:01:54.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.010+0000 7f9db77fe700 1 -- 172.21.15.60:0/139245075 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da4004020 con 0x7f9da8004850 2023-07-12T02:01:54.017 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.010+0000 7f9db77fe700 1 -- 172.21.15.60:0/139245075 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da40043d0 con 0x7f9da8004850 2023-07-12T02:01:54.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.011+0000 7f9dbf119700 1 -- 172.21.15.60:0/139245075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9da8004850 msgr2=0x7f9da8004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:54.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.011+0000 7f9dbf119700 1 --2- 172.21.15.60:0/139245075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9da8004850 0x7f9da8004cc0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9da4009890 tx=0x7f9da8005880 comp rx=0 tx=0).stop 2023-07-12T02:01:54.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.011+0000 7f9dbd6b6700 1 -- 172.21.15.60:0/139245075 reap_dead start 2023-07-12T02:01:54.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.011+0000 7f9dbf119700 1 -- 172.21.15.60:0/139245075 shutdown_connections 2023-07-12T02:01:54.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.011+0000 7f9dbf119700 1 -- 172.21.15.60:0/139245075 >> 172.21.15.60:0/139245075 conn(0x7f9db806d0e0 msgr2=0x7f9db806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:01:54.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.011+0000 7f9dbf119700 1 -- 172.21.15.60:0/139245075 shutdown_connections 2023-07-12T02:01:54.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.011+0000 7f9dbf119700 1 -- 172.21.15.60:0/139245075 wait complete. 2023-07-12T02:01:54.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.012+0000 7f9dbf119700 1 Processor -- start 2023-07-12T02:01:54.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.012+0000 7f9dbf119700 1 -- start start 2023-07-12T02:01:54.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.013+0000 7f9dbf119700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9da8004850 0x7f9db81e2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:54.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.013+0000 7f9dbf119700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9db813fa30 0x7f9db8148df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:54.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.013+0000 7f9dbf119700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9db8149330 0x7f9db81df490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:54.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.013+0000 7f9dbf119700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db81e3140 con 0x7f9db8149330 2023-07-12T02:01:54.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.013+0000 7f9dbf119700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db8149bc0 con 0x7f9da8004850 2023-07-12T02:01:54.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.013+0000 7f9dbf119700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db81497d0 con 0x7f9db813fa30 2023-07-12T02:01:54.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.014+0000 7f9db7fff700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9db813fa30 0x7f9db8148df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:54.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.014+0000 7f9dbceb5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9da8004850 0x7f9db81e2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:54.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.014+0000 7f9db7fff700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9db813fa30 0x7f9db8148df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.60:59664/0 (socket says 172.21.15.60:59664) 2023-07-12T02:01:54.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.014+0000 7f9db7fff700 1 -- 172.21.15.60:0/4255066956 learned_addr learned my addr 172.21.15.60:0/4255066956 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:01:54.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.014+0000 7f9dbd6b6700 1 --2- 172.21.15.60:0/4255066956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9db8149330 0x7f9db81df490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:54.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.014+0000 7f9dbd6b6700 1 -- 172.21.15.60:0/4255066956 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9db813fa30 msgr2=0x7f9db8148df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:54.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.014+0000 7f9dbd6b6700 1 --2- 172.21.15.60:0/4255066956 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9db813fa30 0x7f9db8148df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:54.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.014+0000 7f9dbd6b6700 1 -- 172.21.15.60:0/4255066956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9da8004850 msgr2=0x7f9db81e2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:54.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.014+0000 7f9dbd6b6700 1 --2- 172.21.15.60:0/4255066956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9da8004850 0x7f9db81e2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:54.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.014+0000 7f9dbd6b6700 1 -- 172.21.15.60:0/4255066956 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db8148310 con 0x7f9db8149330 2023-07-12T02:01:54.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.014+0000 7f9dbd6b6700 1 --2- 172.21.15.60:0/4255066956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9db8149330 0x7f9db81df490 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9db806c7b0 tx=0x7f9db000f430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:01:54.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.014+0000 7f9db57fa700 1 -- 172.21.15.60:0/4255066956 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db000fcf0 con 0x7f9db8149330 2023-07-12T02:01:54.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.014+0000 7f9db57fa700 1 -- 172.21.15.60:0/4255066956 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9db000fe90 con 0x7f9db8149330 2023-07-12T02:01:54.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.014+0000 7f9dbf119700 1 -- 172.21.15.60:0/4255066956 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9db81485f0 con 0x7f9db8149330 2023-07-12T02:01:54.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.014+0000 7f9db57fa700 1 -- 172.21.15.60:0/4255066956 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db0003c60 con 0x7f9db8149330 2023-07-12T02:01:54.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.014+0000 7f9dbf119700 1 -- 172.21.15.60:0/4255066956 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9db814a890 con 0x7f9db8149330 2023-07-12T02:01:54.023 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.014+0000 7f9db57fa700 1 -- 172.21.15.60:0/4255066956 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9db0004030 con 0x7f9db8149330 2023-07-12T02:01:54.023 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.014+0000 7f9db57fa700 1 -- 172.21.15.60:0/4255066956 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9db001f4c0 con 0x7f9db8149330 2023-07-12T02:01:54.023 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.015+0000 7f9dbf119700 1 -- 172.21.15.60:0/4255066956 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9db8148b10 con 0x7f9db8149330 2023-07-12T02:01:54.023 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.018+0000 7f9db57fa700 1 -- 172.21.15.60:0/4255066956 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72553 (secure 0 0 0) 0x7f9db8148b10 con 0x7f9db8149330 2023-07-12T02:01:54.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.099+0000 7f9dbf119700 1 -- 172.21.15.60:0/4255066956 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f9db8074360 con 0x7f9db8149330 2023-07-12T02:01:54.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.101+0000 7f9db57fa700 1 -- 172.21.15.60:0/4255066956 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f9db001b070 con 0x7f9db8149330 2023-07-12T02:01:54.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.102+0000 7f9dbf119700 1 -- 172.21.15.60:0/4255066956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9db8149330 msgr2=0x7f9db81df490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:54.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.102+0000 7f9dbf119700 1 --2- 172.21.15.60:0/4255066956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9db8149330 0x7f9db81df490 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9db806c7b0 tx=0x7f9db000f430 comp rx=0 tx=0).stop 2023-07-12T02:01:54.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.102+0000 7f9dbf119700 1 -- 172.21.15.60:0/4255066956 shutdown_connections 2023-07-12T02:01:54.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.102+0000 7f9dbf119700 1 --2- 172.21.15.60:0/4255066956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9db8149330 0x7f9db81df490 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:54.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.102+0000 7f9dbf119700 1 --2- 172.21.15.60:0/4255066956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9da8004850 0x7f9db81e2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:54.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.102+0000 7f9dbf119700 1 --2- 172.21.15.60:0/4255066956 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9db813fa30 0x7f9db8148df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:54.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.102+0000 7f9dbf119700 1 -- 172.21.15.60:0/4255066956 >> 172.21.15.60:0/4255066956 conn(0x7f9db806d0e0 msgr2=0x7f9db80ba630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:01:54.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.102+0000 7f9dbf119700 1 -- 172.21.15.60:0/4255066956 shutdown_connections 2023-07-12T02:01:54.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:54.102+0000 7f9dbf119700 1 -- 172.21.15.60:0/4255066956 wait complete. 2023-07-12T02:01:54.107 INFO:teuthology.orchestra.run.smithi060.stderr:adjusted tunables profile to default 2023-07-12T02:01:54.117 INFO:tasks.ceph:check_enable_crimson: False 2023-07-12T02:01:54.117 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-07-12T02:01:54.118 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-07-12T02:01:54.118 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-07-12T02:01:54.131 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-07-12T02:01:54.127+0000 7fe07fab8200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-12T02:01:54.142 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-07-12T02:01:54.139+0000 7f25f02fe200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-12T02:01:54.146 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-07-12T02:01:54.146 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-07-12T02:01:54.213 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-07-12T02:01:54.213 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-07-12T02:01:54.301 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-07-12T02:01:54.297+0000 7fe07fab8200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-12T02:01:54.308 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-07-12T02:01:54.308 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-07-12T02:01:54.348 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-07-12T02:01:54.345+0000 7f25f02fe200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-12T02:01:54.375 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-07-12T02:01:54.375 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-07-12T02:01:54.402 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-07-12T02:01:54.402 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-07-12T02:01:54.468 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-07-12T02:01:54.469 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-07-12T02:01:54.534 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-07-12T02:01:54.534 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-07-12T02:01:54.601 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd new ed8b71c2-3895-4952-a118-16ede0b4a98c 0 2023-07-12T02:01:54.654 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-07-12T02:01:54.650+0000 7fe07fab8200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-12T02:01:54.727 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-07-12T02:01:54.724+0000 7f25f02fe200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-12T02:01:54.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.759+0000 7f1935b6e700 1 Processor -- start 2023-07-12T02:01:54.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.759+0000 7f1935b6e700 1 -- start start 2023-07-12T02:01:54.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.760+0000 7f1935b6e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f193006c380 0x7f19301423f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:54.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.760+0000 7f1935b6e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f19300b3bf0 0x7f19300b87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:54.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.760+0000 7f1935b6e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19300b2a80 con 0x7f19300b2e50 2023-07-12T02:01:54.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.760+0000 7f1935b6e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19300b2150 con 0x7f193006c380 2023-07-12T02:01:54.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.760+0000 7f1935b6e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19300b2430 con 0x7f19300b3bf0 2023-07-12T02:01:54.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.760+0000 7f192effd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f19300b3bf0 0x7f19300b87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:54.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.760+0000 7f192effd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f19300b3bf0 0x7f19300b87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44558/0 (socket says 172.21.15.79:44558) 2023-07-12T02:01:54.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.760+0000 7f192effd700 1 -- 172.21.15.79:0/726127318 learned_addr learned my addr 172.21.15.79:0/726127318 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-07-12T02:01:54.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.760+0000 7f192f7fe700 1 --2- 172.21.15.79:0/726127318 >> v2:172.21.15.60:3300/0 conn(0x7f193006c380 0x7f19301423f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:54.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.761+0000 7f192effd700 1 -- 172.21.15.79:0/726127318 >> v2:172.21.15.60:3300/0 conn(0x7f193006c380 msgr2=0x7f19301423f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:01:54.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.761+0000 7f192effd700 1 --2- 172.21.15.79:0/726127318 >> v2:172.21.15.60:3300/0 conn(0x7f193006c380 0x7f19301423f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:54.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.761+0000 7f192effd700 1 -- 172.21.15.79:0/726127318 >> v1:172.21.15.60:6789/0 conn(0x7f19300b2e50 legacy=0x7f193014b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:54.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.761+0000 7f192effd700 1 -- 172.21.15.79:0/726127318 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19300b2710 con 0x7f19300b3bf0 2023-07-12T02:01:54.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.761+0000 7f192effd700 1 --2- 172.21.15.79:0/726127318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19300b3bf0 0x7f19300b87b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1930066b90 tx=0x7f1924009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dbb142c536907b3 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:01:54.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.761+0000 7f192e7fc700 1 -- 172.21.15.79:0/726127318 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1924011830 con 0x7f19300b3bf0 2023-07-12T02:01:54.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.761+0000 7f192e7fc700 1 -- 172.21.15.79:0/726127318 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1924011990 con 0x7f19300b3bf0 2023-07-12T02:01:54.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.761+0000 7f192e7fc700 1 -- 172.21.15.79:0/726127318 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1924011d20 con 0x7f19300b3bf0 2023-07-12T02:01:54.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.761+0000 7f1935b6e700 1 -- 172.21.15.79:0/726127318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19300b3bf0 msgr2=0x7f19300b87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:54.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.761+0000 7f1935b6e700 1 --2- 172.21.15.79:0/726127318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19300b3bf0 0x7f19300b87b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1930066b90 tx=0x7f1924009bd0 comp rx=0 tx=0).stop 2023-07-12T02:01:54.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.762+0000 7f1935b6e700 1 -- 172.21.15.79:0/726127318 shutdown_connections 2023-07-12T02:01:54.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.762+0000 7f1935b6e700 1 --2- 172.21.15.79:0/726127318 >> v2:172.21.15.60:3300/0 conn(0x7f193006c380 0x7f19301423f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:54.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.762+0000 7f1935b6e700 1 --2- 172.21.15.79:0/726127318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19300b3bf0 0x7f19300b87b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:54.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.762+0000 7f1935b6e700 1 -- 172.21.15.79:0/726127318 >> 172.21.15.79:0/726127318 conn(0x7f19300b97c0 msgr2=0x7f19300b9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:01:54.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.762+0000 7f1935b6e700 1 -- 172.21.15.79:0/726127318 shutdown_connections 2023-07-12T02:01:54.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.762+0000 7f1935b6e700 1 -- 172.21.15.79:0/726127318 wait complete. 2023-07-12T02:01:54.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.763+0000 7f1935b6e700 1 Processor -- start 2023-07-12T02:01:54.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.763+0000 7f1935b6e700 1 -- start start 2023-07-12T02:01:54.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.763+0000 7f1935b6e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f193006c380 0x7f1930141470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:54.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.763+0000 7f1935b6e700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f19300b2e50 0x7f193013ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:54.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.763+0000 7f1935b6e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19300b3bf0 0x7f19301e34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:54.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.763+0000 7f1935b6e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19301419b0 con 0x7f19300b3bf0 2023-07-12T02:01:54.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.763+0000 7f1935b6e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1930149310 con 0x7f193006c380 2023-07-12T02:01:54.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.763+0000 7f1935b6e700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f193013b400 con 0x7f19300b2e50 2023-07-12T02:01:54.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.764+0000 7f192f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f193006c380 0x7f1930141470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:54.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.764+0000 7f192f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f193006c380 0x7f1930141470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44572/0 (socket says 172.21.15.79:44572) 2023-07-12T02:01:54.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.764+0000 7f192f7fe700 1 -- 172.21.15.79:0/2479985465 learned_addr learned my addr 172.21.15.79:0/2479985465 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-07-12T02:01:54.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.764+0000 7f192effd700 1 --2- 172.21.15.79:0/2479985465 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f19300b2e50 0x7f193013ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:54.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.764+0000 7f192ffff700 1 --2- 172.21.15.79:0/2479985465 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19300b3bf0 0x7f19301e34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:54.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.764+0000 7f192f7fe700 1 -- 172.21.15.79:0/2479985465 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f19300b2e50 msgr2=0x7f193013ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:54.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.764+0000 7f192f7fe700 1 --2- 172.21.15.79:0/2479985465 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f19300b2e50 0x7f193013ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:54.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.764+0000 7f192f7fe700 1 -- 172.21.15.79:0/2479985465 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19300b3bf0 msgr2=0x7f19301e34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:54.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.764+0000 7f192f7fe700 1 --2- 172.21.15.79:0/2479985465 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19300b3bf0 0x7f19301e34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:54.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.764+0000 7f192f7fe700 1 -- 172.21.15.79:0/2479985465 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1924009550 con 0x7f193006c380 2023-07-12T02:01:54.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.764+0000 7f192f7fe700 1 --2- 172.21.15.79:0/2479985465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f193006c380 0x7f1930141470 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f192000efc0 tx=0x7f192000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:01:54.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.764+0000 7f1917fff700 1 -- 172.21.15.79:0/2479985465 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192000cd10 con 0x7f193006c380 2023-07-12T02:01:54.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.764+0000 7f1917fff700 1 -- 172.21.15.79:0/2479985465 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192000f040 con 0x7f193006c380 2023-07-12T02:01:54.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.764+0000 7f1917fff700 1 -- 172.21.15.79:0/2479985465 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19200146a0 con 0x7f193006c380 2023-07-12T02:01:54.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.765+0000 7f1935b6e700 1 -- 172.21.15.79:0/2479985465 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19301d3580 con 0x7f193006c380 2023-07-12T02:01:54.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.765+0000 7f1935b6e700 1 -- 172.21.15.79:0/2479985465 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19301d31a0 con 0x7f193006c380 2023-07-12T02:01:54.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.765+0000 7f1917fff700 1 -- 172.21.15.79:0/2479985465 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1920014b00 con 0x7f193006c380 2023-07-12T02:01:54.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.765+0000 7f1917fff700 1 -- 172.21.15.79:0/2479985465 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f192001da30 con 0x7f193006c380 2023-07-12T02:01:54.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.765+0000 7f1935b6e700 1 -- 172.21.15.79:0/2479985465 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19301d3aa0 con 0x7f193006c380 2023-07-12T02:01:54.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.769+0000 7f1917fff700 1 -- 172.21.15.79:0/2479985465 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72553 (secure 0 0 0) 0x7f1920018020 con 0x7f193006c380 2023-07-12T02:01:54.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.852+0000 7f1935b6e700 1 -- 172.21.15.79:0/2479985465 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ed8b71c2-3895-4952-a118-16ede0b4a98c", "id": 0} v 0) v1 -- 0x7f19301d3390 con 0x7f193006c380 2023-07-12T02:01:54.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.854+0000 7f1917fff700 1 -- 172.21.15.79:0/2479985465 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ed8b71c2-3895-4952-a118-16ede0b4a98c", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f192001d400 con 0x7f193006c380 2023-07-12T02:01:54.858 INFO:teuthology.orchestra.run.smithi079.stdout:0 2023-07-12T02:01:54.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.855+0000 7f1935b6e700 1 -- 172.21.15.79:0/2479985465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f193006c380 msgr2=0x7f1930141470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:54.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.855+0000 7f1935b6e700 1 --2- 172.21.15.79:0/2479985465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f193006c380 0x7f1930141470 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f192000efc0 tx=0x7f192000c3a0 comp rx=0 tx=0).stop 2023-07-12T02:01:54.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.855+0000 7f1935b6e700 1 -- 172.21.15.79:0/2479985465 shutdown_connections 2023-07-12T02:01:54.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.855+0000 7f1935b6e700 1 --2- 172.21.15.79:0/2479985465 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19300b3bf0 0x7f19301e34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:54.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.855+0000 7f1935b6e700 1 --2- 172.21.15.79:0/2479985465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f193006c380 0x7f1930141470 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:54.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.855+0000 7f1935b6e700 1 --2- 172.21.15.79:0/2479985465 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f19300b2e50 0x7f193013ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:54.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.855+0000 7f1935b6e700 1 -- 172.21.15.79:0/2479985465 >> 172.21.15.79:0/2479985465 conn(0x7f19300b97c0 msgr2=0x7f19300b86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:01:54.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.855+0000 7f1935b6e700 1 -- 172.21.15.79:0/2479985465 shutdown_connections 2023-07-12T02:01:54.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:54.855+0000 7f1935b6e700 1 -- 172.21.15.79:0/2479985465 wait complete. 2023-07-12T02:01:54.870 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd new 7cf4d354-78e0-43ce-8c09-4a7d2a0b57a5 1 2023-07-12T02:01:55.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.029+0000 7f0495a14700 1 Processor -- start 2023-07-12T02:01:55.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.030+0000 7f0495a14700 1 -- start start 2023-07-12T02:01:55.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.030+0000 7f0495a14700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f04900bc810 0x7f04900ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:55.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.030+0000 7f0495a14700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f04900b8d90 0x7f049006ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:55.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.030+0000 7f0495a14700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04900b8620 con 0x7f04901449d0 2023-07-12T02:01:55.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.030+0000 7f0495a14700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04900b97a0 con 0x7f04900b8d90 2023-07-12T02:01:55.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.030+0000 7f0495a14700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0490144da0 con 0x7f04900bc810 2023-07-12T02:01:55.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.030+0000 7f048e7fc700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f04900bc810 0x7f04900ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:55.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.030+0000 7f048e7fc700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f04900bc810 0x7f04900ba530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.79:60754/0 (socket says 172.21.15.79:60754) 2023-07-12T02:01:55.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.030+0000 7f048e7fc700 1 -- 172.21.15.79:0/3995829390 learned_addr learned my addr 172.21.15.79:0/3995829390 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-07-12T02:01:55.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.031+0000 7f048f7fe700 1 --2- 172.21.15.79:0/3995829390 >> v2:172.21.15.60:3300/0 conn(0x7f04900b8d90 0x7f049006ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:55.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.031+0000 7f048e7fc700 1 -- 172.21.15.79:0/3995829390 >> v2:172.21.15.60:3300/0 conn(0x7f04900b8d90 msgr2=0x7f049006ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:01:55.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.031+0000 7f048e7fc700 1 --2- 172.21.15.79:0/3995829390 >> v2:172.21.15.60:3300/0 conn(0x7f04900b8d90 0x7f049006ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:55.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.031+0000 7f048e7fc700 1 -- 172.21.15.79:0/3995829390 >> v1:172.21.15.60:6789/0 conn(0x7f04901449d0 legacy=0x7f049014db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:01:55.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.031+0000 7f048e7fc700 1 -- 172.21.15.79:0/3995829390 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04900b8900 con 0x7f04900bc810 2023-07-12T02:01:55.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.031+0000 7f048e7fc700 1 --2- 172.21.15.79:0/3995829390 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f04900bc810 0x7f04900ba530 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f04840098f0 tx=0x7f0484009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4f368dd5d0975ec server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:01:55.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.031+0000 7f048dffb700 1 -- 172.21.15.79:0/3995829390 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0484004230 con 0x7f04900bc810 2023-07-12T02:01:55.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.031+0000 7f048dffb700 1 -- 172.21.15.79:0/3995829390 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0484004390 con 0x7f04900bc810 2023-07-12T02:01:55.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.031+0000 7f048dffb700 1 -- 172.21.15.79:0/3995829390 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04840036a0 con 0x7f04900bc810 2023-07-12T02:01:55.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.031+0000 7f0495a14700 1 -- 172.21.15.79:0/3995829390 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f04900bc810 msgr2=0x7f04900ba530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:55.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.031+0000 7f0495a14700 1 --2- 172.21.15.79:0/3995829390 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f04900bc810 0x7f04900ba530 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f04840098f0 tx=0x7f0484009c00 comp rx=0 tx=0).stop 2023-07-12T02:01:55.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.032+0000 7f0495a14700 1 -- 172.21.15.79:0/3995829390 shutdown_connections 2023-07-12T02:01:55.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.032+0000 7f0495a14700 1 --2- 172.21.15.79:0/3995829390 >> v2:172.21.15.60:3300/0 conn(0x7f04900b8d90 0x7f049006ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:55.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.032+0000 7f0495a14700 1 --2- 172.21.15.79:0/3995829390 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f04900bc810 0x7f04900ba530 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:55.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.032+0000 7f0495a14700 1 -- 172.21.15.79:0/3995829390 >> 172.21.15.79:0/3995829390 conn(0x7f04900c0860 msgr2=0x7f04900c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:01:55.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.032+0000 7f0495a14700 1 -- 172.21.15.79:0/3995829390 shutdown_connections 2023-07-12T02:01:55.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.032+0000 7f0495a14700 1 -- 172.21.15.79:0/3995829390 wait complete. 2023-07-12T02:01:55.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.033+0000 7f0495a14700 1 Processor -- start 2023-07-12T02:01:55.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.033+0000 7f0495a14700 1 -- start start 2023-07-12T02:01:55.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.033+0000 7f0495a14700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04900b8d90 0x7f04900b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:55.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.033+0000 7f0495a14700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f04900bc810 0x7f04901e39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:55.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.033+0000 7f0495a14700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04901449d0 0x7f04900a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:55.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.033+0000 7f0495a14700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04900b6360 con 0x7f04901449d0 2023-07-12T02:01:55.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.033+0000 7f0495a14700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04900b3530 con 0x7f04900b8d90 2023-07-12T02:01:55.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.033+0000 7f0495a14700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04901e3550 con 0x7f04900bc810 2023-07-12T02:01:55.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.034+0000 7f048e7fc700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f04900bc810 0x7f04901e39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:55.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.034+0000 7f048effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04900b8d90 0x7f04900b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:55.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.034+0000 7f048e7fc700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f04900bc810 0x7f04901e39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.79:60770/0 (socket says 172.21.15.79:60770) 2023-07-12T02:01:55.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.034+0000 7f048e7fc700 1 -- 172.21.15.79:0/2959438262 learned_addr learned my addr 172.21.15.79:0/2959438262 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-07-12T02:01:55.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.034+0000 7f048f7fe700 1 --2- 172.21.15.79:0/2959438262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04901449d0 0x7f04900a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:55.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.034+0000 7f048e7fc700 1 -- 172.21.15.79:0/2959438262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04900b8d90 msgr2=0x7f04900b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:55.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.034+0000 7f048e7fc700 1 --2- 172.21.15.79:0/2959438262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04900b8d90 0x7f04900b5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:55.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.034+0000 7f048e7fc700 1 -- 172.21.15.79:0/2959438262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04901449d0 msgr2=0x7f04900a52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:55.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.034+0000 7f048e7fc700 1 --2- 172.21.15.79:0/2959438262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04901449d0 0x7f04900a52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:55.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.034+0000 7f048e7fc700 1 -- 172.21.15.79:0/2959438262 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0484009550 con 0x7f04900bc810 2023-07-12T02:01:55.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.034+0000 7f048effd700 1 --2- 172.21.15.79:0/2959438262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04900b8d90 0x7f04900b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:01:55.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.034+0000 7f048e7fc700 1 --2- 172.21.15.79:0/2959438262 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f04900bc810 0x7f04901e39e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0484009130 tx=0x7f0484004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:01:55.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.034+0000 7f0477fff700 1 -- 172.21.15.79:0/2959438262 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0484003b90 con 0x7f04900bc810 2023-07-12T02:01:55.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.034+0000 7f0477fff700 1 -- 172.21.15.79:0/2959438262 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f048401f070 con 0x7f04900bc810 2023-07-12T02:01:55.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.034+0000 7f0495a14700 1 -- 172.21.15.79:0/2959438262 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04900b45c0 con 0x7f04900bc810 2023-07-12T02:01:55.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.034+0000 7f0477fff700 1 -- 172.21.15.79:0/2959438262 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048400b660 con 0x7f04900bc810 2023-07-12T02:01:55.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.034+0000 7f0495a14700 1 -- 172.21.15.79:0/2959438262 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04901e31e0 con 0x7f04900bc810 2023-07-12T02:01:55.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.034+0000 7f0477fff700 1 -- 172.21.15.79:0/2959438262 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0484021030 con 0x7f04900bc810 2023-07-12T02:01:55.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.034+0000 7f0477fff700 1 -- 172.21.15.79:0/2959438262 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f048401a8a0 con 0x7f04900bc810 2023-07-12T02:01:55.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.035+0000 7f0495a14700 1 -- 172.21.15.79:0/2959438262 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04901e36c0 con 0x7f04900bc810 2023-07-12T02:01:55.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.037+0000 7f0477fff700 1 -- 172.21.15.79:0/2959438262 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72553 (secure 0 0 0) 0x7f048401a440 con 0x7f04900bc810 2023-07-12T02:01:55.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.120+0000 7f0495a14700 1 -- 172.21.15.79:0/2959438262 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7cf4d354-78e0-43ce-8c09-4a7d2a0b57a5", "id": 1} v 0) v1 -- 0x7f04901e36c0 con 0x7f04900bc810 2023-07-12T02:01:55.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.123+0000 7f0477fff700 1 -- 172.21.15.79:0/2959438262 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7cf4d354-78e0-43ce-8c09-4a7d2a0b57a5", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f048400bca0 con 0x7f04900bc810 2023-07-12T02:01:55.127 INFO:teuthology.orchestra.run.smithi079.stdout:1 2023-07-12T02:01:55.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.124+0000 7f0495a14700 1 -- 172.21.15.79:0/2959438262 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f04900bc810 msgr2=0x7f04901e39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:55.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.124+0000 7f0495a14700 1 --2- 172.21.15.79:0/2959438262 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f04900bc810 0x7f04901e39e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0484009130 tx=0x7f0484004750 comp rx=0 tx=0).stop 2023-07-12T02:01:55.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.124+0000 7f0495a14700 1 -- 172.21.15.79:0/2959438262 shutdown_connections 2023-07-12T02:01:55.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.124+0000 7f0495a14700 1 --2- 172.21.15.79:0/2959438262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04901449d0 0x7f04900a52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:55.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.124+0000 7f0495a14700 1 --2- 172.21.15.79:0/2959438262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04900b8d90 0x7f04900b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:55.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.124+0000 7f0495a14700 1 --2- 172.21.15.79:0/2959438262 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f04900bc810 0x7f04901e39e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:55.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.124+0000 7f0495a14700 1 -- 172.21.15.79:0/2959438262 >> 172.21.15.79:0/2959438262 conn(0x7f04900c0860 msgr2=0x7f04900bf000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:01:55.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.124+0000 7f0495a14700 1 -- 172.21.15.79:0/2959438262 shutdown_connections 2023-07-12T02:01:55.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.124+0000 7f0495a14700 1 -- 172.21.15.79:0/2959438262 wait complete. 2023-07-12T02:01:55.139 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd new 02c958b8-9599-4470-92cb-8f7018ec0189 2 2023-07-12T02:01:55.156 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-07-12T02:01:55.153+0000 7fe07fab8200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-12T02:01:55.232 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-07-12T02:01:55.229+0000 7f25f02fe200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-12T02:01:55.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.258+0000 7fdd41c9f700 1 Processor -- start 2023-07-12T02:01:55.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.258+0000 7fdd41c9f700 1 -- start start 2023-07-12T02:01:55.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.258+0000 7fdd41c9f700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdd3c06b120 0x7fdd3c0b8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:55.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.258+0000 7fdd41c9f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdd3c14aa40 0x7fdd3c14ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:55.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.258+0000 7fdd41c9f700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd3c070410 con 0x7fdd3c1444c0 2023-07-12T02:01:55.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.258+0000 7fdd41c9f700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd3c0b9590 con 0x7fdd3c14aa40 2023-07-12T02:01:55.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.258+0000 7fdd41c9f700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3c14b3d0 con 0x7fdd3c06b120 2023-07-12T02:01:55.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.259+0000 7fdd3affd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdd3c14aa40 0x7fdd3c14ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:55.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.259+0000 7fdd3b7fe700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdd3c06b120 0x7fdd3c0b8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:55.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.259+0000 7fdd3affd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdd3c14aa40 0x7fdd3c14ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56882/0 (socket says 172.21.15.79:56882) 2023-07-12T02:01:55.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.259+0000 7fdd3b7fe700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdd3c06b120 0x7fdd3c0b8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.79:55230/0 (socket says 172.21.15.79:55230) 2023-07-12T02:01:55.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.259+0000 7fdd3affd700 1 -- 172.21.15.79:0/2299957174 learned_addr learned my addr 172.21.15.79:0/2299957174 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-07-12T02:01:55.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.259+0000 7fdd3affd700 1 -- 172.21.15.79:0/2299957174 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdd3c06b120 msgr2=0x7fdd3c0b8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:01:55.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.259+0000 7fdd3affd700 1 --2- 172.21.15.79:0/2299957174 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdd3c06b120 0x7fdd3c0b8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:55.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.259+0000 7fdd3affd700 1 -- 172.21.15.79:0/2299957174 >> v1:172.21.15.60:6789/0 conn(0x7fdd3c1444c0 legacy=0x7fdd3c144920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:55.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.259+0000 7fdd3affd700 1 -- 172.21.15.79:0/2299957174 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd3c06ef60 con 0x7fdd3c14aa40 2023-07-12T02:01:55.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.259+0000 7fdd3b7fe700 1 --2- 172.21.15.79:0/2299957174 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdd3c06b120 0x7fdd3c0b8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:01:55.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.259+0000 7fdd3affd700 1 --2- 172.21.15.79:0/2299957174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd3c14aa40 0x7fdd3c14ae90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdd300098f0 tx=0x7fdd30009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79ef74c347f99055 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:01:55.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.259+0000 7fdd3a7fc700 1 -- 172.21.15.79:0/2299957174 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd30011830 con 0x7fdd3c14aa40 2023-07-12T02:01:55.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.259+0000 7fdd3a7fc700 1 -- 172.21.15.79:0/2299957174 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd30011990 con 0x7fdd3c14aa40 2023-07-12T02:01:55.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.259+0000 7fdd3a7fc700 1 -- 172.21.15.79:0/2299957174 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd30011d20 con 0x7fdd3c14aa40 2023-07-12T02:01:55.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.260+0000 7fdd41c9f700 1 -- 172.21.15.79:0/2299957174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd3c14aa40 msgr2=0x7fdd3c14ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:55.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.260+0000 7fdd41c9f700 1 --2- 172.21.15.79:0/2299957174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd3c14aa40 0x7fdd3c14ae90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdd300098f0 tx=0x7fdd30009c00 comp rx=0 tx=0).stop 2023-07-12T02:01:55.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.260+0000 7fdd41c9f700 1 -- 172.21.15.79:0/2299957174 shutdown_connections 2023-07-12T02:01:55.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.260+0000 7fdd41c9f700 1 --2- 172.21.15.79:0/2299957174 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdd3c06b120 0x7fdd3c0b8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:55.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.260+0000 7fdd41c9f700 1 --2- 172.21.15.79:0/2299957174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd3c14aa40 0x7fdd3c14ae90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:55.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.260+0000 7fdd41c9f700 1 -- 172.21.15.79:0/2299957174 >> 172.21.15.79:0/2299957174 conn(0x7fdd3c0bd980 msgr2=0x7fdd3c0b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:01:55.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.260+0000 7fdd41c9f700 1 -- 172.21.15.79:0/2299957174 shutdown_connections 2023-07-12T02:01:55.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.260+0000 7fdd41c9f700 1 -- 172.21.15.79:0/2299957174 wait complete. 2023-07-12T02:01:55.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.261+0000 7fdd41c9f700 1 Processor -- start 2023-07-12T02:01:55.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.261+0000 7fdd41c9f700 1 -- start start 2023-07-12T02:01:55.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.262+0000 7fdd41c9f700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdd3c06b120 0x7fdd3c13f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:55.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.262+0000 7fdd41c9f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd3c1444c0 0x7fdd3c13ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:55.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.262+0000 7fdd41c9f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd3c14aa40 0x7fdd3c1404a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:55.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.262+0000 7fdd41c9f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3c1456b0 con 0x7fdd3c1444c0 2023-07-12T02:01:55.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.262+0000 7fdd41c9f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3c140ac0 con 0x7fdd3c14aa40 2023-07-12T02:01:55.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.262+0000 7fdd41c9f700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3c13e980 con 0x7fdd3c06b120 2023-07-12T02:01:55.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.262+0000 7fdd3b7fe700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdd3c06b120 0x7fdd3c13f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:55.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.262+0000 7fdd3bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd3c14aa40 0x7fdd3c1404a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:55.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.262+0000 7fdd3b7fe700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdd3c06b120 0x7fdd3c13f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.79:55238/0 (socket says 172.21.15.79:55238) 2023-07-12T02:01:55.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.262+0000 7fdd3b7fe700 1 -- 172.21.15.79:0/2064625506 learned_addr learned my addr 172.21.15.79:0/2064625506 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-07-12T02:01:55.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.262+0000 7fdd3affd700 1 --2- 172.21.15.79:0/2064625506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd3c1444c0 0x7fdd3c13ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:55.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.262+0000 7fdd3b7fe700 1 -- 172.21.15.79:0/2064625506 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd3c14aa40 msgr2=0x7fdd3c1404a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:55.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.262+0000 7fdd3b7fe700 1 --2- 172.21.15.79:0/2064625506 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd3c14aa40 0x7fdd3c1404a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:55.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.262+0000 7fdd3b7fe700 1 -- 172.21.15.79:0/2064625506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd3c1444c0 msgr2=0x7fdd3c13ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:55.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.262+0000 7fdd3b7fe700 1 --2- 172.21.15.79:0/2064625506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd3c1444c0 0x7fdd3c13ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:55.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.262+0000 7fdd3b7fe700 1 -- 172.21.15.79:0/2064625506 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd2c0094a0 con 0x7fdd3c06b120 2023-07-12T02:01:55.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.262+0000 7fdd3b7fe700 1 --2- 172.21.15.79:0/2064625506 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdd3c06b120 0x7fdd3c13f5c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c00ebe0 tx=0x7fdd2c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:01:55.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.262+0000 7fdd23fff700 1 -- 172.21.15.79:0/2064625506 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c009760 con 0x7fdd3c06b120 2023-07-12T02:01:55.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.262+0000 7fdd23fff700 1 -- 172.21.15.79:0/2064625506 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd2c00c850 con 0x7fdd3c06b120 2023-07-12T02:01:55.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.262+0000 7fdd23fff700 1 -- 172.21.15.79:0/2064625506 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c00cbe0 con 0x7fdd3c06b120 2023-07-12T02:01:55.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.262+0000 7fdd41c9f700 1 -- 172.21.15.79:0/2064625506 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd30009550 con 0x7fdd3c06b120 2023-07-12T02:01:55.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.263+0000 7fdd41c9f700 1 -- 172.21.15.79:0/2064625506 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd3c13de80 con 0x7fdd3c06b120 2023-07-12T02:01:55.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.263+0000 7fdd23fff700 1 -- 172.21.15.79:0/2064625506 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdd2c005a20 con 0x7fdd3c06b120 2023-07-12T02:01:55.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.263+0000 7fdd23fff700 1 -- 172.21.15.79:0/2064625506 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fdd2c005cd0 con 0x7fdd3c06b120 2023-07-12T02:01:55.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.263+0000 7fdd41c9f700 1 -- 172.21.15.79:0/2064625506 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd3c13e070 con 0x7fdd3c06b120 2023-07-12T02:01:55.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.266+0000 7fdd23fff700 1 -- 172.21.15.79:0/2064625506 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72553 (secure 0 0 0) 0x7fdd2c021060 con 0x7fdd3c06b120 2023-07-12T02:01:55.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.349+0000 7fdd41c9f700 1 -- 172.21.15.79:0/2064625506 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "osd new", "uuid": "02c958b8-9599-4470-92cb-8f7018ec0189", "id": 2} v 0) v1 -- 0x7fdd3c13eea0 con 0x7fdd3c06b120 2023-07-12T02:01:55.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.352+0000 7fdd23fff700 1 -- 172.21.15.79:0/2064625506 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "02c958b8-9599-4470-92cb-8f7018ec0189", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdd2c029020 con 0x7fdd3c06b120 2023-07-12T02:01:55.356 INFO:teuthology.orchestra.run.smithi079.stdout:2 2023-07-12T02:01:55.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.353+0000 7fdd41c9f700 1 -- 172.21.15.79:0/2064625506 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdd3c06b120 msgr2=0x7fdd3c13f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:55.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.353+0000 7fdd41c9f700 1 --2- 172.21.15.79:0/2064625506 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdd3c06b120 0x7fdd3c13f5c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c00ebe0 tx=0x7fdd2c00eef0 comp rx=0 tx=0).stop 2023-07-12T02:01:55.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.353+0000 7fdd41c9f700 1 -- 172.21.15.79:0/2064625506 shutdown_connections 2023-07-12T02:01:55.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.353+0000 7fdd41c9f700 1 --2- 172.21.15.79:0/2064625506 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd3c14aa40 0x7fdd3c1404a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:55.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.353+0000 7fdd41c9f700 1 --2- 172.21.15.79:0/2064625506 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdd3c06b120 0x7fdd3c13f5c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:55.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.353+0000 7fdd41c9f700 1 --2- 172.21.15.79:0/2064625506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd3c1444c0 0x7fdd3c13ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:55.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.353+0000 7fdd41c9f700 1 -- 172.21.15.79:0/2064625506 >> 172.21.15.79:0/2064625506 conn(0x7fdd3c0bd980 msgr2=0x7fdd3c0b96d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:01:55.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.353+0000 7fdd41c9f700 1 -- 172.21.15.79:0/2064625506 shutdown_connections 2023-07-12T02:01:55.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.353+0000 7fdd41c9f700 1 -- 172.21.15.79:0/2064625506 wait complete. 2023-07-12T02:01:55.358 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-07-12T02:01:55.354+0000 7fe07fab8200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-12T02:01:55.368 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd new bc300432-a228-4257-be5c-e42dd5f2015f 3 2023-07-12T02:01:55.433 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-07-12T02:01:55.430+0000 7f25f02fe200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-12T02:01:55.530 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.526+0000 7f48f4ba8700 1 Processor -- start 2023-07-12T02:01:55.530 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.526+0000 7f48f4ba8700 1 -- start start 2023-07-12T02:01:55.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.527+0000 7f48f4ba8700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f48f0144820 0x7f48f00b65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:55.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.527+0000 7f48f4ba8700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48f014af10 0x7f48f00b6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:55.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.527+0000 7f48f4ba8700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48f00b5f00 con 0x7f48f00b5a10 2023-07-12T02:01:55.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.527+0000 7f48f4ba8700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48f00b61e0 con 0x7f48f0144820 2023-07-12T02:01:55.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.527+0000 7f48f4ba8700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f00c17d0 con 0x7f48f014af10 2023-07-12T02:01:55.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.527+0000 7f48eed9d700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48f014af10 0x7f48f00b6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:55.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.527+0000 7f48edd9b700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f48f00b5a10 0x7f48f014a800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52798/0 (socket says 172.21.15.79:52798) 2023-07-12T02:01:55.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.527+0000 7f48edd9b700 1 -- 172.21.15.79:0/1769701563 learned_addr learned my addr 172.21.15.79:0/1769701563 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-07-12T02:01:55.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.527+0000 7f48ee59c700 1 --2- 172.21.15.79:0/1769701563 >> v2:172.21.15.60:3300/0 conn(0x7f48f0144820 0x7f48f00b65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:55.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.527+0000 7f48ed59a700 1 -- 172.21.15.79:0/1769701563 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1223075156 0 0) 0x7f48f00b5f00 con 0x7f48f00b5a10 2023-07-12T02:01:55.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.527+0000 7f48ed59a700 1 -- 172.21.15.79:0/1769701563 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48d80035b0 con 0x7f48f00b5a10 2023-07-12T02:01:55.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.528+0000 7f48eed9d700 1 -- 172.21.15.79:0/1769701563 >> v2:172.21.15.60:3300/0 conn(0x7f48f0144820 msgr2=0x7f48f00b65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:01:55.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.528+0000 7f48eed9d700 1 --2- 172.21.15.79:0/1769701563 >> v2:172.21.15.60:3300/0 conn(0x7f48f0144820 0x7f48f00b65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:55.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.528+0000 7f48eed9d700 1 -- 172.21.15.79:0/1769701563 >> v1:172.21.15.79:6789/0 conn(0x7f48f00b5a10 legacy=0x7f48f014a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:55.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.528+0000 7f48eed9d700 1 -- 172.21.15.79:0/1769701563 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f00b7160 con 0x7f48f014af10 2023-07-12T02:01:55.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.528+0000 7f48ee59c700 1 --2- 172.21.15.79:0/1769701563 >> v2:172.21.15.60:3300/0 conn(0x7f48f0144820 0x7f48f00b65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:01:55.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.528+0000 7f48eed9d700 1 --2- 172.21.15.79:0/1769701563 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48f014af10 0x7f48f00b6b10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f48e8009d90 tx=0x7f48e800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb423d14266a44c3 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:01:55.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.528+0000 7f48ed59a700 1 -- 172.21.15.79:0/1769701563 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e800e070 con 0x7f48f014af10 2023-07-12T02:01:55.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.528+0000 7f48ed59a700 1 -- 172.21.15.79:0/1769701563 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e800bb20 con 0x7f48f014af10 2023-07-12T02:01:55.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.528+0000 7f48ed59a700 1 -- 172.21.15.79:0/1769701563 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e8012430 con 0x7f48f014af10 2023-07-12T02:01:55.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.528+0000 7f48f4ba8700 1 -- 172.21.15.79:0/1769701563 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48f014af10 msgr2=0x7f48f00b6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:55.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.528+0000 7f48f4ba8700 1 --2- 172.21.15.79:0/1769701563 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48f014af10 0x7f48f00b6b10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f48e8009d90 tx=0x7f48e800b330 comp rx=0 tx=0).stop 2023-07-12T02:01:55.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.529+0000 7f48f4ba8700 1 -- 172.21.15.79:0/1769701563 shutdown_connections 2023-07-12T02:01:55.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.529+0000 7f48f4ba8700 1 --2- 172.21.15.79:0/1769701563 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48f014af10 0x7f48f00b6b10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:55.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.529+0000 7f48f4ba8700 1 --2- 172.21.15.79:0/1769701563 >> v2:172.21.15.60:3300/0 conn(0x7f48f0144820 0x7f48f00b65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:55.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.529+0000 7f48f4ba8700 1 -- 172.21.15.79:0/1769701563 >> 172.21.15.79:0/1769701563 conn(0x7f48f00c08f0 msgr2=0x7f48f00c0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:01:55.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.529+0000 7f48f4ba8700 1 -- 172.21.15.79:0/1769701563 shutdown_connections 2023-07-12T02:01:55.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.529+0000 7f48f4ba8700 1 -- 172.21.15.79:0/1769701563 wait complete. 2023-07-12T02:01:55.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.530+0000 7f48f4ba8700 1 Processor -- start 2023-07-12T02:01:55.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.530+0000 7f48f4ba8700 1 -- start start 2023-07-12T02:01:55.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.530+0000 7f48f4ba8700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48f00b5a10 0x7f48f0147650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:55.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.530+0000 7f48f4ba8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48f0144820 0x7f48f0145140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:55.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.530+0000 7f48f4ba8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48f014af10 0x7f48f0146690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:55.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.530+0000 7f48f4ba8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f01459d0 con 0x7f48f014af10 2023-07-12T02:01:55.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.530+0000 7f48f4ba8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f0146170 con 0x7f48f0144820 2023-07-12T02:01:55.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.530+0000 7f48f4ba8700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f0147b90 con 0x7f48f00b5a10 2023-07-12T02:01:55.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.531+0000 7f48edd9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48f0144820 0x7f48f0145140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:55.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.531+0000 7f48edd9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48f0144820 0x7f48f0145140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56908/0 (socket says 172.21.15.79:56908) 2023-07-12T02:01:55.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.531+0000 7f48edd9b700 1 -- 172.21.15.79:0/404711017 learned_addr learned my addr 172.21.15.79:0/404711017 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-07-12T02:01:55.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.531+0000 7f48ee59c700 1 --2- 172.21.15.79:0/404711017 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48f00b5a10 0x7f48f0147650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:55.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.531+0000 7f48eed9d700 1 --2- 172.21.15.79:0/404711017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48f014af10 0x7f48f0146690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:55.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.531+0000 7f48ee59c700 1 -- 172.21.15.79:0/404711017 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48f0144820 msgr2=0x7f48f0145140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:55.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.531+0000 7f48ee59c700 1 --2- 172.21.15.79:0/404711017 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48f0144820 0x7f48f0145140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:55.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.531+0000 7f48ee59c700 1 -- 172.21.15.79:0/404711017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48f014af10 msgr2=0x7f48f0146690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:55.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.531+0000 7f48ee59c700 1 --2- 172.21.15.79:0/404711017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48f014af10 0x7f48f0146690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:55.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.531+0000 7f48ee59c700 1 -- 172.21.15.79:0/404711017 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e8009a70 con 0x7f48f00b5a10 2023-07-12T02:01:55.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.531+0000 7f48edd9b700 1 --2- 172.21.15.79:0/404711017 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48f0144820 0x7f48f0145140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:01:55.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.531+0000 7f48ee59c700 1 --2- 172.21.15.79:0/404711017 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48f00b5a10 0x7f48f0147650 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f48e000e810 tx=0x7f48e000eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:01:55.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.531+0000 7f48deffd700 1 -- 172.21.15.79:0/404711017 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e000c070 con 0x7f48f00b5a10 2023-07-12T02:01:55.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.531+0000 7f48deffd700 1 -- 172.21.15.79:0/404711017 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e0004230 con 0x7f48f00b5a10 2023-07-12T02:01:55.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.531+0000 7f48f4ba8700 1 -- 172.21.15.79:0/404711017 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48f0145680 con 0x7f48f00b5a10 2023-07-12T02:01:55.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.531+0000 7f48deffd700 1 -- 172.21.15.79:0/404711017 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e00036a0 con 0x7f48f00b5a10 2023-07-12T02:01:55.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.531+0000 7f48f4ba8700 1 -- 172.21.15.79:0/404711017 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48f014a150 con 0x7f48f00b5a10 2023-07-12T02:01:55.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.531+0000 7f48deffd700 1 -- 172.21.15.79:0/404711017 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f48e0003b00 con 0x7f48f00b5a10 2023-07-12T02:01:55.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.531+0000 7f48deffd700 1 -- 172.21.15.79:0/404711017 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f48e001c400 con 0x7f48f00b5a10 2023-07-12T02:01:55.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.532+0000 7f48f4ba8700 1 -- 172.21.15.79:0/404711017 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48f0145fd0 con 0x7f48f00b5a10 2023-07-12T02:01:55.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.534+0000 7f48deffd700 1 -- 172.21.15.79:0/404711017 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72553 (secure 0 0 0) 0x7f48f0145fd0 con 0x7f48f00b5a10 2023-07-12T02:01:55.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.617+0000 7f48f4ba8700 1 -- 172.21.15.79:0/404711017 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "osd new", "uuid": "bc300432-a228-4257-be5c-e42dd5f2015f", "id": 3} v 0) v1 -- 0x7f48f0074360 con 0x7f48f00b5a10 2023-07-12T02:01:55.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.620+0000 7f48deffd700 1 -- 172.21.15.79:0/404711017 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bc300432-a228-4257-be5c-e42dd5f2015f", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f48e000f040 con 0x7f48f00b5a10 2023-07-12T02:01:55.624 INFO:teuthology.orchestra.run.smithi079.stdout:3 2023-07-12T02:01:55.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.621+0000 7f48f4ba8700 1 -- 172.21.15.79:0/404711017 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48f00b5a10 msgr2=0x7f48f0147650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:55.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.621+0000 7f48f4ba8700 1 --2- 172.21.15.79:0/404711017 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48f00b5a10 0x7f48f0147650 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f48e000e810 tx=0x7f48e000eb20 comp rx=0 tx=0).stop 2023-07-12T02:01:55.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.621+0000 7f48f4ba8700 1 -- 172.21.15.79:0/404711017 shutdown_connections 2023-07-12T02:01:55.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.621+0000 7f48f4ba8700 1 --2- 172.21.15.79:0/404711017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48f014af10 0x7f48f0146690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:55.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.621+0000 7f48f4ba8700 1 --2- 172.21.15.79:0/404711017 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48f00b5a10 0x7f48f0147650 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:55.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.621+0000 7f48f4ba8700 1 --2- 172.21.15.79:0/404711017 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48f0144820 0x7f48f0145140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:55.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.621+0000 7f48f4ba8700 1 -- 172.21.15.79:0/404711017 >> 172.21.15.79:0/404711017 conn(0x7f48f00c08f0 msgr2=0x7f48f01436d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:01:55.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.621+0000 7f48f4ba8700 1 -- 172.21.15.79:0/404711017 shutdown_connections 2023-07-12T02:01:55.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.622+0000 7f48f4ba8700 1 -- 172.21.15.79:0/404711017 wait complete. 2023-07-12T02:01:55.637 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd new ad9f7dc4-7126-466d-a656-2844880c6060 4 2023-07-12T02:01:55.732 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-07-12T02:01:55.729+0000 7fe07fab8200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-12T02:01:55.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.757+0000 7efcef494700 1 Processor -- start 2023-07-12T02:01:55.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.757+0000 7efcef494700 1 -- start start 2023-07-12T02:01:55.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.758+0000 7efcef494700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efce8070d80 0x7efce814b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:55.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.758+0000 7efcef494700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efce806bce0 0x7efce8155260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:55.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.758+0000 7efcef494700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efce80701a0 con 0x7efce8071910 2023-07-12T02:01:55.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.758+0000 7efcef494700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efce80711b0 con 0x7efce806bce0 2023-07-12T02:01:55.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.758+0000 7efcef494700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce80713d0 con 0x7efce8070d80 2023-07-12T02:01:55.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.758+0000 7efced230700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7efce8071910 0x7efce806c770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52814/0 (socket says 172.21.15.79:52814) 2023-07-12T02:01:55.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.758+0000 7efceca2f700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efce8070d80 0x7efce814b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:55.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.758+0000 7efced230700 1 -- 172.21.15.79:0/613632323 learned_addr learned my addr 172.21.15.79:0/613632323 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-07-12T02:01:55.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.758+0000 7efceda31700 1 --2- 172.21.15.79:0/613632323 >> v2:172.21.15.60:3300/0 conn(0x7efce806bce0 0x7efce8155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:55.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.758+0000 7efcdffff700 1 -- 172.21.15.79:0/613632323 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2596264512 0 0) 0x7efce80701a0 con 0x7efce8071910 2023-07-12T02:01:55.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.758+0000 7efcdffff700 1 -- 172.21.15.79:0/613632323 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcd40035b0 con 0x7efce8071910 2023-07-12T02:01:55.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.758+0000 7efceca2f700 1 -- 172.21.15.79:0/613632323 >> v2:172.21.15.60:3300/0 conn(0x7efce806bce0 msgr2=0x7efce8155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:01:55.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.758+0000 7efceca2f700 1 --2- 172.21.15.79:0/613632323 >> v2:172.21.15.60:3300/0 conn(0x7efce806bce0 0x7efce8155260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:55.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.758+0000 7efceca2f700 1 -- 172.21.15.79:0/613632323 >> v1:172.21.15.79:6789/0 conn(0x7efce8071910 legacy=0x7efce806c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:55.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.758+0000 7efceca2f700 1 -- 172.21.15.79:0/613632323 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce814aa30 con 0x7efce8070d80 2023-07-12T02:01:55.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.758+0000 7efceca2f700 1 --2- 172.21.15.79:0/613632323 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efce8070d80 0x7efce814b510 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7efcd8009840 tx=0x7efcd8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ea79eae22a78b0a server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:01:55.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.758+0000 7efcdffff700 1 -- 172.21.15.79:0/613632323 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd8011830 con 0x7efce8070d80 2023-07-12T02:01:55.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.758+0000 7efcdffff700 1 -- 172.21.15.79:0/613632323 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd8011990 con 0x7efce8070d80 2023-07-12T02:01:55.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.758+0000 7efcdffff700 1 -- 172.21.15.79:0/613632323 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd8011d20 con 0x7efce8070d80 2023-07-12T02:01:55.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.759+0000 7efcef494700 1 -- 172.21.15.79:0/613632323 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efce8070d80 msgr2=0x7efce814b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:55.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.759+0000 7efcef494700 1 --2- 172.21.15.79:0/613632323 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efce8070d80 0x7efce814b510 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7efcd8009840 tx=0x7efcd8009b50 comp rx=0 tx=0).stop 2023-07-12T02:01:55.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.759+0000 7efcef494700 1 -- 172.21.15.79:0/613632323 shutdown_connections 2023-07-12T02:01:55.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.759+0000 7efcef494700 1 --2- 172.21.15.79:0/613632323 >> v2:172.21.15.60:3300/0 conn(0x7efce806bce0 0x7efce8155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:55.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.759+0000 7efcef494700 1 --2- 172.21.15.79:0/613632323 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efce8070d80 0x7efce814b510 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:55.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.759+0000 7efcef494700 1 -- 172.21.15.79:0/613632323 >> 172.21.15.79:0/613632323 conn(0x7efce80be670 msgr2=0x7efce80bea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:01:55.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.759+0000 7efcef494700 1 -- 172.21.15.79:0/613632323 shutdown_connections 2023-07-12T02:01:55.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.759+0000 7efcef494700 1 -- 172.21.15.79:0/613632323 wait complete. 2023-07-12T02:01:55.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.761+0000 7efcef494700 1 Processor -- start 2023-07-12T02:01:55.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.761+0000 7efcef494700 1 -- start start 2023-07-12T02:01:55.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.761+0000 7efcef494700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efce806bce0 0x7efce81e3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:55.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.761+0000 7efcef494700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efce8070d80 0x7efce80b2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:55.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.761+0000 7efcef494700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efce8071910 0x7efce80b2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:55.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.761+0000 7efcef494700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce80b21a0 con 0x7efce8071910 2023-07-12T02:01:55.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.761+0000 7efcef494700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce81427c0 con 0x7efce806bce0 2023-07-12T02:01:55.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.761+0000 7efcef494700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce81e3fb0 con 0x7efce8070d80 2023-07-12T02:01:55.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.761+0000 7efced230700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efce806bce0 0x7efce81e3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:55.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.762+0000 7efceca2f700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efce8070d80 0x7efce80b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:55.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.762+0000 7efced230700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efce806bce0 0x7efce81e3380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56914/0 (socket says 172.21.15.79:56914) 2023-07-12T02:01:55.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.762+0000 7efceca2f700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efce8070d80 0x7efce80b2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.79:55284/0 (socket says 172.21.15.79:55284) 2023-07-12T02:01:55.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.762+0000 7efced230700 1 -- 172.21.15.79:0/3475683081 learned_addr learned my addr 172.21.15.79:0/3475683081 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-07-12T02:01:55.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.762+0000 7efceda31700 1 --2- 172.21.15.79:0/3475683081 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efce8071910 0x7efce80b2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:55.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.762+0000 7efceca2f700 1 -- 172.21.15.79:0/3475683081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efce806bce0 msgr2=0x7efce81e3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:55.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.762+0000 7efceca2f700 1 --2- 172.21.15.79:0/3475683081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efce806bce0 0x7efce81e3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:55.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.762+0000 7efceca2f700 1 -- 172.21.15.79:0/3475683081 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efce8071910 msgr2=0x7efce80b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:55.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.762+0000 7efceca2f700 1 --2- 172.21.15.79:0/3475683081 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efce8071910 0x7efce80b2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:55.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.762+0000 7efceca2f700 1 -- 172.21.15.79:0/3475683081 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd80094a0 con 0x7efce8070d80 2023-07-12T02:01:55.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.762+0000 7efced230700 1 --2- 172.21.15.79:0/3475683081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efce806bce0 0x7efce81e3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:01:55.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.762+0000 7efceca2f700 1 --2- 172.21.15.79:0/3475683081 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efce8070d80 0x7efce80b2630 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7efcd8016000 tx=0x7efcd8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:01:55.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.762+0000 7efcddffb700 1 -- 172.21.15.79:0/3475683081 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd8004590 con 0x7efce8070d80 2023-07-12T02:01:55.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.762+0000 7efcddffb700 1 -- 172.21.15.79:0/3475683081 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd801f070 con 0x7efce8070d80 2023-07-12T02:01:55.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.762+0000 7efcef494700 1 -- 172.21.15.79:0/3475683081 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efce80b8760 con 0x7efce8070d80 2023-07-12T02:01:55.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.762+0000 7efcddffb700 1 -- 172.21.15.79:0/3475683081 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd80038e0 con 0x7efce8070d80 2023-07-12T02:01:55.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.762+0000 7efcef494700 1 -- 172.21.15.79:0/3475683081 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efce80b4bd0 con 0x7efce8070d80 2023-07-12T02:01:55.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.763+0000 7efcddffb700 1 -- 172.21.15.79:0/3475683081 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7efcd8003d40 con 0x7efce8070d80 2023-07-12T02:01:55.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.763+0000 7efcddffb700 1 -- 172.21.15.79:0/3475683081 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7efcd8021070 con 0x7efce8070d80 2023-07-12T02:01:55.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.764+0000 7efcef494700 1 -- 172.21.15.79:0/3475683081 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efce80b2350 con 0x7efce8070d80 2023-07-12T02:01:55.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.766+0000 7efcddffb700 1 -- 172.21.15.79:0/3475683081 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72553 (secure 0 0 0) 0x7efce80b2350 con 0x7efce8070d80 2023-07-12T02:01:55.806 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-07-12T02:01:55.803+0000 7f25f02fe200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-12T02:01:55.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.848+0000 7efcef494700 1 -- 172.21.15.79:0/3475683081 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ad9f7dc4-7126-466d-a656-2844880c6060", "id": 4} v 0) v1 -- 0x7efce80672b0 con 0x7efce8070d80 2023-07-12T02:01:55.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.852+0000 7efcddffb700 1 -- 172.21.15.79:0/3475683081 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ad9f7dc4-7126-466d-a656-2844880c6060", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7efcd802b020 con 0x7efce8070d80 2023-07-12T02:01:55.856 INFO:teuthology.orchestra.run.smithi079.stdout:4 2023-07-12T02:01:55.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.852+0000 7efcef494700 1 -- 172.21.15.79:0/3475683081 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efce8070d80 msgr2=0x7efce80b2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:55.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.852+0000 7efcef494700 1 --2- 172.21.15.79:0/3475683081 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efce8070d80 0x7efce80b2630 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7efcd8016000 tx=0x7efcd8004750 comp rx=0 tx=0).stop 2023-07-12T02:01:55.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.853+0000 7efcef494700 1 -- 172.21.15.79:0/3475683081 shutdown_connections 2023-07-12T02:01:55.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.853+0000 7efcef494700 1 --2- 172.21.15.79:0/3475683081 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efce8071910 0x7efce80b2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:55.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.853+0000 7efcef494700 1 --2- 172.21.15.79:0/3475683081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efce806bce0 0x7efce81e3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:55.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.853+0000 7efcef494700 1 --2- 172.21.15.79:0/3475683081 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efce8070d80 0x7efce80b2630 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:55.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.853+0000 7efcef494700 1 -- 172.21.15.79:0/3475683081 >> 172.21.15.79:0/3475683081 conn(0x7efce80be670 msgr2=0x7efce8147fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:01:55.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.853+0000 7efcef494700 1 -- 172.21.15.79:0/3475683081 shutdown_connections 2023-07-12T02:01:55.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.853+0000 7efcef494700 1 -- 172.21.15.79:0/3475683081 wait complete. 2023-07-12T02:01:55.867 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd new e88d16ca-0b01-4ab9-8aa8-c4aff7f210f7 5 2023-07-12T02:01:55.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.988+0000 7f16e32c8700 1 Processor -- start 2023-07-12T02:01:55.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.988+0000 7f16e32c8700 1 -- start start 2023-07-12T02:01:55.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.988+0000 7f16e32c8700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f16dc071bc0 0x7f16dc0b7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:55.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.988+0000 7f16e32c8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f16dc0ba3e0 0x7f16dc142410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:55.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.988+0000 7f16e32c8700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16dc0ba010 con 0x7f16dc0717f0 2023-07-12T02:01:55.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.988+0000 7f16e32c8700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16dc0b9570 con 0x7f16dc0ba3e0 2023-07-12T02:01:55.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.988+0000 7f16e32c8700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc0ba860 con 0x7f16dc071bc0 2023-07-12T02:01:55.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.989+0000 7f16e0863700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f16dc071bc0 0x7f16dc0b7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:55.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.989+0000 7f16e1865700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f16dc0ba3e0 0x7f16dc142410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:55.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.989+0000 7f16e0863700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f16dc071bc0 0x7f16dc0b7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.79:55298/0 (socket says 172.21.15.79:55298) 2023-07-12T02:01:55.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.989+0000 7f16e0863700 1 -- 172.21.15.79:0/2478617428 learned_addr learned my addr 172.21.15.79:0/2478617428 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-07-12T02:01:55.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.989+0000 7f16e0863700 1 -- 172.21.15.79:0/2478617428 >> v2:172.21.15.79:3300/0 conn(0x7f16dc0ba3e0 msgr2=0x7f16dc142410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:01:55.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.989+0000 7f16e0863700 1 --2- 172.21.15.79:0/2478617428 >> v2:172.21.15.79:3300/0 conn(0x7f16dc0ba3e0 0x7f16dc142410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:55.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.989+0000 7f16e0863700 1 -- 172.21.15.79:0/2478617428 >> v1:172.21.15.60:6789/0 conn(0x7f16dc0717f0 legacy=0x7f16dc0b8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:55.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.989+0000 7f16d3fff700 1 -- 172.21.15.79:0/2478617428 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 537195261 0 0) 0x7f16dc0ba010 con 0x7f16dc0717f0 2023-07-12T02:01:55.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.989+0000 7f16e0863700 1 -- 172.21.15.79:0/2478617428 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16dc0b85a0 con 0x7f16dc071bc0 2023-07-12T02:01:55.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.989+0000 7f16e0863700 1 --2- 172.21.15.79:0/2478617428 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f16dc071bc0 0x7f16dc0b7f80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f16cc009920 tx=0x7f16cc009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fde3f26588f21a0d server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:01:55.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.989+0000 7f16d3fff700 1 -- 172.21.15.79:0/2478617428 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc011830 con 0x7f16dc071bc0 2023-07-12T02:01:55.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.989+0000 7f16d3fff700 1 -- 172.21.15.79:0/2478617428 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16cc011990 con 0x7f16dc071bc0 2023-07-12T02:01:55.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.989+0000 7f16d3fff700 1 -- 172.21.15.79:0/2478617428 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc011d20 con 0x7f16dc071bc0 2023-07-12T02:01:55.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.990+0000 7f16e32c8700 1 -- 172.21.15.79:0/2478617428 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f16dc071bc0 msgr2=0x7f16dc0b7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:55.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.990+0000 7f16e32c8700 1 --2- 172.21.15.79:0/2478617428 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f16dc071bc0 0x7f16dc0b7f80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f16cc009920 tx=0x7f16cc009c30 comp rx=0 tx=0).stop 2023-07-12T02:01:55.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.990+0000 7f16e32c8700 1 -- 172.21.15.79:0/2478617428 shutdown_connections 2023-07-12T02:01:55.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.990+0000 7f16e32c8700 1 --2- 172.21.15.79:0/2478617428 >> v2:172.21.15.79:3300/0 conn(0x7f16dc0ba3e0 0x7f16dc142410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:55.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.990+0000 7f16e32c8700 1 --2- 172.21.15.79:0/2478617428 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f16dc071bc0 0x7f16dc0b7f80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:55.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.990+0000 7f16e32c8700 1 -- 172.21.15.79:0/2478617428 >> 172.21.15.79:0/2478617428 conn(0x7f16dc06d0e0 msgr2=0x7f16dc06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:01:55.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.990+0000 7f16e32c8700 1 -- 172.21.15.79:0/2478617428 shutdown_connections 2023-07-12T02:01:55.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.990+0000 7f16e32c8700 1 -- 172.21.15.79:0/2478617428 wait complete. 2023-07-12T02:01:55.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.991+0000 7f16e32c8700 1 Processor -- start 2023-07-12T02:01:55.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.991+0000 7f16e32c8700 1 -- start start 2023-07-12T02:01:55.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.992+0000 7f16e32c8700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f16dc0717f0 0x7f16dc13dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:55.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.992+0000 7f16e32c8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16dc071bc0 0x7f16dc1d2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:56.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.992+0000 7f16e32c8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16dc0ba3e0 0x7f16dc0703f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:56.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.992+0000 7f16e32c8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc13e230 con 0x7f16dc0ba3e0 2023-07-12T02:01:56.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.992+0000 7f16e32c8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc1d2560 con 0x7f16dc071bc0 2023-07-12T02:01:56.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.992+0000 7f16e32c8700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc13f890 con 0x7f16dc0717f0 2023-07-12T02:01:56.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.992+0000 7f16e0863700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16dc071bc0 0x7f16dc1d2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:56.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.992+0000 7f16e1064700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f16dc0717f0 0x7f16dc13dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:56.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.992+0000 7f16e0863700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16dc071bc0 0x7f16dc1d2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56932/0 (socket says 172.21.15.79:56932) 2023-07-12T02:01:56.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.992+0000 7f16e0863700 1 -- 172.21.15.79:0/2560830062 learned_addr learned my addr 172.21.15.79:0/2560830062 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-07-12T02:01:56.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.992+0000 7f16e1865700 1 --2- 172.21.15.79:0/2560830062 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16dc0ba3e0 0x7f16dc0703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:56.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.992+0000 7f16e0863700 1 -- 172.21.15.79:0/2560830062 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f16dc0717f0 msgr2=0x7f16dc13dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:56.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.992+0000 7f16e0863700 1 --2- 172.21.15.79:0/2560830062 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f16dc0717f0 0x7f16dc13dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:56.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.992+0000 7f16e0863700 1 -- 172.21.15.79:0/2560830062 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16dc0ba3e0 msgr2=0x7f16dc0703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:56.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.992+0000 7f16e0863700 1 --2- 172.21.15.79:0/2560830062 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16dc0ba3e0 0x7f16dc0703f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:56.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.992+0000 7f16e0863700 1 -- 172.21.15.79:0/2560830062 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16cc009550 con 0x7f16dc071bc0 2023-07-12T02:01:56.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.992+0000 7f16e0863700 1 --2- 172.21.15.79:0/2560830062 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16dc071bc0 0x7f16dc1d2020 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f16cc0098f0 tx=0x7f16cc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:01:56.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.992+0000 7f16d1ffb700 1 -- 172.21.15.79:0/2560830062 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc004240 con 0x7f16dc071bc0 2023-07-12T02:01:56.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.992+0000 7f16d1ffb700 1 -- 172.21.15.79:0/2560830062 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16cc01f070 con 0x7f16dc071bc0 2023-07-12T02:01:56.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.992+0000 7f16e32c8700 1 -- 172.21.15.79:0/2560830062 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16dc13efd0 con 0x7f16dc071bc0 2023-07-12T02:01:56.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.992+0000 7f16d1ffb700 1 -- 172.21.15.79:0/2560830062 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc0045e0 con 0x7f16dc071bc0 2023-07-12T02:01:56.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.993+0000 7f16e32c8700 1 -- 172.21.15.79:0/2560830062 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16dc06f910 con 0x7f16dc071bc0 2023-07-12T02:01:56.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.993+0000 7f16d1ffb700 1 -- 172.21.15.79:0/2560830062 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f16cc021030 con 0x7f16dc071bc0 2023-07-12T02:01:56.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.993+0000 7f16d1ffb700 1 -- 172.21.15.79:0/2560830062 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f16cc01acf0 con 0x7f16dc071bc0 2023-07-12T02:01:56.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.993+0000 7f16e32c8700 1 -- 172.21.15.79:0/2560830062 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16dc074360 con 0x7f16dc071bc0 2023-07-12T02:01:56.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:55.996+0000 7f16d1ffb700 1 -- 172.21.15.79:0/2560830062 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72553 (secure 0 0 0) 0x7f16cc015020 con 0x7f16dc071bc0 2023-07-12T02:01:56.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.078+0000 7f16e32c8700 1 -- 172.21.15.79:0/2560830062 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e88d16ca-0b01-4ab9-8aa8-c4aff7f210f7", "id": 5} v 0) v1 -- 0x7f16dc0bbb60 con 0x7f16dc071bc0 2023-07-12T02:01:56.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.081+0000 7f16d1ffb700 1 -- 172.21.15.79:0/2560830062 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e88d16ca-0b01-4ab9-8aa8-c4aff7f210f7", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f16cc003a90 con 0x7f16dc071bc0 2023-07-12T02:01:56.085 INFO:teuthology.orchestra.run.smithi079.stdout:5 2023-07-12T02:01:56.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.082+0000 7f16e32c8700 1 -- 172.21.15.79:0/2560830062 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16dc071bc0 msgr2=0x7f16dc1d2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:56.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.082+0000 7f16e32c8700 1 --2- 172.21.15.79:0/2560830062 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16dc071bc0 0x7f16dc1d2020 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f16cc0098f0 tx=0x7f16cc004750 comp rx=0 tx=0).stop 2023-07-12T02:01:56.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.082+0000 7f16e32c8700 1 -- 172.21.15.79:0/2560830062 shutdown_connections 2023-07-12T02:01:56.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.082+0000 7f16e32c8700 1 --2- 172.21.15.79:0/2560830062 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16dc0ba3e0 0x7f16dc0703f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:56.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.082+0000 7f16e32c8700 1 --2- 172.21.15.79:0/2560830062 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f16dc0717f0 0x7f16dc13dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:56.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.082+0000 7f16e32c8700 1 --2- 172.21.15.79:0/2560830062 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16dc071bc0 0x7f16dc1d2020 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:56.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.082+0000 7f16e32c8700 1 -- 172.21.15.79:0/2560830062 >> 172.21.15.79:0/2560830062 conn(0x7f16dc06d0e0 msgr2=0x7f16dc0bd600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:01:56.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.082+0000 7f16e32c8700 1 -- 172.21.15.79:0/2560830062 shutdown_connections 2023-07-12T02:01:56.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.082+0000 7f16e32c8700 1 -- 172.21.15.79:0/2560830062 wait complete. 2023-07-12T02:01:56.097 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd new 6898cb84-56d1-48a9-bd45-97e4668e2fe9 6 2023-07-12T02:01:56.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.216+0000 7f2836c13700 1 Processor -- start 2023-07-12T02:01:56.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.216+0000 7f2836c13700 1 -- start start 2023-07-12T02:01:56.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.216+0000 7f2836c13700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2830144820 0x7f28300b65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:56.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.216+0000 7f2836c13700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28300b5f00 con 0x7f283014af10 2023-07-12T02:01:56.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.216+0000 7f2836c13700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28300b61e0 con 0x7f28300b5a10 2023-07-12T02:01:56.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.216+0000 7f2836c13700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28300c17d0 con 0x7f2830144820 2023-07-12T02:01:56.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.216+0000 7f28349af700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2830144820 0x7f28300b65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:56.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.216+0000 7f282ffff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f28300b5a10 0x7f283014a800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52830/0 (socket says 172.21.15.79:52830) 2023-07-12T02:01:56.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.217+0000 7f282ffff700 1 -- 172.21.15.79:0/841217224 learned_addr learned my addr 172.21.15.79:0/841217224 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-07-12T02:01:56.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.217+0000 7f28349af700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2830144820 0x7f28300b65d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56934/0 (socket says 172.21.15.79:56934) 2023-07-12T02:01:56.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.217+0000 7f28349af700 1 -- 172.21.15.79:0/841217224 >> v1:172.21.15.79:6789/0 conn(0x7f28300b5a10 legacy=0x7f283014a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:56.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.217+0000 7f28349af700 1 -- 172.21.15.79:0/841217224 >> v1:172.21.15.60:6789/0 conn(0x7f283014af10 legacy=0x7f2830154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:56.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.217+0000 7f28349af700 1 -- 172.21.15.79:0/841217224 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28300b7160 con 0x7f2830144820 2023-07-12T02:01:56.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.217+0000 7f28349af700 1 --2- 172.21.15.79:0/841217224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2830144820 0x7f28300b65d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2824009840 tx=0x7f2824009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c88762893ea885e server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:01:56.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.217+0000 7f282f7fe700 1 -- 172.21.15.79:0/841217224 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2824011830 con 0x7f2830144820 2023-07-12T02:01:56.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.217+0000 7f282f7fe700 1 -- 172.21.15.79:0/841217224 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2824011990 con 0x7f2830144820 2023-07-12T02:01:56.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.217+0000 7f282f7fe700 1 -- 172.21.15.79:0/841217224 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2824011d20 con 0x7f2830144820 2023-07-12T02:01:56.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.218+0000 7f2836c13700 1 -- 172.21.15.79:0/841217224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2830144820 msgr2=0x7f28300b65d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:56.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.218+0000 7f2836c13700 1 --2- 172.21.15.79:0/841217224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2830144820 0x7f28300b65d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2824009840 tx=0x7f2824009b50 comp rx=0 tx=0).stop 2023-07-12T02:01:56.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.218+0000 7f2836c13700 1 -- 172.21.15.79:0/841217224 shutdown_connections 2023-07-12T02:01:56.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.218+0000 7f2836c13700 1 --2- 172.21.15.79:0/841217224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2830144820 0x7f28300b65d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:56.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.218+0000 7f2836c13700 1 -- 172.21.15.79:0/841217224 >> 172.21.15.79:0/841217224 conn(0x7f28300c08f0 msgr2=0x7f28300c0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:01:56.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.218+0000 7f2836c13700 1 -- 172.21.15.79:0/841217224 shutdown_connections 2023-07-12T02:01:56.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.218+0000 7f2836c13700 1 -- 172.21.15.79:0/841217224 wait complete. 2023-07-12T02:01:56.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.219+0000 7f2836c13700 1 Processor -- start 2023-07-12T02:01:56.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.219+0000 7f2836c13700 1 -- start start 2023-07-12T02:01:56.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.220+0000 7f2836c13700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28300b5a10 0x7f2830149c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:56.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.220+0000 7f2836c13700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2830144820 0x7f28301460d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:56.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.220+0000 7f2836c13700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f283014af10 0x7f2830146610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:56.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.220+0000 7f2836c13700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2830139d80 con 0x7f2830144820 2023-07-12T02:01:56.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.220+0000 7f2836c13700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283014a1a0 con 0x7f28300b5a10 2023-07-12T02:01:56.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.220+0000 7f2836c13700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28301e4870 con 0x7f283014af10 2023-07-12T02:01:56.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.220+0000 7f28351b0700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f283014af10 0x7f2830146610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:56.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.220+0000 7f28349af700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28300b5a10 0x7f2830149c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:56.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.220+0000 7f28351b0700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f283014af10 0x7f2830146610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.79:55314/0 (socket says 172.21.15.79:55314) 2023-07-12T02:01:56.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.220+0000 7f28349af700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28300b5a10 0x7f2830149c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56950/0 (socket says 172.21.15.79:56950) 2023-07-12T02:01:56.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.220+0000 7f282ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2830144820 0x7f28301460d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:56.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.220+0000 7f28351b0700 1 -- 172.21.15.79:0/92125991 learned_addr learned my addr 172.21.15.79:0/92125991 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-07-12T02:01:56.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.220+0000 7f28351b0700 1 -- 172.21.15.79:0/92125991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28300b5a10 msgr2=0x7f2830149c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:56.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.220+0000 7f28351b0700 1 --2- 172.21.15.79:0/92125991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28300b5a10 0x7f2830149c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:56.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.220+0000 7f28351b0700 1 -- 172.21.15.79:0/92125991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2830144820 msgr2=0x7f28301460d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:56.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.220+0000 7f28351b0700 1 --2- 172.21.15.79:0/92125991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2830144820 0x7f28301460d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:56.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.220+0000 7f28351b0700 1 -- 172.21.15.79:0/92125991 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28240094a0 con 0x7f283014af10 2023-07-12T02:01:56.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.220+0000 7f28351b0700 1 --2- 172.21.15.79:0/92125991 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f283014af10 0x7f2830146610 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f282800cbc0 tx=0x7f282800ced0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:01:56.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.220+0000 7f282d7fa700 1 -- 172.21.15.79:0/92125991 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2828003c00 con 0x7f283014af10 2023-07-12T02:01:56.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.220+0000 7f282d7fa700 1 -- 172.21.15.79:0/92125991 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2828003d60 con 0x7f283014af10 2023-07-12T02:01:56.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.220+0000 7f2836c13700 1 -- 172.21.15.79:0/92125991 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28300c0360 con 0x7f283014af10 2023-07-12T02:01:56.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.220+0000 7f282d7fa700 1 -- 172.21.15.79:0/92125991 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282800aa20 con 0x7f283014af10 2023-07-12T02:01:56.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.220+0000 7f2836c13700 1 -- 172.21.15.79:0/92125991 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28301e4500 con 0x7f283014af10 2023-07-12T02:01:56.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.221+0000 7f282d7fa700 1 -- 172.21.15.79:0/92125991 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f28280050d0 con 0x7f283014af10 2023-07-12T02:01:56.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.221+0000 7f282d7fa700 1 -- 172.21.15.79:0/92125991 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f2828012b00 con 0x7f283014af10 2023-07-12T02:01:56.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.222+0000 7f2836c13700 1 -- 172.21.15.79:0/92125991 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28301e4050 con 0x7f283014af10 2023-07-12T02:01:56.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.224+0000 7f282d7fa700 1 -- 172.21.15.79:0/92125991 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72553 (secure 0 0 0) 0x7f2828012d60 con 0x7f283014af10 2023-07-12T02:01:56.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.307+0000 7f2836c13700 1 -- 172.21.15.79:0/92125991 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6898cb84-56d1-48a9-bd45-97e4668e2fe9", "id": 6} v 0) v1 -- 0x7f2830074360 con 0x7f283014af10 2023-07-12T02:01:56.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.311+0000 7f282d7fa700 1 -- 172.21.15.79:0/92125991 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6898cb84-56d1-48a9-bd45-97e4668e2fe9", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2828005510 con 0x7f283014af10 2023-07-12T02:01:56.315 INFO:teuthology.orchestra.run.smithi079.stdout:6 2023-07-12T02:01:56.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.312+0000 7f2836c13700 1 -- 172.21.15.79:0/92125991 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f283014af10 msgr2=0x7f2830146610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:56.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.312+0000 7f2836c13700 1 --2- 172.21.15.79:0/92125991 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f283014af10 0x7f2830146610 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f282800cbc0 tx=0x7f282800ced0 comp rx=0 tx=0).stop 2023-07-12T02:01:56.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.312+0000 7f2836c13700 1 -- 172.21.15.79:0/92125991 shutdown_connections 2023-07-12T02:01:56.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.312+0000 7f2836c13700 1 --2- 172.21.15.79:0/92125991 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f283014af10 0x7f2830146610 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:56.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.312+0000 7f2836c13700 1 --2- 172.21.15.79:0/92125991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28300b5a10 0x7f2830149c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:56.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.312+0000 7f2836c13700 1 --2- 172.21.15.79:0/92125991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2830144820 0x7f28301460d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:56.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.312+0000 7f2836c13700 1 -- 172.21.15.79:0/92125991 >> 172.21.15.79:0/92125991 conn(0x7f28300c08f0 msgr2=0x7f28300bf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:01:56.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.312+0000 7f2836c13700 1 -- 172.21.15.79:0/92125991 shutdown_connections 2023-07-12T02:01:56.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.312+0000 7f2836c13700 1 -- 172.21.15.79:0/92125991 wait complete. 2023-07-12T02:01:56.327 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd new 65c10882-371e-4762-b384-9c3a48f332ac 7 2023-07-12T02:01:56.423 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-07-12T02:01:56.420+0000 7fe07fab8200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-12T02:01:56.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.445+0000 7fe333bcf700 1 Processor -- start 2023-07-12T02:01:56.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.446+0000 7fe333bcf700 1 -- start start 2023-07-12T02:01:56.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.446+0000 7fe333bcf700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe32c071910 0x7fe32c070d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:56.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.446+0000 7fe333bcf700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe32c0701a0 con 0x7fe32c14b510 2023-07-12T02:01:56.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.446+0000 7fe333bcf700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe32c14b940 con 0x7fe32c06bce0 2023-07-12T02:01:56.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.446+0000 7fe333bcf700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c0713d0 con 0x7fe32c071910 2023-07-12T02:01:56.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.446+0000 7fe33216c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe32c06bce0 0x7fe32c155260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52838/0 (socket says 172.21.15.79:52838) 2023-07-12T02:01:56.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.446+0000 7fe33216c700 1 -- 172.21.15.79:0/4227541429 learned_addr learned my addr 172.21.15.79:0/4227541429 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-07-12T02:01:56.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.446+0000 7fe33196b700 1 --2- 172.21.15.79:0/4227541429 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe32c071910 0x7fe32c070d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:56.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.447+0000 7fe330969700 1 -- 172.21.15.79:0/4227541429 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 382872352 0 0) 0x7fe32c14b940 con 0x7fe32c06bce0 2023-07-12T02:01:56.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.447+0000 7fe330969700 1 -- 172.21.15.79:0/4227541429 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3180035b0 con 0x7fe32c06bce0 2023-07-12T02:01:56.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.447+0000 7fe33196b700 1 -- 172.21.15.79:0/4227541429 >> v1:172.21.15.79:6789/0 conn(0x7fe32c06bce0 legacy=0x7fe32c155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:56.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.447+0000 7fe33196b700 1 -- 172.21.15.79:0/4227541429 >> v1:172.21.15.60:6789/0 conn(0x7fe32c14b510 legacy=0x7fe32c06c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:56.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.447+0000 7fe33196b700 1 -- 172.21.15.79:0/4227541429 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe32c14aa30 con 0x7fe32c071910 2023-07-12T02:01:56.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.447+0000 7fe33196b700 1 --2- 172.21.15.79:0/4227541429 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe32c071910 0x7fe32c070d80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe328009dc0 tx=0x7fe32800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81359a2647625110 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:01:56.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.447+0000 7fe330969700 1 -- 172.21.15.79:0/4227541429 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32800e070 con 0x7fe32c071910 2023-07-12T02:01:56.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.447+0000 7fe330969700 1 -- 172.21.15.79:0/4227541429 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe328003a20 con 0x7fe32c071910 2023-07-12T02:01:56.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.447+0000 7fe330969700 1 -- 172.21.15.79:0/4227541429 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe328003dd0 con 0x7fe32c071910 2023-07-12T02:01:56.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.448+0000 7fe333bcf700 1 -- 172.21.15.79:0/4227541429 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe32c071910 msgr2=0x7fe32c070d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:56.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.448+0000 7fe333bcf700 1 --2- 172.21.15.79:0/4227541429 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe32c071910 0x7fe32c070d80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe328009dc0 tx=0x7fe32800b330 comp rx=0 tx=0).stop 2023-07-12T02:01:56.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.448+0000 7fe333bcf700 1 -- 172.21.15.79:0/4227541429 shutdown_connections 2023-07-12T02:01:56.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.448+0000 7fe333bcf700 1 --2- 172.21.15.79:0/4227541429 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe32c071910 0x7fe32c070d80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:56.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.448+0000 7fe333bcf700 1 -- 172.21.15.79:0/4227541429 >> 172.21.15.79:0/4227541429 conn(0x7fe32c0be670 msgr2=0x7fe32c0bea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:01:56.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.448+0000 7fe333bcf700 1 -- 172.21.15.79:0/4227541429 shutdown_connections 2023-07-12T02:01:56.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.448+0000 7fe333bcf700 1 -- 172.21.15.79:0/4227541429 wait complete. 2023-07-12T02:01:56.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.449+0000 7fe333bcf700 1 Processor -- start 2023-07-12T02:01:56.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.449+0000 7fe333bcf700 1 -- start start 2023-07-12T02:01:56.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.449+0000 7fe333bcf700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe32c06bce0 0x7fe32c145f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:56.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.449+0000 7fe333bcf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe32c071910 0x7fe32c0b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:56.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.450+0000 7fe333bcf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe32c14b510 0x7fe32c0b5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:56.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.450+0000 7fe333bcf700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c146480 con 0x7fe32c071910 2023-07-12T02:01:56.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.450+0000 7fe333bcf700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c1e1170 con 0x7fe32c14b510 2023-07-12T02:01:56.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.450+0000 7fe333bcf700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c0b3170 con 0x7fe32c06bce0 2023-07-12T02:01:56.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.450+0000 7fe33196b700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe32c06bce0 0x7fe32c145f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:56.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.450+0000 7fe33196b700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe32c06bce0 0x7fe32c145f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.79:55344/0 (socket says 172.21.15.79:55344) 2023-07-12T02:01:56.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.450+0000 7fe33216c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe32c14b510 0x7fe32c0b5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:56.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.450+0000 7fe33196b700 1 -- 172.21.15.79:0/91816057 learned_addr learned my addr 172.21.15.79:0/91816057 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-07-12T02:01:56.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.450+0000 7fe33116a700 1 --2- 172.21.15.79:0/91816057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe32c071910 0x7fe32c0b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:56.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.450+0000 7fe33216c700 1 -- 172.21.15.79:0/91816057 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe32c06bce0 msgr2=0x7fe32c145f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:56.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.450+0000 7fe33216c700 1 --2- 172.21.15.79:0/91816057 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe32c06bce0 0x7fe32c145f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:56.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.450+0000 7fe33216c700 1 -- 172.21.15.79:0/91816057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe32c071910 msgr2=0x7fe32c0b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:56.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.450+0000 7fe33216c700 1 --2- 172.21.15.79:0/91816057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe32c071910 0x7fe32c0b2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:56.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.450+0000 7fe33216c700 1 -- 172.21.15.79:0/91816057 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe328009a70 con 0x7fe32c14b510 2023-07-12T02:01:56.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.450+0000 7fe33216c700 1 --2- 172.21.15.79:0/91816057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe32c14b510 0x7fe32c0b5920 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe32400c400 tx=0x7fe32400c710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:01:56.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.450+0000 7fe3227fc700 1 -- 172.21.15.79:0/91816057 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe324005d70 con 0x7fe32c14b510 2023-07-12T02:01:56.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.450+0000 7fe3227fc700 1 -- 172.21.15.79:0/91816057 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe32400ce10 con 0x7fe32c14b510 2023-07-12T02:01:56.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.450+0000 7fe333bcf700 1 -- 172.21.15.79:0/91816057 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe32c1e03b0 con 0x7fe32c14b510 2023-07-12T02:01:56.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.450+0000 7fe3227fc700 1 -- 172.21.15.79:0/91816057 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3240072d0 con 0x7fe32c14b510 2023-07-12T02:01:56.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.450+0000 7fe333bcf700 1 -- 172.21.15.79:0/91816057 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe32c1e0970 con 0x7fe32c14b510 2023-07-12T02:01:56.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.450+0000 7fe3227fc700 1 -- 172.21.15.79:0/91816057 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe32401c440 con 0x7fe32c14b510 2023-07-12T02:01:56.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.451+0000 7fe3227fc700 1 -- 172.21.15.79:0/91816057 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fe324007730 con 0x7fe32c14b510 2023-07-12T02:01:56.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.451+0000 7fe333bcf700 1 -- 172.21.15.79:0/91816057 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe32c0672b0 con 0x7fe32c14b510 2023-07-12T02:01:56.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.453+0000 7fe3227fc700 1 -- 172.21.15.79:0/91816057 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72553 (secure 0 0 0) 0x7fe324021060 con 0x7fe32c14b510 2023-07-12T02:01:56.499 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-07-12T02:01:56.496+0000 7f25f02fe200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-12T02:01:56.500 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-07-12T02:01:56.497+0000 7fe07fab8200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-12T02:01:56.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.536+0000 7fe333bcf700 1 -- 172.21.15.79:0/91816057 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd new", "uuid": "65c10882-371e-4762-b384-9c3a48f332ac", "id": 7} v 0) v1 -- 0x7fe32c074360 con 0x7fe32c14b510 2023-07-12T02:01:56.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.539+0000 7fe3227fc700 1 -- 172.21.15.79:0/91816057 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "65c10882-371e-4762-b384-9c3a48f332ac", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe324017070 con 0x7fe32c14b510 2023-07-12T02:01:56.543 INFO:teuthology.orchestra.run.smithi079.stdout:7 2023-07-12T02:01:56.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.540+0000 7fe333bcf700 1 -- 172.21.15.79:0/91816057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe32c14b510 msgr2=0x7fe32c0b5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:56.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.540+0000 7fe333bcf700 1 --2- 172.21.15.79:0/91816057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe32c14b510 0x7fe32c0b5920 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe32400c400 tx=0x7fe32400c710 comp rx=0 tx=0).stop 2023-07-12T02:01:56.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.540+0000 7fe333bcf700 1 -- 172.21.15.79:0/91816057 shutdown_connections 2023-07-12T02:01:56.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.540+0000 7fe333bcf700 1 --2- 172.21.15.79:0/91816057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe32c14b510 0x7fe32c0b5920 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:56.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.540+0000 7fe333bcf700 1 --2- 172.21.15.79:0/91816057 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe32c06bce0 0x7fe32c145f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:56.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.540+0000 7fe333bcf700 1 --2- 172.21.15.79:0/91816057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe32c071910 0x7fe32c0b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:56.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.540+0000 7fe333bcf700 1 -- 172.21.15.79:0/91816057 >> 172.21.15.79:0/91816057 conn(0x7fe32c0be670 msgr2=0x7fe32c149410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:01:56.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.540+0000 7fe333bcf700 1 -- 172.21.15.79:0/91816057 shutdown_connections 2023-07-12T02:01:56.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-07-12T02:01:56.540+0000 7fe333bcf700 1 -- 172.21.15.79:0/91816057 wait complete. 2023-07-12T02:01:56.556 INFO:tasks.ceph.osd.0:Restarting daemon 2023-07-12T02:01:56.556 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-07-12T02:01:56.558 INFO:tasks.ceph.osd.0:Started 2023-07-12T02:01:56.558 INFO:tasks.ceph.osd.1:Restarting daemon 2023-07-12T02:01:56.559 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-07-12T02:01:56.560 INFO:tasks.ceph.osd.1:Started 2023-07-12T02:01:56.560 INFO:tasks.ceph.osd.2:Restarting daemon 2023-07-12T02:01:56.561 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-07-12T02:01:56.563 INFO:tasks.ceph.osd.2:Started 2023-07-12T02:01:56.563 INFO:tasks.ceph.osd.3:Restarting daemon 2023-07-12T02:01:56.563 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-07-12T02:01:56.565 INFO:tasks.ceph.osd.3:Started 2023-07-12T02:01:56.565 INFO:tasks.ceph.osd.4:Restarting daemon 2023-07-12T02:01:56.566 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-07-12T02:01:56.567 INFO:tasks.ceph.osd.4:Started 2023-07-12T02:01:56.568 INFO:tasks.ceph.osd.5:Restarting daemon 2023-07-12T02:01:56.568 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-07-12T02:01:56.570 INFO:tasks.ceph.osd.5:Started 2023-07-12T02:01:56.570 INFO:tasks.ceph.osd.6:Restarting daemon 2023-07-12T02:01:56.570 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-07-12T02:01:56.572 INFO:tasks.ceph.osd.6:Started 2023-07-12T02:01:56.572 INFO:tasks.ceph.osd.7:Restarting daemon 2023-07-12T02:01:56.573 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-07-12T02:01:56.574 INFO:tasks.ceph.osd.7:Started 2023-07-12T02:01:56.575 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:01:56.581 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-07-12T02:01:56.578+0000 7f25f02fe200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-12T02:01:56.673 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-07-12T02:01:56.670+0000 7fe07fab8200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-12T02:01:56.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.730+0000 7fee4ce20700 1 Processor -- start 2023-07-12T02:01:56.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.731+0000 7fee4ce20700 1 -- start start 2023-07-12T02:01:56.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.731+0000 7fee4ce20700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fee4806b120 0x7fee480b8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:56.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.731+0000 7fee4ce20700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee481444c0 0x7fee48144920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:56.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.731+0000 7fee4ce20700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee48070410 con 0x7fee4814aa40 2023-07-12T02:01:56.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.731+0000 7fee4ce20700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee480b9590 con 0x7fee4806b120 2023-07-12T02:01:56.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.731+0000 7fee4ce20700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee4806ef60 con 0x7fee481444c0 2023-07-12T02:01:56.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.732+0000 7fee4659c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fee4806b120 0x7fee480b8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:56.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.732+0000 7fee4659c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fee4806b120 0x7fee480b8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42624/0 (socket says 172.21.15.60:42624) 2023-07-12T02:01:56.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.732+0000 7fee4659c700 1 -- 172.21.15.60:0/2267648680 learned_addr learned my addr 172.21.15.60:0/2267648680 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:01:56.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.732+0000 7fee46d9d700 1 --2- 172.21.15.60:0/2267648680 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee481444c0 0x7fee48144920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:56.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.732+0000 7fee4659c700 1 -- 172.21.15.60:0/2267648680 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee481444c0 msgr2=0x7fee48144920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:01:56.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.732+0000 7fee4659c700 1 --2- 172.21.15.60:0/2267648680 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee481444c0 0x7fee48144920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:56.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.732+0000 7fee4659c700 1 -- 172.21.15.60:0/2267648680 >> v1:172.21.15.79:6789/0 conn(0x7fee4814aa40 legacy=0x7fee4814aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:56.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.732+0000 7fee4659c700 1 -- 172.21.15.60:0/2267648680 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4806f240 con 0x7fee4806b120 2023-07-12T02:01:56.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.732+0000 7fee4659c700 1 --2- 172.21.15.60:0/2267648680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee4806b120 0x7fee480b8cd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fee380098f0 tx=0x7fee38009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41b3798ad5144b86 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:01:56.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.732+0000 7fee4559a700 1 -- 172.21.15.60:0/2267648680 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee38011830 con 0x7fee4806b120 2023-07-12T02:01:56.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.732+0000 7fee4559a700 1 -- 172.21.15.60:0/2267648680 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee38011990 con 0x7fee4806b120 2023-07-12T02:01:56.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.732+0000 7fee4559a700 1 -- 172.21.15.60:0/2267648680 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee38011d20 con 0x7fee4806b120 2023-07-12T02:01:56.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.733+0000 7fee4ce20700 1 -- 172.21.15.60:0/2267648680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee4806b120 msgr2=0x7fee480b8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:56.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.733+0000 7fee4ce20700 1 --2- 172.21.15.60:0/2267648680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee4806b120 0x7fee480b8cd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fee380098f0 tx=0x7fee38009c00 comp rx=0 tx=0).stop 2023-07-12T02:01:56.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.733+0000 7fee4ce20700 1 -- 172.21.15.60:0/2267648680 shutdown_connections 2023-07-12T02:01:56.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.733+0000 7fee4ce20700 1 --2- 172.21.15.60:0/2267648680 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee481444c0 0x7fee48144920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:56.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.733+0000 7fee4ce20700 1 --2- 172.21.15.60:0/2267648680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee4806b120 0x7fee480b8cd0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:56.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.733+0000 7fee4ce20700 1 -- 172.21.15.60:0/2267648680 >> 172.21.15.60:0/2267648680 conn(0x7fee480bd980 msgr2=0x7fee480b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:01:56.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.733+0000 7fee4ce20700 1 -- 172.21.15.60:0/2267648680 shutdown_connections 2023-07-12T02:01:56.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.733+0000 7fee4ce20700 1 -- 172.21.15.60:0/2267648680 wait complete. 2023-07-12T02:01:56.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.734+0000 7fee4ce20700 1 Processor -- start 2023-07-12T02:01:56.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.734+0000 7fee4ce20700 1 -- start start 2023-07-12T02:01:56.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.735+0000 7fee4ce20700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee4806b120 0x7fee481428d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:56.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.735+0000 7fee4ce20700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee481444c0 0x7fee4814dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:56.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.735+0000 7fee4ce20700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee4814aa40 0x7fee4814bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:56.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.735+0000 7fee4ce20700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee48142e10 con 0x7fee481444c0 2023-07-12T02:01:56.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.735+0000 7fee4ce20700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4814e7c0 con 0x7fee4806b120 2023-07-12T02:01:56.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.735+0000 7fee4ce20700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee4814d160 con 0x7fee4814aa40 2023-07-12T02:01:56.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.735+0000 7fee45d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee481444c0 0x7fee4814dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:56.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.735+0000 7fee4659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee4806b120 0x7fee481428d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:56.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.735+0000 7fee4659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee4806b120 0x7fee481428d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.60:38158/0 (socket says 172.21.15.60:38158) 2023-07-12T02:01:56.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.735+0000 7fee4659c700 1 -- 172.21.15.60:0/402233457 learned_addr learned my addr 172.21.15.60:0/402233457 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:01:56.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.735+0000 7fee46d9d700 1 --2- 172.21.15.60:0/402233457 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee4814aa40 0x7fee4814bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:56.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.736+0000 7fee45d9b700 1 -- 172.21.15.60:0/402233457 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee4814aa40 msgr2=0x7fee4814bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:56.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.736+0000 7fee45d9b700 1 --2- 172.21.15.60:0/402233457 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee4814aa40 0x7fee4814bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:56.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.736+0000 7fee45d9b700 1 -- 172.21.15.60:0/402233457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee4806b120 msgr2=0x7fee481428d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:56.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.736+0000 7fee45d9b700 1 --2- 172.21.15.60:0/402233457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee4806b120 0x7fee481428d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:56.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.736+0000 7fee45d9b700 1 -- 172.21.15.60:0/402233457 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee38009550 con 0x7fee481444c0 2023-07-12T02:01:56.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.736+0000 7fee4659c700 1 --2- 172.21.15.60:0/402233457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee4806b120 0x7fee481428d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:01:56.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.736+0000 7fee46d9d700 1 --2- 172.21.15.60:0/402233457 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee4814aa40 0x7fee4814bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:01:56.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.736+0000 7fee45d9b700 1 --2- 172.21.15.60:0/402233457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee481444c0 0x7fee4814dcf0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fee3c000f60 tx=0x7fee3c00c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:01:56.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.736+0000 7fee36ffd700 1 -- 172.21.15.60:0/402233457 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3c0052d0 con 0x7fee481444c0 2023-07-12T02:01:56.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.736+0000 7fee36ffd700 1 -- 172.21.15.60:0/402233457 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee3c005430 con 0x7fee481444c0 2023-07-12T02:01:56.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.736+0000 7fee4ce20700 1 -- 172.21.15.60:0/402233457 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee481e2be0 con 0x7fee481444c0 2023-07-12T02:01:56.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.736+0000 7fee36ffd700 1 -- 172.21.15.60:0/402233457 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3c0038c0 con 0x7fee481444c0 2023-07-12T02:01:56.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.736+0000 7fee4ce20700 1 -- 172.21.15.60:0/402233457 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee481e3110 con 0x7fee481444c0 2023-07-12T02:01:56.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.736+0000 7fee36ffd700 1 -- 172.21.15.60:0/402233457 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fee3c01c440 con 0x7fee481444c0 2023-07-12T02:01:56.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.736+0000 7fee36ffd700 1 -- 172.21.15.60:0/402233457 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fee3c012af0 con 0x7fee481444c0 2023-07-12T02:01:56.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.737+0000 7fee4ce20700 1 -- 172.21.15.60:0/402233457 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee480bc0c0 con 0x7fee481444c0 2023-07-12T02:01:56.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.739+0000 7fee36ffd700 1 -- 172.21.15.60:0/402233457 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72553 (secure 0 0 0) 0x7fee3c017070 con 0x7fee481444c0 2023-07-12T02:01:56.746 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-07-12T02:01:56.743+0000 7fe07fab8200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-12T02:01:56.760 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-07-12T02:01:56.757+0000 7f25f02fe200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-12T02:01:56.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.810+0000 7fee4ce20700 1 -- 172.21.15.60:0/402233457 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee48074360 con 0x7fee481444c0 2023-07-12T02:01:56.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.810+0000 7fee36ffd700 1 -- 172.21.15.60:0/402233457 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fee3c012420 con 0x7fee481444c0 2023-07-12T02:01:56.814 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:01:56.814 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":10,"fsid":"97e7c909-e567-472e-a5aa-72fde15171f2","created":"2023-07-12T02:01:53.987086+0000","modified":"2023-07-12T02:01:56.538621+0000","last_up_change":"0.000000","last_in_change":"2023-07-12T02:01:56.538621+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ed8b71c2-3895-4952-a118-16ede0b4a98c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7cf4d354-78e0-43ce-8c09-4a7d2a0b57a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"02c958b8-9599-4470-92cb-8f7018ec0189","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"bc300432-a228-4257-be5c-e42dd5f2015f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ad9f7dc4-7126-466d-a656-2844880c6060","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e88d16ca-0b01-4ab9-8aa8-c4aff7f210f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6898cb84-56d1-48a9-bd45-97e4668e2fe9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"65c10882-371e-4762-b384-9c3a48f332ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:01:56.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.812+0000 7fee4ce20700 1 -- 172.21.15.60:0/402233457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee481444c0 msgr2=0x7fee4814dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:56.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.812+0000 7fee4ce20700 1 --2- 172.21.15.60:0/402233457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee481444c0 0x7fee4814dcf0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fee3c000f60 tx=0x7fee3c00c6e0 comp rx=0 tx=0).stop 2023-07-12T02:01:56.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.812+0000 7fee4ce20700 1 -- 172.21.15.60:0/402233457 shutdown_connections 2023-07-12T02:01:56.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.812+0000 7fee4ce20700 1 --2- 172.21.15.60:0/402233457 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fee4814aa40 0x7fee4814bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:56.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.812+0000 7fee4ce20700 1 --2- 172.21.15.60:0/402233457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee4806b120 0x7fee481428d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:56.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.812+0000 7fee4ce20700 1 --2- 172.21.15.60:0/402233457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee481444c0 0x7fee4814dcf0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:56.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.812+0000 7fee4ce20700 1 -- 172.21.15.60:0/402233457 >> 172.21.15.60:0/402233457 conn(0x7fee480bd980 msgr2=0x7fee480bb9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:01:56.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.812+0000 7fee4ce20700 1 -- 172.21.15.60:0/402233457 shutdown_connections 2023-07-12T02:01:56.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:01:56.812+0000 7fee4ce20700 1 -- 172.21.15.60:0/402233457 wait complete. 2023-07-12T02:01:56.827 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-07-12T02:01:56.827 INFO:tasks.ceph:Waiting for OSDs to come up 2023-07-12T02:01:56.835 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-07-12T02:01:56.832+0000 7f25f02fe200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-12T02:01:56.925 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-07-12T02:01:56.921+0000 7fe07fab8200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-12T02:01:57.006 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-07-12T02:01:57.002+0000 7fe07fab8200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-12T02:01:57.023 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-07-12T02:01:57.020+0000 7f25f02fe200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-12T02:01:57.084 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-07-12T02:01:57.081+0000 7fe07fab8200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-12T02:01:57.105 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-07-12T02:01:57.103+0000 7f25f02fe200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-12T02:01:57.169 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-07-12T02:01:57.166+0000 7fe07fab8200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-12T02:01:57.170 INFO:tasks.ceph.osd.0.smithi060.stderr:2023-07-12T02:01:57.167+0000 7ff1eacd9640 -1 Falling back to public interface 2023-07-12T02:01:57.175 INFO:tasks.ceph.osd.5.smithi079.stderr:2023-07-12T02:01:57.171+0000 7f7c5f076640 -1 Falling back to public interface 2023-07-12T02:01:57.179 INFO:tasks.ceph.osd.4.smithi079.stderr:2023-07-12T02:01:57.175+0000 7faa0b889640 -1 Falling back to public interface 2023-07-12T02:01:57.183 INFO:tasks.ceph.osd.7.smithi079.stderr:2023-07-12T02:01:57.179+0000 7fc9281d6640 -1 Falling back to public interface 2023-07-12T02:01:57.186 INFO:tasks.ceph.osd.2.smithi060.stderr:2023-07-12T02:01:57.183+0000 7f7d0d947640 -1 Falling back to public interface 2023-07-12T02:01:57.187 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-07-12T02:01:57.183+0000 7f25f02fe200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-12T02:01:57.193 INFO:tasks.ceph.osd.6.smithi079.stderr:2023-07-12T02:01:57.189+0000 7f9b0a909640 -1 Falling back to public interface 2023-07-12T02:01:57.211 INFO:tasks.ceph.osd.1.smithi060.stderr:2023-07-12T02:01:57.208+0000 7f225018c640 -1 Falling back to public interface 2023-07-12T02:01:57.215 INFO:tasks.ceph.osd.3.smithi060.stderr:2023-07-12T02:01:57.212+0000 7fad2ce72640 -1 Falling back to public interface 2023-07-12T02:01:57.286 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-07-12T02:01:57.283+0000 7f25f02fe200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-12T02:01:57.353 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-07-12T02:01:57.350+0000 7fe07fab8200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-12T02:01:57.434 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-07-12T02:01:57.431+0000 7fe07fab8200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-12T02:01:57.474 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-07-12T02:01:57.471+0000 7f25f02fe200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-12T02:01:57.559 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-07-12T02:01:57.556+0000 7f25f02fe200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-12T02:01:57.633 DEBUG:teuthology.orchestra.run.smithi060:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-12T02:01:57.724 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-07-12T02:01:57.721+0000 7fe07fab8200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-12T02:01:57.752 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.749+0000 7f5d19bf5700 1 Processor -- start 2023-07-12T02:01:57.752 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.750+0000 7f5d19bf5700 1 -- start start 2023-07-12T02:01:57.753 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.750+0000 7f5d19bf5700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5d14071840 0x7f5d14156000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:57.753 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.750+0000 7f5d19bf5700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d1406a640 con 0x7f5d140721e0 2023-07-12T02:01:57.754 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.750+0000 7f5d19bf5700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d1406f680 con 0x7f5d14147dc0 2023-07-12T02:01:57.754 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.750+0000 7f5d19bf5700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d14070950 con 0x7f5d14071840 2023-07-12T02:01:57.754 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.750+0000 7f5d13fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5d14071840 0x7f5d14156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:57.754 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.750+0000 7f5d0bfff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f5d140721e0 0x7f5d14071130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45868/0 (socket says 172.21.15.60:45868) 2023-07-12T02:01:57.754 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.750+0000 7f5d0bfff700 1 -- 172.21.15.60:0/3394378726 learned_addr learned my addr 172.21.15.60:0/3394378726 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:01:57.755 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.751+0000 7f5d13fff700 1 -- 172.21.15.60:0/3394378726 >> v1:172.21.15.79:6789/0 conn(0x7f5d14147dc0 legacy=0x7f5d14069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:57.755 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.751+0000 7f5d13fff700 1 -- 172.21.15.60:0/3394378726 >> v1:172.21.15.60:6789/0 conn(0x7f5d140721e0 legacy=0x7f5d14071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:57.756 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.751+0000 7f5d12ffd700 1 -- 172.21.15.60:0/3394378726 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1196268170 0 0) 0x7f5d1406f680 con 0x7f5d14147dc0 2023-07-12T02:01:57.756 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.751+0000 7f5d13fff700 1 -- 172.21.15.60:0/3394378726 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d1406f920 con 0x7f5d14071840 2023-07-12T02:01:57.756 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.751+0000 7f5d13fff700 1 --2- 172.21.15.60:0/3394378726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d14071840 0x7f5d14156000 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c009d90 tx=0x7f5d0c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7bd6ccd8b716590 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:01:57.756 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.751+0000 7f5d12ffd700 1 -- 172.21.15.60:0/3394378726 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0c00e070 con 0x7f5d14071840 2023-07-12T02:01:57.756 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.751+0000 7f5d12ffd700 1 -- 172.21.15.60:0/3394378726 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d0c00bad0 con 0x7f5d14071840 2023-07-12T02:01:57.756 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.751+0000 7f5d12ffd700 1 -- 172.21.15.60:0/3394378726 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0c00be80 con 0x7f5d14071840 2023-07-12T02:01:57.757 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.752+0000 7f5d19bf5700 1 -- 172.21.15.60:0/3394378726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d14071840 msgr2=0x7f5d14156000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:57.757 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.752+0000 7f5d19bf5700 1 --2- 172.21.15.60:0/3394378726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d14071840 0x7f5d14156000 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c009d90 tx=0x7f5d0c00b330 comp rx=0 tx=0).stop 2023-07-12T02:01:57.757 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.752+0000 7f5d19bf5700 1 -- 172.21.15.60:0/3394378726 shutdown_connections 2023-07-12T02:01:57.757 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.752+0000 7f5d19bf5700 1 --2- 172.21.15.60:0/3394378726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d14071840 0x7f5d14156000 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:57.757 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.752+0000 7f5d19bf5700 1 -- 172.21.15.60:0/3394378726 >> 172.21.15.60:0/3394378726 conn(0x7f5d1406d0e0 msgr2=0x7f5d1406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:01:57.757 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.752+0000 7f5d19bf5700 1 -- 172.21.15.60:0/3394378726 shutdown_connections 2023-07-12T02:01:57.757 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.752+0000 7f5d19bf5700 1 -- 172.21.15.60:0/3394378726 wait complete. 2023-07-12T02:01:57.759 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.753+0000 7f5d19bf5700 1 Processor -- start 2023-07-12T02:01:57.759 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.753+0000 7f5d19bf5700 1 -- start start 2023-07-12T02:01:57.760 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.753+0000 7f5d19bf5700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5d14071840 0x7f5d14149a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:57.760 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.753+0000 7f5d19bf5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d140721e0 0x7f5d14148400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:57.760 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.753+0000 7f5d19bf5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d14147dc0 0x7f5d14141ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:01:57.760 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.754+0000 7f5d19bf5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d141495a0 con 0x7f5d140721e0 2023-07-12T02:01:57.760 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.754+0000 7f5d19bf5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1414b8b0 con 0x7f5d14147dc0 2023-07-12T02:01:57.760 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.754+0000 7f5d19bf5700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d140b78c0 con 0x7f5d14071840 2023-07-12T02:01:57.761 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.754+0000 7f5d0bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d140721e0 0x7f5d14148400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:57.761 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.754+0000 7f5d0bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d140721e0 0x7f5d14148400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35372/0 (socket says 172.21.15.60:35372) 2023-07-12T02:01:57.761 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.754+0000 7f5d0bfff700 1 -- 172.21.15.60:0/2692914702 learned_addr learned my addr 172.21.15.60:0/2692914702 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:01:57.761 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.754+0000 7f5d13fff700 1 --2- 172.21.15.60:0/2692914702 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d14147dc0 0x7f5d14141ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:57.761 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.754+0000 7f5d137fe700 1 --2- 172.21.15.60:0/2692914702 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5d14071840 0x7f5d14149a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:01:57.761 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.754+0000 7f5d0bfff700 1 -- 172.21.15.60:0/2692914702 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5d14071840 msgr2=0x7f5d14149a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:57.761 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.754+0000 7f5d0bfff700 1 --2- 172.21.15.60:0/2692914702 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5d14071840 0x7f5d14149a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:57.762 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.754+0000 7f5d0bfff700 1 -- 172.21.15.60:0/2692914702 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d14147dc0 msgr2=0x7f5d14141ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:57.762 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.754+0000 7f5d0bfff700 1 --2- 172.21.15.60:0/2692914702 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d14147dc0 0x7f5d14141ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:57.762 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.754+0000 7f5d0bfff700 1 -- 172.21.15.60:0/2692914702 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d0c009a70 con 0x7f5d140721e0 2023-07-12T02:01:57.762 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.754+0000 7f5d0bfff700 1 --2- 172.21.15.60:0/2692914702 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d140721e0 0x7f5d14148400 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc00c780 tx=0x7f5cfc00ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:01:57.762 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.754+0000 7f5d10ff9700 1 -- 172.21.15.60:0/2692914702 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc004c80 con 0x7f5d140721e0 2023-07-12T02:01:57.762 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.754+0000 7f5d10ff9700 1 -- 172.21.15.60:0/2692914702 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cfc004de0 con 0x7f5d140721e0 2023-07-12T02:01:57.762 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.754+0000 7f5d19bf5700 1 -- 172.21.15.60:0/2692914702 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d14149f70 con 0x7f5d140721e0 2023-07-12T02:01:57.763 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.754+0000 7f5d10ff9700 1 -- 172.21.15.60:0/2692914702 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc007310 con 0x7f5d140721e0 2023-07-12T02:01:57.763 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.754+0000 7f5d19bf5700 1 -- 172.21.15.60:0/2692914702 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d1414b0b0 con 0x7f5d140721e0 2023-07-12T02:01:57.763 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.754+0000 7f5d10ff9700 1 -- 172.21.15.60:0/2692914702 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5cfc01d3f0 con 0x7f5d140721e0 2023-07-12T02:01:57.763 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.755+0000 7f5d10ff9700 1 -- 172.21.15.60:0/2692914702 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f5cfc01dd70 con 0x7f5d140721e0 2023-07-12T02:01:57.763 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.755+0000 7f5d19bf5700 1 -- 172.21.15.60:0/2692914702 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d14074360 con 0x7f5d140721e0 2023-07-12T02:01:57.764 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.759+0000 7f5d10ff9700 1 -- 172.21.15.60:0/2692914702 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72553 (secure 0 0 0) 0x7f5cfc01d6a0 con 0x7f5d140721e0 2023-07-12T02:01:57.797 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-07-12T02:01:57.794+0000 7fe07fab8200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-12T02:01:57.833 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.830+0000 7f5d19bf5700 1 -- 172.21.15.60:0/2692914702 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d141d78a0 con 0x7f5d140721e0 2023-07-12T02:01:57.834 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.831+0000 7f5d10ff9700 1 -- 172.21.15.60:0/2692914702 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f5cfc01d970 con 0x7f5d140721e0 2023-07-12T02:01:57.834 INFO:teuthology.misc.health.smithi060.stdout: 2023-07-12T02:01:57.835 INFO:teuthology.misc.health.smithi060.stdout:{"epoch":10,"fsid":"97e7c909-e567-472e-a5aa-72fde15171f2","created":"2023-07-12T02:01:53.987086+0000","modified":"2023-07-12T02:01:56.538621+0000","last_up_change":"0.000000","last_in_change":"2023-07-12T02:01:56.538621+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ed8b71c2-3895-4952-a118-16ede0b4a98c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7cf4d354-78e0-43ce-8c09-4a7d2a0b57a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"02c958b8-9599-4470-92cb-8f7018ec0189","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"bc300432-a228-4257-be5c-e42dd5f2015f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ad9f7dc4-7126-466d-a656-2844880c6060","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e88d16ca-0b01-4ab9-8aa8-c4aff7f210f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6898cb84-56d1-48a9-bd45-97e4668e2fe9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"65c10882-371e-4762-b384-9c3a48f332ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:01:57.835 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.832+0000 7f5d19bf5700 1 -- 172.21.15.60:0/2692914702 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d140721e0 msgr2=0x7f5d14148400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:01:57.836 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.832+0000 7f5d19bf5700 1 --2- 172.21.15.60:0/2692914702 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d140721e0 0x7f5d14148400 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc00c780 tx=0x7f5cfc00ca90 comp rx=0 tx=0).stop 2023-07-12T02:01:57.836 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.832+0000 7f5d19bf5700 1 -- 172.21.15.60:0/2692914702 shutdown_connections 2023-07-12T02:01:57.836 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.832+0000 7f5d19bf5700 1 --2- 172.21.15.60:0/2692914702 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d14147dc0 0x7f5d14141ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:57.836 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.832+0000 7f5d19bf5700 1 --2- 172.21.15.60:0/2692914702 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5d14071840 0x7f5d14149a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:57.836 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.832+0000 7f5d19bf5700 1 --2- 172.21.15.60:0/2692914702 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d140721e0 0x7f5d14148400 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:01:57.836 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.832+0000 7f5d19bf5700 1 -- 172.21.15.60:0/2692914702 >> 172.21.15.60:0/2692914702 conn(0x7f5d1406d0e0 msgr2=0x7f5d140b83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:01:57.837 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.832+0000 7f5d19bf5700 1 -- 172.21.15.60:0/2692914702 shutdown_connections 2023-07-12T02:01:57.837 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:01:57.832+0000 7f5d19bf5700 1 -- 172.21.15.60:0/2692914702 wait complete. 2023-07-12T02:01:57.846 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-07-12T02:01:57.876 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-07-12T02:01:57.873+0000 7f25f02fe200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-12T02:01:57.950 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-07-12T02:01:57.947+0000 7f25f02fe200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-12T02:01:58.311 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-07-12T02:01:58.308+0000 7fe07fab8200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-12T02:01:58.491 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-07-12T02:01:58.488+0000 7f25f02fe200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-12T02:01:58.649 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-07-12T02:01:58.645+0000 7fe07fab8200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-12T02:01:58.793 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-07-12T02:01:58.789+0000 7fe07fab8200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-12T02:01:58.823 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-07-12T02:01:58.820+0000 7f25f02fe200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-12T02:01:58.973 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-07-12T02:01:58.970+0000 7f25f02fe200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-12T02:01:59.155 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-07-12T02:01:59.151+0000 7fe07fab8200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-12T02:01:59.304 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-07-12T02:01:59.300+0000 7fe07fab8200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-12T02:01:59.350 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-07-12T02:01:59.347+0000 7f25f02fe200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-12T02:01:59.456 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-07-12T02:01:59.453+0000 7fe07fab8200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-12T02:01:59.504 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-07-12T02:01:59.501+0000 7f25f02fe200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-12T02:01:59.673 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-07-12T02:01:59.670+0000 7f25f02fe200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-12T02:01:59.782 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-07-12T02:01:59.778+0000 7fe07fab8200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-12T02:02:00.047 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-07-12T02:02:00.044+0000 7f25f02fe200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-12T02:02:00.644 INFO:tasks.ceph.osd.0.smithi060.stderr:2023-07-12T02:02:00.642+0000 7ff1eacd9640 -1 osd.0 0 log_to_monitors true 2023-07-12T02:02:00.659 INFO:tasks.ceph.osd.5.smithi079.stderr:2023-07-12T02:02:00.655+0000 7f7c5f076640 -1 osd.5 0 log_to_monitors true 2023-07-12T02:02:00.680 INFO:tasks.ceph.osd.6.smithi079.stderr:2023-07-12T02:02:00.678+0000 7f9b0a909640 -1 osd.6 0 log_to_monitors true 2023-07-12T02:02:00.688 INFO:tasks.ceph.osd.2.smithi060.stderr:2023-07-12T02:02:00.685+0000 7f7d0d947640 -1 osd.2 0 log_to_monitors true 2023-07-12T02:02:00.694 INFO:tasks.ceph.osd.7.smithi079.stderr:2023-07-12T02:02:00.691+0000 7fc9281d6640 -1 osd.7 0 log_to_monitors true 2023-07-12T02:02:00.718 INFO:tasks.ceph.osd.4.smithi079.stderr:2023-07-12T02:02:00.714+0000 7faa0b889640 -1 osd.4 0 log_to_monitors true 2023-07-12T02:02:00.733 INFO:tasks.ceph.osd.1.smithi060.stderr:2023-07-12T02:02:00.731+0000 7f225018c640 -1 osd.1 0 log_to_monitors true 2023-07-12T02:02:00.740 INFO:tasks.ceph.osd.3.smithi060.stderr:2023-07-12T02:02:00.737+0000 7fad2ce72640 -1 osd.3 0 log_to_monitors true 2023-07-12T02:02:00.807 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-07-12T02:02:00.804+0000 7fe040ed5700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-07-12T02:02:00.807 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-07-12T02:02:00.804+0000 7fe040ed5700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-07-12T02:02:03.195 INFO:tasks.ceph.osd.3.smithi060.stderr:2023-07-12T02:02:03.189+0000 7fad20a12700 -1 osd.3 0 waiting for initial osdmap 2023-07-12T02:02:03.207 INFO:tasks.ceph.osd.3.smithi060.stderr:2023-07-12T02:02:03.204+0000 7fad18ded700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-12T02:02:03.224 INFO:tasks.ceph.osd.2.smithi060.stderr:2023-07-12T02:02:03.221+0000 7f7d014e7700 -1 osd.2 0 waiting for initial osdmap 2023-07-12T02:02:03.233 INFO:tasks.ceph.osd.2.smithi060.stderr:2023-07-12T02:02:03.231+0000 7f7cf98c2700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-12T02:02:03.246 INFO:tasks.ceph.osd.1.smithi060.stderr:2023-07-12T02:02:03.243+0000 7f2243d2c700 -1 osd.1 0 waiting for initial osdmap 2023-07-12T02:02:03.261 INFO:tasks.ceph.osd.1.smithi060.stderr:2023-07-12T02:02:03.259+0000 7f223c107700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-12T02:02:03.264 INFO:tasks.ceph.osd.0.smithi060.stderr:2023-07-12T02:02:03.262+0000 7ff1de879700 -1 osd.0 0 waiting for initial osdmap 2023-07-12T02:02:03.281 INFO:tasks.ceph.osd.0.smithi060.stderr:2023-07-12T02:02:03.279+0000 7ff1d6c54700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-12T02:02:03.866 INFO:tasks.ceph.osd.5.smithi079.stderr:2023-07-12T02:02:03.864+0000 7f7c54419700 -1 osd.5 0 waiting for initial osdmap 2023-07-12T02:02:03.874 INFO:tasks.ceph.osd.4.smithi079.stderr:2023-07-12T02:02:03.871+0000 7fa9ff429700 -1 osd.4 0 waiting for initial osdmap 2023-07-12T02:02:03.881 INFO:tasks.ceph.osd.5.smithi079.stderr:2023-07-12T02:02:03.879+0000 7f7c4aff1700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-12T02:02:03.892 INFO:tasks.ceph.osd.4.smithi079.stderr:2023-07-12T02:02:03.890+0000 7fa9f7804700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-12T02:02:03.899 INFO:tasks.ceph.osd.7.smithi079.stderr:2023-07-12T02:02:03.897+0000 7fc91bd76700 -1 osd.7 0 waiting for initial osdmap 2023-07-12T02:02:03.915 INFO:tasks.ceph.osd.7.smithi079.stderr:2023-07-12T02:02:03.913+0000 7fc914151700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-12T02:02:03.926 INFO:tasks.ceph.osd.6.smithi079.stderr:2023-07-12T02:02:03.923+0000 7f9afe4a9700 -1 osd.6 0 waiting for initial osdmap 2023-07-12T02:02:03.937 INFO:tasks.ceph.osd.6.smithi079.stderr:2023-07-12T02:02:03.935+0000 7f9af6884700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-12T02:02:04.652 DEBUG:teuthology.orchestra.run.smithi060:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-12T02:02:04.783 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.780+0000 7f4826199700 1 Processor -- start 2023-07-12T02:02:04.783 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.780+0000 7f4826199700 1 -- start start 2023-07-12T02:02:04.784 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.780+0000 7f4826199700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4820141780 0x7f48200ba010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:04.785 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.780+0000 7f4826199700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4820071a30 0x7f482014ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:04.785 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.780+0000 7f4826199700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4820070e70 con 0x7f48200b96b0 2023-07-12T02:02:04.785 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.780+0000 7f4826199700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4820071ea0 con 0x7f4820071a30 2023-07-12T02:02:04.785 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.780+0000 7f4826199700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48200b9b40 con 0x7f4820141780 2023-07-12T02:02:04.785 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.781+0000 7f481effd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4820071a30 0x7f482014ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:04.785 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.781+0000 7f481ffff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f48200b96b0 0x7f48200b7f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45874/0 (socket says 172.21.15.60:45874) 2023-07-12T02:02:04.785 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.781+0000 7f481ffff700 1 -- 172.21.15.60:0/1172034087 learned_addr learned my addr 172.21.15.60:0/1172034087 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:04.786 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.781+0000 7f481effd700 1 --2- 172.21.15.60:0/1172034087 >> v2:172.21.15.60:3300/0 conn(0x7f4820071a30 0x7f482014ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35418/0 (socket says 172.21.15.60:35418) 2023-07-12T02:02:04.786 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.781+0000 7f481f7fe700 1 --2- 172.21.15.60:0/1172034087 >> v2:172.21.15.79:3300/0 conn(0x7f4820141780 0x7f48200ba010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:04.786 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.781+0000 7f481effd700 1 -- 172.21.15.60:0/1172034087 >> v2:172.21.15.79:3300/0 conn(0x7f4820141780 msgr2=0x7f48200ba010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:04.786 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.781+0000 7f481effd700 1 --2- 172.21.15.60:0/1172034087 >> v2:172.21.15.79:3300/0 conn(0x7f4820141780 0x7f48200ba010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:04.786 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.781+0000 7f481effd700 1 -- 172.21.15.60:0/1172034087 >> v1:172.21.15.60:6789/0 conn(0x7f48200b96b0 legacy=0x7f48200b7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:04.786 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.781+0000 7f481e7fc700 1 -- 172.21.15.60:0/1172034087 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4006690574 0 0) 0x7f4820070e70 con 0x7f48200b96b0 2023-07-12T02:02:04.786 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.781+0000 7f481effd700 1 -- 172.21.15.60:0/1172034087 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4820070670 con 0x7f4820071a30 2023-07-12T02:02:04.787 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.781+0000 7f481effd700 1 --2- 172.21.15.60:0/1172034087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4820071a30 0x7f482014ab20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f48200b9400 tx=0x7f4814009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73449f93ef809b43 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:04.787 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.781+0000 7f481e7fc700 1 -- 172.21.15.60:0/1172034087 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4814011830 con 0x7f4820071a30 2023-07-12T02:02:04.787 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.781+0000 7f481e7fc700 1 -- 172.21.15.60:0/1172034087 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4814011990 con 0x7f4820071a30 2023-07-12T02:02:04.787 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.781+0000 7f481e7fc700 1 -- 172.21.15.60:0/1172034087 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4814011d20 con 0x7f4820071a30 2023-07-12T02:02:04.790 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.782+0000 7f4826199700 1 -- 172.21.15.60:0/1172034087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4820071a30 msgr2=0x7f482014ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:04.790 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.782+0000 7f4826199700 1 --2- 172.21.15.60:0/1172034087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4820071a30 0x7f482014ab20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f48200b9400 tx=0x7f4814009b20 comp rx=0 tx=0).stop 2023-07-12T02:02:04.790 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.782+0000 7f4826199700 1 -- 172.21.15.60:0/1172034087 shutdown_connections 2023-07-12T02:02:04.790 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.782+0000 7f4826199700 1 --2- 172.21.15.60:0/1172034087 >> v2:172.21.15.79:3300/0 conn(0x7f4820141780 0x7f48200ba010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:04.790 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.782+0000 7f4826199700 1 --2- 172.21.15.60:0/1172034087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4820071a30 0x7f482014ab20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:04.790 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.782+0000 7f4826199700 1 -- 172.21.15.60:0/1172034087 >> 172.21.15.60:0/1172034087 conn(0x7f482006d0e0 msgr2=0x7f482006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:04.790 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.782+0000 7f4826199700 1 -- 172.21.15.60:0/1172034087 shutdown_connections 2023-07-12T02:02:04.791 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.782+0000 7f4826199700 1 -- 172.21.15.60:0/1172034087 wait complete. 2023-07-12T02:02:04.791 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.784+0000 7f4826199700 1 Processor -- start 2023-07-12T02:02:04.791 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.784+0000 7f4826199700 1 -- start start 2023-07-12T02:02:04.791 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.785+0000 7f4826199700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4820071a30 0x7f48200b73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:04.791 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.785+0000 7f4826199700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48200b96b0 0x7f48201e1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:04.791 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.785+0000 7f4826199700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4820141780 0x7f48201302f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:04.791 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.785+0000 7f4826199700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4820144170 con 0x7f4820141780 2023-07-12T02:02:04.792 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.785+0000 7f4826199700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48200b5ca0 con 0x7f4820071a30 2023-07-12T02:02:04.792 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.785+0000 7f4826199700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48200b7900 con 0x7f48200b96b0 2023-07-12T02:02:04.792 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.785+0000 7f481ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4820141780 0x7f48201302f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:04.792 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.785+0000 7f481ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4820141780 0x7f48201302f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35426/0 (socket says 172.21.15.60:35426) 2023-07-12T02:02:04.792 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.785+0000 7f481ffff700 1 -- 172.21.15.60:0/2953097929 learned_addr learned my addr 172.21.15.60:0/2953097929 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:04.792 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.785+0000 7f481effd700 1 --2- 172.21.15.60:0/2953097929 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48200b96b0 0x7f48201e1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:04.793 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.785+0000 7f481f7fe700 1 --2- 172.21.15.60:0/2953097929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4820071a30 0x7f48200b73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:04.793 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.785+0000 7f481ffff700 1 -- 172.21.15.60:0/2953097929 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48200b96b0 msgr2=0x7f48201e1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:04.793 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.785+0000 7f481ffff700 1 --2- 172.21.15.60:0/2953097929 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48200b96b0 0x7f48201e1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:04.793 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.785+0000 7f481ffff700 1 -- 172.21.15.60:0/2953097929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4820071a30 msgr2=0x7f48200b73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:04.793 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.785+0000 7f481ffff700 1 --2- 172.21.15.60:0/2953097929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4820071a30 0x7f48200b73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:04.793 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.785+0000 7f481ffff700 1 -- 172.21.15.60:0/2953097929 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48140094a0 con 0x7f4820141780 2023-07-12T02:02:04.793 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.785+0000 7f481effd700 1 --2- 172.21.15.60:0/2953097929 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48200b96b0 0x7f48201e1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:04.794 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.785+0000 7f481ffff700 1 --2- 172.21.15.60:0/2953097929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4820141780 0x7f48201302f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f481800cc70 tx=0x7f481800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:04.794 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.785+0000 7f4807fff700 1 -- 172.21.15.60:0/2953097929 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481800ada0 con 0x7f4820141780 2023-07-12T02:02:04.794 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.785+0000 7f4807fff700 1 -- 172.21.15.60:0/2953097929 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f481800ce70 con 0x7f4820141780 2023-07-12T02:02:04.794 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.785+0000 7f4807fff700 1 -- 172.21.15.60:0/2953097929 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48180072f0 con 0x7f4820141780 2023-07-12T02:02:04.794 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.785+0000 7f4826199700 1 -- 172.21.15.60:0/2953097929 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48201e1b50 con 0x7f4820141780 2023-07-12T02:02:04.794 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.786+0000 7f4826199700 1 -- 172.21.15.60:0/2953097929 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48201443c0 con 0x7f4820141780 2023-07-12T02:02:04.794 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.786+0000 7f4826199700 1 -- 172.21.15.60:0/2953097929 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48200702c0 con 0x7f4820141780 2023-07-12T02:02:04.794 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.787+0000 7f4807fff700 1 -- 172.21.15.60:0/2953097929 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f4818007450 con 0x7f4820141780 2023-07-12T02:02:04.795 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.787+0000 7f4807fff700 1 --2- 172.21.15.60:0/2953097929 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f480c06ac50 0x7f480c06d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:04.795 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.787+0000 7f4807fff700 1 -- 172.21.15.60:0/2953097929 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f48180888e0 con 0x7f4820141780 2023-07-12T02:02:04.796 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.787+0000 7f481f7fe700 1 --2- 172.21.15.60:0/2953097929 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f480c06ac50 0x7f480c06d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:04.796 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.788+0000 7f481f7fe700 1 --2- 172.21.15.60:0/2953097929 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f480c06ac50 0x7f480c06d100 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4810009ad0 tx=0x7f4810008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:04.796 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.792+0000 7f4807fff700 1 -- 172.21.15.60:0/2953097929 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f48180540a0 con 0x7f4820141780 2023-07-12T02:02:04.998 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.995+0000 7f4826199700 1 -- 172.21.15.60:0/2953097929 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4820074360 con 0x7f4820141780 2023-07-12T02:02:04.999 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.996+0000 7f4807fff700 1 -- 172.21.15.60:0/2953097929 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10860 (secure 0 0 0) 0x7f4818018090 con 0x7f4820141780 2023-07-12T02:02:04.999 INFO:teuthology.misc.health.smithi060.stdout: 2023-07-12T02:02:05.000 INFO:teuthology.misc.health.smithi060.stdout:{"epoch":13,"fsid":"97e7c909-e567-472e-a5aa-72fde15171f2","created":"2023-07-12T02:01:53.987086+0000","modified":"2023-07-12T02:02:04.031780+0000","last_up_change":"2023-07-12T02:02:04.031780+0000","last_in_change":"2023-07-12T02:01:56.538621+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ed8b71c2-3895-4952-a118-16ede0b4a98c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6801","nonce":2818935979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6803","nonce":2818935979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6807","nonce":2818935979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6805","nonce":2818935979}]},"public_addr":"172.21.15.60:6801/2818935979","cluster_addr":"172.21.15.60:6803/2818935979","heartbeat_back_addr":"172.21.15.60:6807/2818935979","heartbeat_front_addr":"172.21.15.60:6805/2818935979","state":["exists","up"]},{"osd":1,"uuid":"7cf4d354-78e0-43ce-8c09-4a7d2a0b57a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6817","nonce":1678864191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6819","nonce":1678864191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6823","nonce":1678864191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6821","nonce":1678864191}]},"public_addr":"172.21.15.60:6817/1678864191","cluster_addr":"172.21.15.60:6819/1678864191","heartbeat_back_addr":"172.21.15.60:6823/1678864191","heartbeat_front_addr":"172.21.15.60:6821/1678864191","state":["exists","up"]},{"osd":2,"uuid":"02c958b8-9599-4470-92cb-8f7018ec0189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6809","nonce":1459480680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6811","nonce":1459480680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6815","nonce":1459480680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6813","nonce":1459480680}]},"public_addr":"172.21.15.60:6809/1459480680","cluster_addr":"172.21.15.60:6811/1459480680","heartbeat_back_addr":"172.21.15.60:6815/1459480680","heartbeat_front_addr":"172.21.15.60:6813/1459480680","state":["exists","up"]},{"osd":3,"uuid":"bc300432-a228-4257-be5c-e42dd5f2015f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6825","nonce":3295100060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6827","nonce":3295100060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6831","nonce":3295100060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6829","nonce":3295100060}]},"public_addr":"172.21.15.60:6825/3295100060","cluster_addr":"172.21.15.60:6827/3295100060","heartbeat_back_addr":"172.21.15.60:6831/3295100060","heartbeat_front_addr":"172.21.15.60:6829/3295100060","state":["exists","up"]},{"osd":4,"uuid":"ad9f7dc4-7126-466d-a656-2844880c6060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6809","nonce":4127109138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6811","nonce":4127109138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6815","nonce":4127109138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6813","nonce":4127109138}]},"public_addr":"172.21.15.79:6809/4127109138","cluster_addr":"172.21.15.79:6811/4127109138","heartbeat_back_addr":"172.21.15.79:6815/4127109138","heartbeat_front_addr":"172.21.15.79:6813/4127109138","state":["exists","up"]},{"osd":5,"uuid":"e88d16ca-0b01-4ab9-8aa8-c4aff7f210f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6801","nonce":421449406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6803","nonce":421449406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6807","nonce":421449406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6805","nonce":421449406}]},"public_addr":"172.21.15.79:6801/421449406","cluster_addr":"172.21.15.79:6803/421449406","heartbeat_back_addr":"172.21.15.79:6807/421449406","heartbeat_front_addr":"172.21.15.79:6805/421449406","state":["exists","up"]},{"osd":6,"uuid":"6898cb84-56d1-48a9-bd45-97e4668e2fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6825","nonce":4144355139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6827","nonce":4144355139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6831","nonce":4144355139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6829","nonce":4144355139}]},"public_addr":"172.21.15.79:6825/4144355139","cluster_addr":"172.21.15.79:6827/4144355139","heartbeat_back_addr":"172.21.15.79:6831/4144355139","heartbeat_front_addr":"172.21.15.79:6829/4144355139","state":["exists","up"]},{"osd":7,"uuid":"65c10882-371e-4762-b384-9c3a48f332ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6817","nonce":2845223299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6819","nonce":2845223299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6823","nonce":2845223299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6821","nonce":2845223299}]},"public_addr":"172.21.15.79:6817/2845223299","cluster_addr":"172.21.15.79:6819/2845223299","heartbeat_back_addr":"172.21.15.79:6823/2845223299","heartbeat_front_addr":"172.21.15.79:6821/2845223299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:02:05.002 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.998+0000 7f4826199700 1 -- 172.21.15.60:0/2953097929 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f480c06ac50 msgr2=0x7f480c06d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:05.002 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.998+0000 7f4826199700 1 --2- 172.21.15.60:0/2953097929 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f480c06ac50 0x7f480c06d100 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4810009ad0 tx=0x7f4810008040 comp rx=0 tx=0).stop 2023-07-12T02:02:05.002 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.998+0000 7f4826199700 1 -- 172.21.15.60:0/2953097929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4820141780 msgr2=0x7f48201302f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:05.002 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.998+0000 7f4826199700 1 --2- 172.21.15.60:0/2953097929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4820141780 0x7f48201302f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f481800cc70 tx=0x7f481800a340 comp rx=0 tx=0).stop 2023-07-12T02:02:05.002 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.998+0000 7f4826199700 1 -- 172.21.15.60:0/2953097929 shutdown_connections 2023-07-12T02:02:05.002 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.998+0000 7f4826199700 1 --2- 172.21.15.60:0/2953097929 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f480c06ac50 0x7f480c06d100 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:05.003 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.998+0000 7f4826199700 1 --2- 172.21.15.60:0/2953097929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4820141780 0x7f48201302f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:05.003 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.998+0000 7f4826199700 1 --2- 172.21.15.60:0/2953097929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4820071a30 0x7f48200b73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:05.003 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.998+0000 7f4826199700 1 --2- 172.21.15.60:0/2953097929 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f48200b96b0 0x7f48201e1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:05.003 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.998+0000 7f4826199700 1 -- 172.21.15.60:0/2953097929 >> 172.21.15.60:0/2953097929 conn(0x7f482006d0e0 msgr2=0x7f482013f860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:05.003 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.999+0000 7f4826199700 1 -- 172.21.15.60:0/2953097929 shutdown_connections 2023-07-12T02:02:05.003 INFO:teuthology.misc.health.smithi060.stderr:2023-07-12T02:02:04.999+0000 7f4826199700 1 -- 172.21.15.60:0/2953097929 wait complete. 2023-07-12T02:02:05.013 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-07-12T02:02:05.013 INFO:tasks.ceph:Creating RBD pool 2023-07-12T02:02:05.013 DEBUG:teuthology.orchestra.run.smithi060:> sudo ceph --cluster ceph osd pool create rbd 8 2023-07-12T02:02:05.139 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.136+0000 7f066f09e700 1 Processor -- start 2023-07-12T02:02:05.139 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.136+0000 7f066f09e700 1 -- start start 2023-07-12T02:02:05.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.136+0000 7f066f09e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f06680bc810 0x7f06680ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:05.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.136+0000 7f066f09e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f06680b8d90 0x7f066806ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:05.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.136+0000 7f066f09e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06680b8620 con 0x7f06681449d0 2023-07-12T02:02:05.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.136+0000 7f066f09e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06680b97a0 con 0x7f06680bc810 2023-07-12T02:02:05.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.136+0000 7f066f09e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0668144da0 con 0x7f06680b8d90 2023-07-12T02:02:05.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.137+0000 7f0667fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f06680bc810 0x7f06680ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:05.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.137+0000 7f066ce3a700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f06681449d0 0x7f066814db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45882/0 (socket says 172.21.15.60:45882) 2023-07-12T02:02:05.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.137+0000 7f066ce3a700 1 -- 172.21.15.60:0/2308378054 learned_addr learned my addr 172.21.15.60:0/2308378054 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:05.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.137+0000 7f066d63b700 1 --2- 172.21.15.60:0/2308378054 >> v2:172.21.15.79:3300/0 conn(0x7f06680b8d90 0x7f066806ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:05.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.137+0000 7f0667fff700 1 -- 172.21.15.60:0/2308378054 >> v2:172.21.15.79:3300/0 conn(0x7f06680b8d90 msgr2=0x7f066806ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:05.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.137+0000 7f0667fff700 1 --2- 172.21.15.60:0/2308378054 >> v2:172.21.15.79:3300/0 conn(0x7f06680b8d90 0x7f066806ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:05.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.137+0000 7f0667fff700 1 -- 172.21.15.60:0/2308378054 >> v1:172.21.15.60:6789/0 conn(0x7f06681449d0 legacy=0x7f066814db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:05.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.137+0000 7f0667fff700 1 -- 172.21.15.60:0/2308378054 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06680b8900 con 0x7f06680bc810 2023-07-12T02:02:05.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.137+0000 7f06677fe700 1 -- 172.21.15.60:0/2308378054 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3006441747 0 0) 0x7f06680b8620 con 0x7f06681449d0 2023-07-12T02:02:05.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.137+0000 7f0667fff700 1 --2- 172.21.15.60:0/2308378054 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06680bc810 0x7f06680ba530 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f06680be710 tx=0x7f0654009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a20ad2bce0fa1364 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:05.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.137+0000 7f06677fe700 1 -- 172.21.15.60:0/2308378054 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0654011830 con 0x7f06680bc810 2023-07-12T02:02:05.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.137+0000 7f06677fe700 1 -- 172.21.15.60:0/2308378054 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0654011990 con 0x7f06680bc810 2023-07-12T02:02:05.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.137+0000 7f06677fe700 1 -- 172.21.15.60:0/2308378054 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0654011d20 con 0x7f06680bc810 2023-07-12T02:02:05.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.138+0000 7f066f09e700 1 -- 172.21.15.60:0/2308378054 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06680bc810 msgr2=0x7f06680ba530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:05.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.138+0000 7f066f09e700 1 --2- 172.21.15.60:0/2308378054 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06680bc810 0x7f06680ba530 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f06680be710 tx=0x7f0654009b20 comp rx=0 tx=0).stop 2023-07-12T02:02:05.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.138+0000 7f066f09e700 1 -- 172.21.15.60:0/2308378054 shutdown_connections 2023-07-12T02:02:05.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.138+0000 7f066f09e700 1 --2- 172.21.15.60:0/2308378054 >> v2:172.21.15.79:3300/0 conn(0x7f06680b8d90 0x7f066806ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:05.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.138+0000 7f066f09e700 1 --2- 172.21.15.60:0/2308378054 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06680bc810 0x7f06680ba530 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:05.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.138+0000 7f066f09e700 1 -- 172.21.15.60:0/2308378054 >> 172.21.15.60:0/2308378054 conn(0x7f06680c0860 msgr2=0x7f06680c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:05.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.138+0000 7f066f09e700 1 -- 172.21.15.60:0/2308378054 shutdown_connections 2023-07-12T02:02:05.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.138+0000 7f066f09e700 1 -- 172.21.15.60:0/2308378054 wait complete. 2023-07-12T02:02:05.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.139+0000 7f066f09e700 1 Processor -- start 2023-07-12T02:02:05.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.139+0000 7f066f09e700 1 -- start start 2023-07-12T02:02:05.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.140+0000 7f066f09e700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f06680b8d90 0x7f06680b3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:05.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.140+0000 7f066f09e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06680bc810 0x7f06680b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:05.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.140+0000 7f066f09e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06681449d0 0x7f06680b1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:05.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.140+0000 7f066f09e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06681e3430 con 0x7f06680bc810 2023-07-12T02:02:05.149 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.140+0000 7f066f09e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06680b35d0 con 0x7f06681449d0 2023-07-12T02:02:05.149 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.140+0000 7f066f09e700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0668148430 con 0x7f06680b8d90 2023-07-12T02:02:05.149 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.140+0000 7f0667fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06680bc810 0x7f06680b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:05.149 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.140+0000 7f0667fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06680bc810 0x7f06680b3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35442/0 (socket says 172.21.15.60:35442) 2023-07-12T02:02:05.149 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.140+0000 7f0667fff700 1 -- 172.21.15.60:0/3569416979 learned_addr learned my addr 172.21.15.60:0/3569416979 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:05.149 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.140+0000 7f066ce3a700 1 --2- 172.21.15.60:0/3569416979 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f06680b8d90 0x7f06680b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:05.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.140+0000 7f0667fff700 1 -- 172.21.15.60:0/3569416979 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f06680b8d90 msgr2=0x7f06680b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:05.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.140+0000 7f0667fff700 1 --2- 172.21.15.60:0/3569416979 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f06680b8d90 0x7f06680b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:05.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.140+0000 7f0667fff700 1 -- 172.21.15.60:0/3569416979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06681449d0 msgr2=0x7f06680b1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:05.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.140+0000 7f0667fff700 1 --2- 172.21.15.60:0/3569416979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06681449d0 0x7f06680b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:05.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.140+0000 7f0667fff700 1 -- 172.21.15.60:0/3569416979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06540094a0 con 0x7f06680bc810 2023-07-12T02:02:05.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.140+0000 7f0667fff700 1 --2- 172.21.15.60:0/3569416979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06680bc810 0x7f06680b3d60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0654000c00 tx=0x7f0654004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:05.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.140+0000 7f06657fa700 1 -- 172.21.15.60:0/3569416979 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06540038a0 con 0x7f06680bc810 2023-07-12T02:02:05.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.140+0000 7f06657fa700 1 -- 172.21.15.60:0/3569416979 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f065401f070 con 0x7f06680bc810 2023-07-12T02:02:05.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.140+0000 7f066f09e700 1 -- 172.21.15.60:0/3569416979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06680b73c0 con 0x7f06680bc810 2023-07-12T02:02:05.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.140+0000 7f06657fa700 1 -- 172.21.15.60:0/3569416979 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0654003c40 con 0x7f06680bc810 2023-07-12T02:02:05.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.140+0000 7f066f09e700 1 -- 172.21.15.60:0/3569416979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06681e3960 con 0x7f06680bc810 2023-07-12T02:02:05.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.141+0000 7f066f09e700 1 -- 172.21.15.60:0/3569416979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06680bfdb0 con 0x7f06680bc810 2023-07-12T02:02:05.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.142+0000 7f06657fa700 1 -- 172.21.15.60:0/3569416979 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f0654026480 con 0x7f06680bc810 2023-07-12T02:02:05.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.142+0000 7f06657fa700 1 --2- 172.21.15.60:0/3569416979 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f064c06ac80 0x7f064c06d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:05.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.142+0000 7f06657fa700 1 -- 172.21.15.60:0/3569416979 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f0654021070 con 0x7f06680bc810 2023-07-12T02:02:05.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.143+0000 7f066ce3a700 1 --2- 172.21.15.60:0/3569416979 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f064c06ac80 0x7f064c06d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:05.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.143+0000 7f066ce3a700 1 --2- 172.21.15.60:0/3569416979 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f064c06ac80 0x7f064c06d130 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f065c000f60 tx=0x7f065c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:05.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.147+0000 7f06657fa700 1 -- 172.21.15.60:0/3569416979 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f0654056060 con 0x7f06680bc810 2023-07-12T02:02:05.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:05.345+0000 7f066f09e700 1 -- 172.21.15.60:0/3569416979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f0668074360 con 0x7f06680bc810 2023-07-12T02:02:06.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.262+0000 7f06657fa700 1 -- 172.21.15.60:0/3569416979 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) v1 ==== 109+0+0 (secure 0 0 0) 0x7f065402b0a0 con 0x7f06680bc810 2023-07-12T02:02:06.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.266+0000 7f066f09e700 1 -- 172.21.15.60:0/3569416979 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f064c06ac80 msgr2=0x7f064c06d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:06.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.266+0000 7f066f09e700 1 --2- 172.21.15.60:0/3569416979 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f064c06ac80 0x7f064c06d130 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f065c000f60 tx=0x7f065c009040 comp rx=0 tx=0).stop 2023-07-12T02:02:06.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.266+0000 7f066f09e700 1 -- 172.21.15.60:0/3569416979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06680bc810 msgr2=0x7f06680b3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:06.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.266+0000 7f066f09e700 1 --2- 172.21.15.60:0/3569416979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06680bc810 0x7f06680b3d60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0654000c00 tx=0x7f0654004750 comp rx=0 tx=0).stop 2023-07-12T02:02:06.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.266+0000 7f066f09e700 1 -- 172.21.15.60:0/3569416979 shutdown_connections 2023-07-12T02:02:06.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.266+0000 7f066f09e700 1 --2- 172.21.15.60:0/3569416979 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f064c06ac80 0x7f064c06d130 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:06.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.266+0000 7f066f09e700 1 --2- 172.21.15.60:0/3569416979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06681449d0 0x7f06680b1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:06.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.266+0000 7f066f09e700 1 --2- 172.21.15.60:0/3569416979 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f06680b8d90 0x7f06680b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:06.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.266+0000 7f066f09e700 1 --2- 172.21.15.60:0/3569416979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06680bc810 0x7f06680b3d60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:06.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.266+0000 7f066f09e700 1 -- 172.21.15.60:0/3569416979 >> 172.21.15.60:0/3569416979 conn(0x7f06680c0860 msgr2=0x7f06680bf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:06.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.266+0000 7f066f09e700 1 -- 172.21.15.60:0/3569416979 shutdown_connections 2023-07-12T02:02:06.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.266+0000 7f066f09e700 1 -- 172.21.15.60:0/3569416979 wait complete. 2023-07-12T02:02:06.271 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'rbd' created 2023-07-12T02:02:06.284 DEBUG:teuthology.orchestra.run.smithi060:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-07-12T02:02:06.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.416+0000 7fc0bb317700 1 Processor -- start 2023-07-12T02:02:06.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.416+0000 7fc0bb317700 1 -- start start 2023-07-12T02:02:06.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.417+0000 7fc0bb317700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc0b406b120 0x7fc0b41474f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:06.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.417+0000 7fc0bb317700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc0b4147a30 0x7fc0b40b6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:06.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.417+0000 7fc0bb317700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0b40b3bd0 con 0x7fc0b4071b60 2023-07-12T02:02:06.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.417+0000 7fc0bb317700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0b4070800 con 0x7fc0b4147a30 2023-07-12T02:02:06.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.417+0000 7fc0bb317700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b4141c90 con 0x7fc0b406b120 2023-07-12T02:02:06.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.417+0000 7fc0b98b4700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc0b4147a30 0x7fc0b40b6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:06.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.417+0000 7fc0b98b4700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc0b4147a30 0x7fc0b40b6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35452/0 (socket says 172.21.15.60:35452) 2023-07-12T02:02:06.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.417+0000 7fc0b98b4700 1 -- 172.21.15.60:0/419234901 learned_addr learned my addr 172.21.15.60:0/419234901 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:06.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.417+0000 7fc0b88b2700 1 --1- 172.21.15.60:0/419234901 >> v1:172.21.15.60:6789/0 conn(0x7fc0b4071b60 0x7fc0b40b6430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45892/0 (socket says 172.21.15.60:45892) 2023-07-12T02:02:06.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.417+0000 7fc0b90b3700 1 --2- 172.21.15.60:0/419234901 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc0b406b120 0x7fc0b41474f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:06.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.417+0000 7fc0b98b4700 1 -- 172.21.15.60:0/419234901 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc0b406b120 msgr2=0x7fc0b41474f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:06.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.417+0000 7fc0b98b4700 1 --2- 172.21.15.60:0/419234901 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc0b406b120 0x7fc0b41474f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:06.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.417+0000 7fc0b98b4700 1 -- 172.21.15.60:0/419234901 >> v1:172.21.15.60:6789/0 conn(0x7fc0b4071b60 legacy=0x7fc0b40b6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:06.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.417+0000 7fc0b98b4700 1 -- 172.21.15.60:0/419234901 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b40714d0 con 0x7fc0b4147a30 2023-07-12T02:02:06.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.417+0000 7fc0abfff700 1 -- 172.21.15.60:0/419234901 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 500632687 0 0) 0x7fc0b40b3bd0 con 0x7fc0b4071b60 2023-07-12T02:02:06.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.417+0000 7fc0b98b4700 1 --2- 172.21.15.60:0/419234901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0b4147a30 0x7fc0b40b6b40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac00bb90 tx=0x7fc0ac00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8120ef98ae229b94 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:06.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.418+0000 7fc0abfff700 1 -- 172.21.15.60:0/419234901 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac00dd30 con 0x7fc0b4147a30 2023-07-12T02:02:06.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.418+0000 7fc0abfff700 1 -- 172.21.15.60:0/419234901 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0ac00de90 con 0x7fc0b4147a30 2023-07-12T02:02:06.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.418+0000 7fc0abfff700 1 -- 172.21.15.60:0/419234901 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac010690 con 0x7fc0b4147a30 2023-07-12T02:02:06.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.418+0000 7fc0bb317700 1 -- 172.21.15.60:0/419234901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0b4147a30 msgr2=0x7fc0b40b6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:06.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.418+0000 7fc0bb317700 1 --2- 172.21.15.60:0/419234901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0b4147a30 0x7fc0b40b6b40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac00bb90 tx=0x7fc0ac00bea0 comp rx=0 tx=0).stop 2023-07-12T02:02:06.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.418+0000 7fc0bb317700 1 -- 172.21.15.60:0/419234901 shutdown_connections 2023-07-12T02:02:06.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.418+0000 7fc0bb317700 1 --2- 172.21.15.60:0/419234901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0b4147a30 0x7fc0b40b6b40 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:06.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.418+0000 7fc0bb317700 1 --2- 172.21.15.60:0/419234901 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc0b406b120 0x7fc0b41474f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:06.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.418+0000 7fc0bb317700 1 -- 172.21.15.60:0/419234901 >> 172.21.15.60:0/419234901 conn(0x7fc0b40bd980 msgr2=0x7fc0b40b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:06.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.418+0000 7fc0bb317700 1 -- 172.21.15.60:0/419234901 shutdown_connections 2023-07-12T02:02:06.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.418+0000 7fc0bb317700 1 -- 172.21.15.60:0/419234901 wait complete. 2023-07-12T02:02:06.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.419+0000 7fc0bb317700 1 Processor -- start 2023-07-12T02:02:06.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.420+0000 7fc0bb317700 1 -- start start 2023-07-12T02:02:06.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.420+0000 7fc0bb317700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc0b406b120 0x7fc0b413cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:06.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.420+0000 7fc0bb317700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0b4071b60 0x7fc0b413d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:06.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.420+0000 7fc0bb317700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0b4147a30 0x7fc0b413dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:06.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.420+0000 7fc0bb317700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b413d470 con 0x7fc0b4147a30 2023-07-12T02:02:06.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.420+0000 7fc0bb317700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b40b5af0 con 0x7fc0b4071b60 2023-07-12T02:02:06.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.420+0000 7fc0bb317700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b40b67c0 con 0x7fc0b406b120 2023-07-12T02:02:06.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.420+0000 7fc0b98b4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0b4147a30 0x7fc0b413dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:06.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.420+0000 7fc0b98b4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0b4147a30 0x7fc0b413dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35462/0 (socket says 172.21.15.60:35462) 2023-07-12T02:02:06.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.420+0000 7fc0b98b4700 1 -- 172.21.15.60:0/4057572935 learned_addr learned my addr 172.21.15.60:0/4057572935 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:06.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.420+0000 7fc0b90b3700 1 --2- 172.21.15.60:0/4057572935 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc0b406b120 0x7fc0b413cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:06.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.420+0000 7fc0b88b2700 1 --2- 172.21.15.60:0/4057572935 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0b4071b60 0x7fc0b413d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:06.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.421+0000 7fc0b98b4700 1 -- 172.21.15.60:0/4057572935 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc0b406b120 msgr2=0x7fc0b413cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:06.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.421+0000 7fc0b98b4700 1 --2- 172.21.15.60:0/4057572935 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc0b406b120 0x7fc0b413cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:06.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.421+0000 7fc0b98b4700 1 -- 172.21.15.60:0/4057572935 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0b4071b60 msgr2=0x7fc0b413d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:06.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.421+0000 7fc0b98b4700 1 --2- 172.21.15.60:0/4057572935 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0b4071b60 0x7fc0b413d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:06.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.421+0000 7fc0b98b4700 1 -- 172.21.15.60:0/4057572935 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0ac00b7f0 con 0x7fc0b4147a30 2023-07-12T02:02:06.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.421+0000 7fc0b90b3700 1 --2- 172.21.15.60:0/4057572935 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc0b406b120 0x7fc0b413cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:06.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.421+0000 7fc0b88b2700 1 --2- 172.21.15.60:0/4057572935 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0b4071b60 0x7fc0b413d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:06.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.421+0000 7fc0b98b4700 1 --2- 172.21.15.60:0/4057572935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0b4147a30 0x7fc0b413dbc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc0b406d830 tx=0x7fc0ac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:06.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.421+0000 7fc0a9ffb700 1 -- 172.21.15.60:0/4057572935 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac003bf0 con 0x7fc0b4147a30 2023-07-12T02:02:06.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.421+0000 7fc0a9ffb700 1 -- 172.21.15.60:0/4057572935 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0ac003d50 con 0x7fc0b4147a30 2023-07-12T02:02:06.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.421+0000 7fc0bb317700 1 -- 172.21.15.60:0/4057572935 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0b413f7d0 con 0x7fc0b4147a30 2023-07-12T02:02:06.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.421+0000 7fc0a9ffb700 1 -- 172.21.15.60:0/4057572935 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac010670 con 0x7fc0b4147a30 2023-07-12T02:02:06.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.421+0000 7fc0bb317700 1 -- 172.21.15.60:0/4057572935 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0b41e0430 con 0x7fc0b4147a30 2023-07-12T02:02:06.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.422+0000 7fc0bb317700 1 -- 172.21.15.60:0/4057572935 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0b41cdc10 con 0x7fc0b4147a30 2023-07-12T02:02:06.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.423+0000 7fc0a9ffb700 1 -- 172.21.15.60:0/4057572935 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7fc0ac019400 con 0x7fc0b4147a30 2023-07-12T02:02:06.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.423+0000 7fc0a9ffb700 1 --2- 172.21.15.60:0/4057572935 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc09806ac50 0x7fc09806d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:06.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.423+0000 7fc0a9ffb700 1 -- 172.21.15.60:0/4057572935 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5188+0+0 (secure 0 0 0) 0x7fc0ac08aa30 con 0x7fc0b4147a30 2023-07-12T02:02:06.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.423+0000 7fc0b90b3700 1 --2- 172.21.15.60:0/4057572935 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc09806ac50 0x7fc09806d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:06.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.424+0000 7fc0b90b3700 1 --2- 172.21.15.60:0/4057572935 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc09806ac50 0x7fc09806d100 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc0b00074c0 tx=0x7fc0b000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:06.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.428+0000 7fc0a9ffb700 1 -- 172.21.15.60:0/4057572935 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fc0ac055fb0 con 0x7fc0b4147a30 2023-07-12T02:02:06.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:06.627+0000 7fc0bb317700 1 -- 172.21.15.60:0/4057572935 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc0b40704d0 con 0x7fc0b4147a30 2023-07-12T02:02:07.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.264+0000 7fc0a9ffb700 1 -- 172.21.15.60:0/4057572935 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v16) v1 ==== 173+0+0 (secure 0 0 0) 0x7fc0ac0595d0 con 0x7fc0b4147a30 2023-07-12T02:02:07.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.268+0000 7fc0bb317700 1 -- 172.21.15.60:0/4057572935 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc09806ac50 msgr2=0x7fc09806d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:07.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.268+0000 7fc0bb317700 1 --2- 172.21.15.60:0/4057572935 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc09806ac50 0x7fc09806d100 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc0b00074c0 tx=0x7fc0b000b040 comp rx=0 tx=0).stop 2023-07-12T02:02:07.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.268+0000 7fc0bb317700 1 -- 172.21.15.60:0/4057572935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0b4147a30 msgr2=0x7fc0b413dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:07.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.268+0000 7fc0bb317700 1 --2- 172.21.15.60:0/4057572935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0b4147a30 0x7fc0b413dbc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc0b406d830 tx=0x7fc0ac004750 comp rx=0 tx=0).stop 2023-07-12T02:02:07.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.268+0000 7fc0bb317700 1 -- 172.21.15.60:0/4057572935 shutdown_connections 2023-07-12T02:02:07.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.268+0000 7fc0bb317700 1 --2- 172.21.15.60:0/4057572935 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc09806ac50 0x7fc09806d100 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:07.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.268+0000 7fc0bb317700 1 --2- 172.21.15.60:0/4057572935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0b4147a30 0x7fc0b413dbc0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:07.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.268+0000 7fc0bb317700 1 --2- 172.21.15.60:0/4057572935 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc0b406b120 0x7fc0b413cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:07.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.268+0000 7fc0bb317700 1 --2- 172.21.15.60:0/4057572935 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0b4071b60 0x7fc0b413d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:07.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.268+0000 7fc0bb317700 1 -- 172.21.15.60:0/4057572935 >> 172.21.15.60:0/4057572935 conn(0x7fc0b40bd980 msgr2=0x7fc0b41cd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:07.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.268+0000 7fc0bb317700 1 -- 172.21.15.60:0/4057572935 shutdown_connections 2023-07-12T02:02:07.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.268+0000 7fc0bb317700 1 -- 172.21.15.60:0/4057572935 wait complete. 2023-07-12T02:02:07.275 INFO:teuthology.orchestra.run.smithi060.stderr:enabled application 'rbd' on pool 'rbd' 2023-07-12T02:02:07.287 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-07-12T02:02:07.288 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-12T02:02:07.288 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-12T02:02:07.290 INFO:tasks.ceph.mds.a:Started 2023-07-12T02:02:07.291 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-12T02:02:07.291 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-12T02:02:07.294 INFO:tasks.ceph.mds.c:Started 2023-07-12T02:02:07.294 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-12T02:02:07.295 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-12T02:02:07.297 INFO:tasks.ceph.mds.b:Started 2023-07-12T02:02:07.297 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-07-12T02:02:07.298 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:02:07.384 INFO:tasks.ceph.mds.b.smithi079.stdout:starting mds.b at 2023-07-12T02:02:07.395 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2023-07-12T02:02:07.397 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2023-07-12T02:02:07.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.442+0000 7f924579a700 1 Processor -- start 2023-07-12T02:02:07.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.442+0000 7f924579a700 1 -- start start 2023-07-12T02:02:07.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.443+0000 7f924579a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f92400ba800 0x7f92400b9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:07.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.443+0000 7f924579a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f92400b4890 0x7f924014dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:07.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.443+0000 7f924579a700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92400b4d10 con 0x7f924014e2a0 2023-07-12T02:02:07.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.443+0000 7f924579a700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92400b66d0 con 0x7f92400b4890 2023-07-12T02:02:07.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.443+0000 7f924579a700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92400b69b0 con 0x7f92400ba800 2023-07-12T02:02:07.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.443+0000 7f923e7fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f92400b4890 0x7f924014dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:07.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.443+0000 7f923f7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f924014e2a0 0x7f92401442c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52422/0 (socket says 172.21.15.60:52422) 2023-07-12T02:02:07.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.443+0000 7f923f7fe700 1 -- 172.21.15.60:0/3350737215 learned_addr learned my addr 172.21.15.60:0/3350737215 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:07.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.443+0000 7f923effd700 1 --2- 172.21.15.60:0/3350737215 >> v2:172.21.15.79:3300/0 conn(0x7f92400ba800 0x7f92400b9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:07.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.443+0000 7f923dffb700 1 -- 172.21.15.60:0/3350737215 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1779864642 0 0) 0x7f92400b4d10 con 0x7f924014e2a0 2023-07-12T02:02:07.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.443+0000 7f923dffb700 1 -- 172.21.15.60:0/3350737215 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92280035b0 con 0x7f924014e2a0 2023-07-12T02:02:07.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.443+0000 7f923e7fc700 1 -- 172.21.15.60:0/3350737215 >> v2:172.21.15.79:3300/0 conn(0x7f92400ba800 msgr2=0x7f92400b9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:07.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.443+0000 7f923e7fc700 1 --2- 172.21.15.60:0/3350737215 >> v2:172.21.15.79:3300/0 conn(0x7f92400ba800 0x7f92400b9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:07.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.443+0000 7f923e7fc700 1 -- 172.21.15.60:0/3350737215 >> v1:172.21.15.60:6789/0 conn(0x7f924014e2a0 legacy=0x7f92401442c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:07.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.443+0000 7f923e7fc700 1 -- 172.21.15.60:0/3350737215 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92400b6c90 con 0x7f92400b4890 2023-07-12T02:02:07.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.444+0000 7f923effd700 1 --2- 172.21.15.60:0/3350737215 >> v2:172.21.15.79:3300/0 conn(0x7f92400ba800 0x7f92400b9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:02:07.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.444+0000 7f923e7fc700 1 --2- 172.21.15.60:0/3350737215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92400b4890 0x7f924014dd60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f924006f1c0 tx=0x7f9234009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32dccd2db0d3142 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:07.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.444+0000 7f923dffb700 1 -- 172.21.15.60:0/3350737215 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9234011830 con 0x7f92400b4890 2023-07-12T02:02:07.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.444+0000 7f923dffb700 1 -- 172.21.15.60:0/3350737215 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9234011990 con 0x7f92400b4890 2023-07-12T02:02:07.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.444+0000 7f923dffb700 1 -- 172.21.15.60:0/3350737215 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9234011d00 con 0x7f92400b4890 2023-07-12T02:02:07.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.444+0000 7f924579a700 1 -- 172.21.15.60:0/3350737215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92400b4890 msgr2=0x7f924014dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:07.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.444+0000 7f924579a700 1 --2- 172.21.15.60:0/3350737215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92400b4890 0x7f924014dd60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f924006f1c0 tx=0x7f9234009b20 comp rx=0 tx=0).stop 2023-07-12T02:02:07.453 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.445+0000 7f924579a700 1 -- 172.21.15.60:0/3350737215 shutdown_connections 2023-07-12T02:02:07.453 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.445+0000 7f924579a700 1 --2- 172.21.15.60:0/3350737215 >> v2:172.21.15.79:3300/0 conn(0x7f92400ba800 0x7f92400b9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:07.453 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.445+0000 7f924579a700 1 --2- 172.21.15.60:0/3350737215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92400b4890 0x7f924014dd60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:07.453 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.445+0000 7f924579a700 1 -- 172.21.15.60:0/3350737215 >> 172.21.15.60:0/3350737215 conn(0x7f92400be0e0 msgr2=0x7f92400b9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:07.453 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.445+0000 7f924579a700 1 -- 172.21.15.60:0/3350737215 shutdown_connections 2023-07-12T02:02:07.453 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.445+0000 7f924579a700 1 -- 172.21.15.60:0/3350737215 wait complete. 2023-07-12T02:02:07.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.446+0000 7f924579a700 1 Processor -- start 2023-07-12T02:02:07.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.446+0000 7f924579a700 1 -- start start 2023-07-12T02:02:07.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.446+0000 7f924579a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92400b4890 0x7f92401e32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:07.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.446+0000 7f924579a700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f92400ba800 0x7f9240148ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:07.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.446+0000 7f924579a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f924014e2a0 0x7f9240149a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:07.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.446+0000 7f924579a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9240148a30 con 0x7f92400b4890 2023-07-12T02:02:07.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.446+0000 7f924579a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924014a440 con 0x7f924014e2a0 2023-07-12T02:02:07.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.446+0000 7f924579a700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92401483e0 con 0x7f92400ba800 2023-07-12T02:02:07.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.447+0000 7f923effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92400b4890 0x7f92401e32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:07.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.447+0000 7f923effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92400b4890 0x7f92401e32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36496/0 (socket says 172.21.15.60:36496) 2023-07-12T02:02:07.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.447+0000 7f923effd700 1 -- 172.21.15.60:0/1951079175 learned_addr learned my addr 172.21.15.60:0/1951079175 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:07.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.447+0000 7f923e7fc700 1 --2- 172.21.15.60:0/1951079175 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f92400ba800 0x7f9240148ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:07.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.447+0000 7f923f7fe700 1 --2- 172.21.15.60:0/1951079175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f924014e2a0 0x7f9240149a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:07.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.447+0000 7f923effd700 1 -- 172.21.15.60:0/1951079175 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f92400ba800 msgr2=0x7f9240148ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:07.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.447+0000 7f923effd700 1 --2- 172.21.15.60:0/1951079175 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f92400ba800 0x7f9240148ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:07.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.447+0000 7f923effd700 1 -- 172.21.15.60:0/1951079175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f924014e2a0 msgr2=0x7f9240149a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:07.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.447+0000 7f923effd700 1 --2- 172.21.15.60:0/1951079175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f924014e2a0 0x7f9240149a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:07.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.447+0000 7f923effd700 1 -- 172.21.15.60:0/1951079175 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92300094a0 con 0x7f92400b4890 2023-07-12T02:02:07.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.447+0000 7f923effd700 1 --2- 172.21.15.60:0/1951079175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92400b4890 0x7f92401e32f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f923000ebe0 tx=0x7f923000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:07.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.447+0000 7f92277fe700 1 -- 172.21.15.60:0/1951079175 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923000c850 con 0x7f92400b4890 2023-07-12T02:02:07.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.447+0000 7f92277fe700 1 -- 172.21.15.60:0/1951079175 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f923000c9b0 con 0x7f92400b4890 2023-07-12T02:02:07.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.447+0000 7f924579a700 1 -- 172.21.15.60:0/1951079175 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92340094a0 con 0x7f92400b4890 2023-07-12T02:02:07.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.447+0000 7f92277fe700 1 -- 172.21.15.60:0/1951079175 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923000cd40 con 0x7f92400b4890 2023-07-12T02:02:07.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.448+0000 7f924579a700 1 -- 172.21.15.60:0/1951079175 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f924014b350 con 0x7f92400b4890 2023-07-12T02:02:07.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.449+0000 7f924579a700 1 -- 172.21.15.60:0/1951079175 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f924004e210 con 0x7f92400b4890 2023-07-12T02:02:07.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.450+0000 7f92277fe700 1 -- 172.21.15.60:0/1951079175 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f9230013470 con 0x7f92400b4890 2023-07-12T02:02:07.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.450+0000 7f92277fe700 1 --2- 172.21.15.60:0/1951079175 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f922c06ac50 0x7f922c06d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:07.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.451+0000 7f92277fe700 1 -- 172.21.15.60:0/1951079175 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9230089480 con 0x7f92400b4890 2023-07-12T02:02:07.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.451+0000 7f923e7fc700 1 --2- 172.21.15.60:0/1951079175 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f922c06ac50 0x7f922c06d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:07.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.451+0000 7f923e7fc700 1 --2- 172.21.15.60:0/1951079175 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f922c06ac50 0x7f922c06d100 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f92340090b0 tx=0x7f9234008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:07.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.455+0000 7f92277fe700 1 -- 172.21.15.60:0/1951079175 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f9230054950 con 0x7f92400b4890 2023-07-12T02:02:07.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.662+0000 7f924579a700 1 -- 172.21.15.60:0/1951079175 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9240074360 con 0x7f92400b4890 2023-07-12T02:02:07.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.663+0000 7f92277fe700 1 -- 172.21.15.60:0/1951079175 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+14557 (secure 0 0 0) 0x7f923000cea0 con 0x7f92400b4890 2023-07-12T02:02:07.666 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:02:07.666 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":16,"fsid":"97e7c909-e567-472e-a5aa-72fde15171f2","created":"2023-07-12T02:01:53.987086+0000","modified":"2023-07-12T02:02:07.260884+0000","last_up_change":"2023-07-12T02:02:04.031780+0000","last_in_change":"2023-07-12T02:01:56.538621+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-12T02:02:05.375042+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-12T02:02:05.857441+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ed8b71c2-3895-4952-a118-16ede0b4a98c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6801","nonce":2818935979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6803","nonce":2818935979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6807","nonce":2818935979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6805","nonce":2818935979}]},"public_addr":"172.21.15.60:6801/2818935979","cluster_addr":"172.21.15.60:6803/2818935979","heartbeat_back_addr":"172.21.15.60:6807/2818935979","heartbeat_front_addr":"172.21.15.60:6805/2818935979","state":["exists","up"]},{"osd":1,"uuid":"7cf4d354-78e0-43ce-8c09-4a7d2a0b57a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6817","nonce":1678864191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6819","nonce":1678864191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6823","nonce":1678864191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6821","nonce":1678864191}]},"public_addr":"172.21.15.60:6817/1678864191","cluster_addr":"172.21.15.60:6819/1678864191","heartbeat_back_addr":"172.21.15.60:6823/1678864191","heartbeat_front_addr":"172.21.15.60:6821/1678864191","state":["exists","up"]},{"osd":2,"uuid":"02c958b8-9599-4470-92cb-8f7018ec0189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6809","nonce":1459480680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6811","nonce":1459480680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6815","nonce":1459480680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6813","nonce":1459480680}]},"public_addr":"172.21.15.60:6809/1459480680","cluster_addr":"172.21.15.60:6811/1459480680","heartbeat_back_addr":"172.21.15.60:6815/1459480680","heartbeat_front_addr":"172.21.15.60:6813/1459480680","state":["exists","up"]},{"osd":3,"uuid":"bc300432-a228-4257-be5c-e42dd5f2015f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6825","nonce":3295100060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6827","nonce":3295100060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6831","nonce":3295100060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6829","nonce":3295100060}]},"public_addr":"172.21.15.60:6825/3295100060","cluster_addr":"172.21.15.60:6827/3295100060","heartbeat_back_addr":"172.21.15.60:6831/3295100060","heartbeat_front_addr":"172.21.15.60:6829/3295100060","state":["exists","up"]},{"osd":4,"uuid":"ad9f7dc4-7126-466d-a656-2844880c6060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6809","nonce":4127109138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6811","nonce":4127109138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6815","nonce":4127109138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6813","nonce":4127109138}]},"public_addr":"172.21.15.79:6809/4127109138","cluster_addr":"172.21.15.79:6811/4127109138","heartbeat_back_addr":"172.21.15.79:6815/4127109138","heartbeat_front_addr":"172.21.15.79:6813/4127109138","state":["exists","up"]},{"osd":5,"uuid":"e88d16ca-0b01-4ab9-8aa8-c4aff7f210f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6801","nonce":421449406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6803","nonce":421449406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6807","nonce":421449406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6805","nonce":421449406}]},"public_addr":"172.21.15.79:6801/421449406","cluster_addr":"172.21.15.79:6803/421449406","heartbeat_back_addr":"172.21.15.79:6807/421449406","heartbeat_front_addr":"172.21.15.79:6805/421449406","state":["exists","up"]},{"osd":6,"uuid":"6898cb84-56d1-48a9-bd45-97e4668e2fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6825","nonce":4144355139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6827","nonce":4144355139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6831","nonce":4144355139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6829","nonce":4144355139}]},"public_addr":"172.21.15.79:6825/4144355139","cluster_addr":"172.21.15.79:6827/4144355139","heartbeat_back_addr":"172.21.15.79:6831/4144355139","heartbeat_front_addr":"172.21.15.79:6829/4144355139","state":["exists","up"]},{"osd":7,"uuid":"65c10882-371e-4762-b384-9c3a48f332ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6817","nonce":2845223299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6819","nonce":2845223299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6823","nonce":2845223299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6821","nonce":2845223299}]},"public_addr":"172.21.15.79:6817/2845223299","cluster_addr":"172.21.15.79:6819/2845223299","heartbeat_back_addr":"172.21.15.79:6823/2845223299","heartbeat_front_addr":"172.21.15.79:6821/2845223299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.634716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.758349+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.728366+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.777395+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707262+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.649705+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.693021+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:02:07.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.665+0000 7f924579a700 1 -- 172.21.15.60:0/1951079175 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f922c06ac50 msgr2=0x7f922c06d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:07.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.665+0000 7f924579a700 1 --2- 172.21.15.60:0/1951079175 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f922c06ac50 0x7f922c06d100 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f92340090b0 tx=0x7f9234008030 comp rx=0 tx=0).stop 2023-07-12T02:02:07.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.665+0000 7f924579a700 1 -- 172.21.15.60:0/1951079175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92400b4890 msgr2=0x7f92401e32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:07.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.665+0000 7f924579a700 1 --2- 172.21.15.60:0/1951079175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92400b4890 0x7f92401e32f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f923000ebe0 tx=0x7f923000eef0 comp rx=0 tx=0).stop 2023-07-12T02:02:07.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.665+0000 7f924579a700 1 -- 172.21.15.60:0/1951079175 shutdown_connections 2023-07-12T02:02:07.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.665+0000 7f924579a700 1 --2- 172.21.15.60:0/1951079175 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f922c06ac50 0x7f922c06d100 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:07.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.665+0000 7f924579a700 1 --2- 172.21.15.60:0/1951079175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92400b4890 0x7f92401e32f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:07.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.665+0000 7f924579a700 1 --2- 172.21.15.60:0/1951079175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f924014e2a0 0x7f9240149a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:07.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.665+0000 7f924579a700 1 --2- 172.21.15.60:0/1951079175 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f92400ba800 0x7f9240148ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:07.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.665+0000 7f924579a700 1 -- 172.21.15.60:0/1951079175 >> 172.21.15.60:0/1951079175 conn(0x7f92400be0e0 msgr2=0x7f92400b7270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:07.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.665+0000 7f924579a700 1 -- 172.21.15.60:0/1951079175 shutdown_connections 2023-07-12T02:02:07.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.665+0000 7f924579a700 1 -- 172.21.15.60:0/1951079175 wait complete. 2023-07-12T02:02:07.680 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-12T02:02:05.375042+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-12T02:02:05.857441+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-12T02:02:07.681 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-12T02:02:07.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.811+0000 7f2589184700 1 Processor -- start 2023-07-12T02:02:07.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.811+0000 7f2589184700 1 -- start start 2023-07-12T02:02:07.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.812+0000 7f2589184700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f25840b9410 0x7f25840b8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:07.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.812+0000 7f2589184700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2584072360 0x7f2584070fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:07.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.812+0000 7f2589184700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2584071510 0x7f25841478b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:07.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.812+0000 7f2589184700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2584071990 con 0x7f2584072360 2023-07-12T02:02:07.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.812+0000 7f2589184700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f258406a7d0 con 0x7f2584071510 2023-07-12T02:02:07.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.812+0000 7f2589184700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f258406f780 con 0x7f25840b9410 2023-07-12T02:02:07.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.812+0000 7f258259c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2584072360 0x7f2584070fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:07.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.812+0000 7f258259c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2584072360 0x7f2584070fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36504/0 (socket says 172.21.15.60:36504) 2023-07-12T02:02:07.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.812+0000 7f258259c700 1 -- 172.21.15.60:0/4095966561 learned_addr learned my addr 172.21.15.60:0/4095966561 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:07.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.812+0000 7f258359e700 1 --2- 172.21.15.60:0/4095966561 >> v2:172.21.15.79:3300/0 conn(0x7f2584071510 0x7f25841478b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:07.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.812+0000 7f2582d9d700 1 --2- 172.21.15.60:0/4095966561 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f25840b9410 0x7f25840b8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:07.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.813+0000 7f258259c700 1 -- 172.21.15.60:0/4095966561 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f25840b9410 msgr2=0x7f25840b8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:07.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.813+0000 7f258259c700 1 --2- 172.21.15.60:0/4095966561 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f25840b9410 0x7f25840b8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:07.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.813+0000 7f258259c700 1 -- 172.21.15.60:0/4095966561 >> v2:172.21.15.79:3300/0 conn(0x7f2584071510 msgr2=0x7f25841478b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:07.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.813+0000 7f258259c700 1 --2- 172.21.15.60:0/4095966561 >> v2:172.21.15.79:3300/0 conn(0x7f2584071510 0x7f25841478b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:07.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.813+0000 7f258259c700 1 -- 172.21.15.60:0/4095966561 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f258406fa20 con 0x7f2584072360 2023-07-12T02:02:07.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.813+0000 7f258259c700 1 --2- 172.21.15.60:0/4095966561 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2584072360 0x7f2584070fd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f25840b9ba0 tx=0x7f256c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2abf753d5456c9c7 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:07.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.813+0000 7f2581d9b700 1 -- 172.21.15.60:0/4095966561 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c011830 con 0x7f2584072360 2023-07-12T02:02:07.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.813+0000 7f2581d9b700 1 -- 172.21.15.60:0/4095966561 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256c011990 con 0x7f2584072360 2023-07-12T02:02:07.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.813+0000 7f2581d9b700 1 -- 172.21.15.60:0/4095966561 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c011d20 con 0x7f2584072360 2023-07-12T02:02:07.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.813+0000 7f2589184700 1 -- 172.21.15.60:0/4095966561 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2584072360 msgr2=0x7f2584070fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:07.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.813+0000 7f2589184700 1 --2- 172.21.15.60:0/4095966561 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2584072360 0x7f2584070fd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f25840b9ba0 tx=0x7f256c009bd0 comp rx=0 tx=0).stop 2023-07-12T02:02:07.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.813+0000 7f2589184700 1 -- 172.21.15.60:0/4095966561 shutdown_connections 2023-07-12T02:02:07.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.813+0000 7f2589184700 1 --2- 172.21.15.60:0/4095966561 >> v2:172.21.15.79:3300/0 conn(0x7f2584071510 0x7f25841478b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:07.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.813+0000 7f2589184700 1 --2- 172.21.15.60:0/4095966561 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f25840b9410 0x7f25840b8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:07.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.813+0000 7f2589184700 1 --2- 172.21.15.60:0/4095966561 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2584072360 0x7f2584070fd0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:07.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.813+0000 7f2589184700 1 -- 172.21.15.60:0/4095966561 >> 172.21.15.60:0/4095966561 conn(0x7f258406d0e0 msgr2=0x7f258406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:07.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.814+0000 7f2589184700 1 -- 172.21.15.60:0/4095966561 shutdown_connections 2023-07-12T02:02:07.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.814+0000 7f2589184700 1 -- 172.21.15.60:0/4095966561 wait complete. 2023-07-12T02:02:07.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.815+0000 7f2589184700 1 Processor -- start 2023-07-12T02:02:07.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.815+0000 7f2589184700 1 -- start start 2023-07-12T02:02:07.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.816+0000 7f2589184700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2584071510 0x7f258414a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:07.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.816+0000 7f2589184700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25840b9410 0x7f25841d18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:07.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.816+0000 7f2589184700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f25841e2ed0 0x7f2584145890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:07.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.816+0000 7f2589184700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258414aa40 con 0x7f2584071510 2023-07-12T02:02:07.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.816+0000 7f2589184700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25840b7440 con 0x7f25840b9410 2023-07-12T02:02:07.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.816+0000 7f2589184700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25841d1110 con 0x7f25841e2ed0 2023-07-12T02:02:07.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.816+0000 7f2582d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2584071510 0x7f258414a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:07.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.816+0000 7f2582d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2584071510 0x7f258414a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36516/0 (socket says 172.21.15.60:36516) 2023-07-12T02:02:07.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.816+0000 7f258259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25840b9410 0x7f25841d18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:07.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.816+0000 7f2582d9d700 1 -- 172.21.15.60:0/4436560 learned_addr learned my addr 172.21.15.60:0/4436560 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:07.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.816+0000 7f258359e700 1 --2- 172.21.15.60:0/4436560 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f25841e2ed0 0x7f2584145890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:07.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.817+0000 7f2582d9d700 1 -- 172.21.15.60:0/4436560 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f25841e2ed0 msgr2=0x7f2584145890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:07.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.817+0000 7f2582d9d700 1 --2- 172.21.15.60:0/4436560 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f25841e2ed0 0x7f2584145890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:07.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.817+0000 7f2582d9d700 1 -- 172.21.15.60:0/4436560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25840b9410 msgr2=0x7f25841d18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:07.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.817+0000 7f2582d9d700 1 --2- 172.21.15.60:0/4436560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25840b9410 0x7f25841d18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:07.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.817+0000 7f2582d9d700 1 -- 172.21.15.60:0/4436560 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f256c009550 con 0x7f2584071510 2023-07-12T02:02:07.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.817+0000 7f258359e700 1 --2- 172.21.15.60:0/4436560 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f25841e2ed0 0x7f2584145890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:02:07.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.817+0000 7f2582d9d700 1 --2- 172.21.15.60:0/4436560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2584071510 0x7f258414a500 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f257c00efc0 tx=0x7f257c00c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:07.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.817+0000 7f257b7fe700 1 -- 172.21.15.60:0/4436560 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257c00cb50 con 0x7f2584071510 2023-07-12T02:02:07.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.817+0000 7f257b7fe700 1 -- 172.21.15.60:0/4436560 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f257c00f040 con 0x7f2584071510 2023-07-12T02:02:07.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.817+0000 7f257b7fe700 1 -- 172.21.15.60:0/4436560 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257c014480 con 0x7f2584071510 2023-07-12T02:02:07.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.817+0000 7f2589184700 1 -- 172.21.15.60:0/4436560 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25841d1e10 con 0x7f2584071510 2023-07-12T02:02:07.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.817+0000 7f2589184700 1 -- 172.21.15.60:0/4436560 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25841d0c10 con 0x7f2584071510 2023-07-12T02:02:07.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.818+0000 7f2589184700 1 -- 172.21.15.60:0/4436560 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2584074360 con 0x7f2584071510 2023-07-12T02:02:07.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.819+0000 7f257b7fe700 1 -- 172.21.15.60:0/4436560 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f257c0145e0 con 0x7f2584071510 2023-07-12T02:02:07.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.819+0000 7f257b7fe700 1 --2- 172.21.15.60:0/4436560 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f256406ac50 0x7f256406d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:07.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.819+0000 7f257b7fe700 1 -- 172.21.15.60:0/4436560 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f257c089820 con 0x7f2584071510 2023-07-12T02:02:07.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.824+0000 7f257b7fe700 1 -- 172.21.15.60:0/4436560 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f257c054d00 con 0x7f2584071510 2023-07-12T02:02:07.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.835+0000 7f258259c700 1 --2- 172.21.15.60:0/4436560 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f256406ac50 0x7f256406d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:07.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:07.836+0000 7f258259c700 1 --2- 172.21.15.60:0/4436560 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f256406ac50 0x7f256406d100 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f256c009c10 tx=0x7f256c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:08.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.023+0000 7f2589184700 1 -- 172.21.15.60:0/4436560 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f25840bdc70 con 0x7f2584071510 2023-07-12T02:02:08.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.023+0000 7f257b7fe700 1 -- 172.21.15.60:0/4436560 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7f257c058320 con 0x7f2584071510 2023-07-12T02:02:08.026 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2023-07-12T02:02:08.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.025+0000 7f2589184700 1 -- 172.21.15.60:0/4436560 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f256406ac50 msgr2=0x7f256406d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:08.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.025+0000 7f2589184700 1 --2- 172.21.15.60:0/4436560 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f256406ac50 0x7f256406d100 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f256c009c10 tx=0x7f256c008030 comp rx=0 tx=0).stop 2023-07-12T02:02:08.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.025+0000 7f2589184700 1 -- 172.21.15.60:0/4436560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2584071510 msgr2=0x7f258414a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:08.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.025+0000 7f2589184700 1 --2- 172.21.15.60:0/4436560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2584071510 0x7f258414a500 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f257c00efc0 tx=0x7f257c00c0c0 comp rx=0 tx=0).stop 2023-07-12T02:02:08.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.025+0000 7f2589184700 1 -- 172.21.15.60:0/4436560 shutdown_connections 2023-07-12T02:02:08.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.025+0000 7f2589184700 1 --2- 172.21.15.60:0/4436560 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f256406ac50 0x7f256406d100 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:08.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.025+0000 7f2589184700 1 --2- 172.21.15.60:0/4436560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2584071510 0x7f258414a500 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:08.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.025+0000 7f2589184700 1 --2- 172.21.15.60:0/4436560 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f25841e2ed0 0x7f2584145890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:08.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.025+0000 7f2589184700 1 --2- 172.21.15.60:0/4436560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25840b9410 0x7f25841d18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:08.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.025+0000 7f2589184700 1 -- 172.21.15.60:0/4436560 >> 172.21.15.60:0/4436560 conn(0x7f258406d0e0 msgr2=0x7f25840ba550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:08.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.025+0000 7f2589184700 1 -- 172.21.15.60:0/4436560 shutdown_connections 2023-07-12T02:02:08.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.025+0000 7f2589184700 1 -- 172.21.15.60:0/4436560 wait complete. 2023-07-12T02:02:08.040 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-12T02:02:08.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.168+0000 7fbb3049d700 1 Processor -- start 2023-07-12T02:02:08.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.168+0000 7fbb3049d700 1 -- start start 2023-07-12T02:02:08.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.169+0000 7fbb3049d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbb280717f0 0x7fbb280b7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:08.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.169+0000 7fbb3049d700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb28071bc0 0x7fbb280ba3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:08.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.169+0000 7fbb3049d700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb280ba010 con 0x7fbb280b8e60 2023-07-12T02:02:08.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.169+0000 7fbb3049d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb280b85a0 con 0x7fbb280717f0 2023-07-12T02:02:08.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.169+0000 7fbb3049d700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb280b7470 con 0x7fbb28071bc0 2023-07-12T02:02:08.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.169+0000 7fbb2ea3a700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fbb280b8e60 0x7fbb28142410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.60:36984/0 (socket says 172.21.15.60:36984) 2023-07-12T02:02:08.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.169+0000 7fbb2e239700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbb280717f0 0x7fbb280b7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:08.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.169+0000 7fbb2ea3a700 1 -- 172.21.15.60:0/2783959971 learned_addr learned my addr 172.21.15.60:0/2783959971 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:08.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.169+0000 7fbb2da38700 1 --2- 172.21.15.60:0/2783959971 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb28071bc0 0x7fbb280ba3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:08.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.169+0000 7fbb2d237700 1 -- 172.21.15.60:0/2783959971 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 576666985 0 0) 0x7fbb280ba010 con 0x7fbb280b8e60 2023-07-12T02:02:08.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.169+0000 7fbb2d237700 1 -- 172.21.15.60:0/2783959971 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb140035b0 con 0x7fbb280b8e60 2023-07-12T02:02:08.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.170+0000 7fbb2da38700 1 -- 172.21.15.60:0/2783959971 >> v2:172.21.15.60:3300/0 conn(0x7fbb280717f0 msgr2=0x7fbb280b7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:08.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.170+0000 7fbb2da38700 1 --2- 172.21.15.60:0/2783959971 >> v2:172.21.15.60:3300/0 conn(0x7fbb280717f0 0x7fbb280b7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:08.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.170+0000 7fbb2da38700 1 -- 172.21.15.60:0/2783959971 >> v1:172.21.15.79:6789/0 conn(0x7fbb280b8e60 legacy=0x7fbb28142410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:08.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.170+0000 7fbb2da38700 1 -- 172.21.15.60:0/2783959971 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb280b7750 con 0x7fbb28071bc0 2023-07-12T02:02:08.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.170+0000 7fbb2da38700 1 --2- 172.21.15.60:0/2783959971 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb28071bc0 0x7fbb280ba3e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbb18009870 tx=0x7fbb18009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=343299e37b609f1a server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:08.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.170+0000 7fbb2d237700 1 -- 172.21.15.60:0/2783959971 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb18011830 con 0x7fbb28071bc0 2023-07-12T02:02:08.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.170+0000 7fbb2d237700 1 -- 172.21.15.60:0/2783959971 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb18011990 con 0x7fbb28071bc0 2023-07-12T02:02:08.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.170+0000 7fbb2d237700 1 -- 172.21.15.60:0/2783959971 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb18011d20 con 0x7fbb28071bc0 2023-07-12T02:02:08.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.170+0000 7fbb3049d700 1 -- 172.21.15.60:0/2783959971 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb28071bc0 msgr2=0x7fbb280ba3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:08.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.170+0000 7fbb3049d700 1 --2- 172.21.15.60:0/2783959971 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb28071bc0 0x7fbb280ba3e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbb18009870 tx=0x7fbb18009b80 comp rx=0 tx=0).stop 2023-07-12T02:02:08.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.171+0000 7fbb3049d700 1 -- 172.21.15.60:0/2783959971 shutdown_connections 2023-07-12T02:02:08.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.171+0000 7fbb3049d700 1 --2- 172.21.15.60:0/2783959971 >> v2:172.21.15.60:3300/0 conn(0x7fbb280717f0 0x7fbb280b7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:08.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.171+0000 7fbb3049d700 1 --2- 172.21.15.60:0/2783959971 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb28071bc0 0x7fbb280ba3e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:08.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.171+0000 7fbb3049d700 1 -- 172.21.15.60:0/2783959971 >> 172.21.15.60:0/2783959971 conn(0x7fbb2806d0e0 msgr2=0x7fbb2806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:08.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.171+0000 7fbb3049d700 1 -- 172.21.15.60:0/2783959971 shutdown_connections 2023-07-12T02:02:08.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.171+0000 7fbb3049d700 1 -- 172.21.15.60:0/2783959971 wait complete. 2023-07-12T02:02:08.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.172+0000 7fbb3049d700 1 Processor -- start 2023-07-12T02:02:08.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.172+0000 7fbb3049d700 1 -- start start 2023-07-12T02:02:08.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.172+0000 7fbb3049d700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb280717f0 0x7fbb2813d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:08.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.172+0000 7fbb3049d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb28071bc0 0x7fbb281d1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:08.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.172+0000 7fbb3049d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb280b8e60 0x7fbb2806ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:08.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.172+0000 7fbb3049d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb281d2060 con 0x7fbb280b8e60 2023-07-12T02:02:08.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.172+0000 7fbb3049d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2813ca00 con 0x7fbb28071bc0 2023-07-12T02:02:08.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.172+0000 7fbb3049d700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb28070500 con 0x7fbb280717f0 2023-07-12T02:02:08.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.172+0000 7fbb2ea3a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb280b8e60 0x7fbb2806ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:08.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.172+0000 7fbb2ea3a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb280b8e60 0x7fbb2806ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36530/0 (socket says 172.21.15.60:36530) 2023-07-12T02:02:08.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.173+0000 7fbb2ea3a700 1 -- 172.21.15.60:0/4126906864 learned_addr learned my addr 172.21.15.60:0/4126906864 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:08.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.173+0000 7fbb2e239700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb280717f0 0x7fbb2813d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:08.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.173+0000 7fbb2da38700 1 --2- 172.21.15.60:0/4126906864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb28071bc0 0x7fbb281d1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:08.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.173+0000 7fbb2da38700 1 -- 172.21.15.60:0/4126906864 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb280717f0 msgr2=0x7fbb2813d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:08.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.173+0000 7fbb2da38700 1 --2- 172.21.15.60:0/4126906864 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb280717f0 0x7fbb2813d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:08.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.173+0000 7fbb2da38700 1 -- 172.21.15.60:0/4126906864 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb280b8e60 msgr2=0x7fbb2806ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:08.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.173+0000 7fbb2da38700 1 --2- 172.21.15.60:0/4126906864 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb280b8e60 0x7fbb2806ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:08.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.173+0000 7fbb2da38700 1 -- 172.21.15.60:0/4126906864 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb180094a0 con 0x7fbb28071bc0 2023-07-12T02:02:08.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.173+0000 7fbb2da38700 1 --2- 172.21.15.60:0/4126906864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb28071bc0 0x7fbb281d1b20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbb18016000 tx=0x7fbb18004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:08.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.173+0000 7fbb1effd700 1 -- 172.21.15.60:0/4126906864 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb18004590 con 0x7fbb28071bc0 2023-07-12T02:02:08.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.173+0000 7fbb1effd700 1 -- 172.21.15.60:0/4126906864 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1801f070 con 0x7fbb28071bc0 2023-07-12T02:02:08.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.173+0000 7fbb3049d700 1 -- 172.21.15.60:0/4126906864 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb2813cc50 con 0x7fbb28071bc0 2023-07-12T02:02:08.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.173+0000 7fbb1effd700 1 -- 172.21.15.60:0/4126906864 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb180038c0 con 0x7fbb28071bc0 2023-07-12T02:02:08.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.173+0000 7fbb3049d700 1 -- 172.21.15.60:0/4126906864 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb2813d210 con 0x7fbb28071bc0 2023-07-12T02:02:08.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.175+0000 7fbb1effd700 1 -- 172.21.15.60:0/4126906864 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7fbb18003a20 con 0x7fbb28071bc0 2023-07-12T02:02:08.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.175+0000 7fbb3049d700 1 -- 172.21.15.60:0/4126906864 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb28074360 con 0x7fbb28071bc0 2023-07-12T02:02:08.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.175+0000 7fbb1effd700 1 --2- 172.21.15.60:0/4126906864 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fbb0c06ac50 0x7fbb0c06d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:08.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.175+0000 7fbb1effd700 1 -- 172.21.15.60:0/4126906864 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fbb18021070 con 0x7fbb28071bc0 2023-07-12T02:02:08.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.175+0000 7fbb2e239700 1 --2- 172.21.15.60:0/4126906864 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fbb0c06ac50 0x7fbb0c06d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:08.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.176+0000 7fbb2e239700 1 --2- 172.21.15.60:0/4126906864 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fbb0c06ac50 0x7fbb0c06d100 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbb24009be0 tx=0x7fbb24009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:08.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.180+0000 7fbb1effd700 1 -- 172.21.15.60:0/4126906864 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fbb18055cd0 con 0x7fbb28071bc0 2023-07-12T02:02:08.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.392+0000 7fbb3049d700 1 -- 172.21.15.60:0/4126906864 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbb2813c7e0 con 0x7fbb28071bc0 2023-07-12T02:02:08.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.393+0000 7fbb1effd700 1 -- 172.21.15.60:0/4126906864 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbb18015020 con 0x7fbb28071bc0 2023-07-12T02:02:08.396 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-07-12T02:02:08.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.395+0000 7fbb3049d700 1 -- 172.21.15.60:0/4126906864 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fbb0c06ac50 msgr2=0x7fbb0c06d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:08.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.395+0000 7fbb3049d700 1 --2- 172.21.15.60:0/4126906864 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fbb0c06ac50 0x7fbb0c06d100 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbb24009be0 tx=0x7fbb24009210 comp rx=0 tx=0).stop 2023-07-12T02:02:08.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.395+0000 7fbb3049d700 1 -- 172.21.15.60:0/4126906864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb28071bc0 msgr2=0x7fbb281d1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:08.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.395+0000 7fbb3049d700 1 --2- 172.21.15.60:0/4126906864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb28071bc0 0x7fbb281d1b20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbb18016000 tx=0x7fbb18004750 comp rx=0 tx=0).stop 2023-07-12T02:02:08.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.395+0000 7fbb3049d700 1 -- 172.21.15.60:0/4126906864 shutdown_connections 2023-07-12T02:02:08.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.395+0000 7fbb3049d700 1 --2- 172.21.15.60:0/4126906864 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fbb0c06ac50 0x7fbb0c06d100 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:08.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.395+0000 7fbb3049d700 1 --2- 172.21.15.60:0/4126906864 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb280b8e60 0x7fbb2806ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:08.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.395+0000 7fbb3049d700 1 --2- 172.21.15.60:0/4126906864 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbb280717f0 0x7fbb2813d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:08.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.395+0000 7fbb3049d700 1 --2- 172.21.15.60:0/4126906864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb28071bc0 0x7fbb281d1b20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:08.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.395+0000 7fbb3049d700 1 -- 172.21.15.60:0/4126906864 >> 172.21.15.60:0/4126906864 conn(0x7fbb2806d0e0 msgr2=0x7fbb280bbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:08.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.396+0000 7fbb3049d700 1 -- 172.21.15.60:0/4126906864 shutdown_connections 2023-07-12T02:02:08.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.396+0000 7fbb3049d700 1 -- 172.21.15.60:0/4126906864 wait complete. 2023-07-12T02:02:08.412 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-12T02:02:08.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.536+0000 7fa247281700 1 Processor -- start 2023-07-12T02:02:08.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.536+0000 7fa247281700 1 -- start start 2023-07-12T02:02:08.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.537+0000 7fa247281700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa24006bda0 0x7fa24014e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:08.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.537+0000 7fa247281700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa24014e1d0 con 0x7fa240071980 2023-07-12T02:02:08.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.537+0000 7fa247281700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2400725f0 con 0x7fa24006cce0 2023-07-12T02:02:08.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.537+0000 7fa247281700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa24006c280 con 0x7fa24006bda0 2023-07-12T02:02:08.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.537+0000 7fa24501d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa240071980 0x7fa240144aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52428/0 (socket says 172.21.15.60:52428) 2023-07-12T02:02:08.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.537+0000 7fa24501d700 1 -- 172.21.15.60:0/616839966 learned_addr learned my addr 172.21.15.60:0/616839966 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:08.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.537+0000 7fa24481c700 1 --2- 172.21.15.60:0/616839966 >> v2:172.21.15.79:3300/0 conn(0x7fa24006bda0 0x7fa24014e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:08.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.537+0000 7fa237fff700 1 -- 172.21.15.60:0/616839966 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2124347838 0 0) 0x7fa24014e1d0 con 0x7fa240071980 2023-07-12T02:02:08.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.538+0000 7fa237fff700 1 -- 172.21.15.60:0/616839966 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa22c0035b0 con 0x7fa240071980 2023-07-12T02:02:08.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.538+0000 7fa237fff700 1 -- 172.21.15.60:0/616839966 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1976712126 0 0) 0x7fa2400725f0 con 0x7fa24006cce0 2023-07-12T02:02:08.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.538+0000 7fa237fff700 1 -- 172.21.15.60:0/616839966 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa24014e1d0 con 0x7fa24006cce0 2023-07-12T02:02:08.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.538+0000 7fa24481c700 1 -- 172.21.15.60:0/616839966 >> v1:172.21.15.79:6789/0 conn(0x7fa24006cce0 legacy=0x7fa2401553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:08.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.538+0000 7fa24481c700 1 -- 172.21.15.60:0/616839966 >> v1:172.21.15.60:6789/0 conn(0x7fa240071980 legacy=0x7fa240144aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:08.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.538+0000 7fa24481c700 1 -- 172.21.15.60:0/616839966 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa24006c560 con 0x7fa24006bda0 2023-07-12T02:02:08.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.538+0000 7fa24481c700 1 --2- 172.21.15.60:0/616839966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa24006bda0 0x7fa24014e660 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa23c009840 tx=0x7fa23c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7132ce73b883a66 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:08.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.538+0000 7fa237fff700 1 -- 172.21.15.60:0/616839966 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c011830 con 0x7fa24006bda0 2023-07-12T02:02:08.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.538+0000 7fa237fff700 1 -- 172.21.15.60:0/616839966 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23c011990 con 0x7fa24006bda0 2023-07-12T02:02:08.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.538+0000 7fa237fff700 1 -- 172.21.15.60:0/616839966 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c011d20 con 0x7fa24006bda0 2023-07-12T02:02:08.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.539+0000 7fa247281700 1 -- 172.21.15.60:0/616839966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa24006bda0 msgr2=0x7fa24014e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:08.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.539+0000 7fa247281700 1 --2- 172.21.15.60:0/616839966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa24006bda0 0x7fa24014e660 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa23c009840 tx=0x7fa23c009b50 comp rx=0 tx=0).stop 2023-07-12T02:02:08.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.539+0000 7fa247281700 1 -- 172.21.15.60:0/616839966 shutdown_connections 2023-07-12T02:02:08.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.539+0000 7fa247281700 1 --2- 172.21.15.60:0/616839966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa24006bda0 0x7fa24014e660 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:08.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.539+0000 7fa247281700 1 -- 172.21.15.60:0/616839966 >> 172.21.15.60:0/616839966 conn(0x7fa2400be670 msgr2=0x7fa2400bea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:08.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.539+0000 7fa247281700 1 -- 172.21.15.60:0/616839966 shutdown_connections 2023-07-12T02:02:08.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.539+0000 7fa247281700 1 -- 172.21.15.60:0/616839966 wait complete. 2023-07-12T02:02:08.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.540+0000 7fa247281700 1 Processor -- start 2023-07-12T02:02:08.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.540+0000 7fa247281700 1 -- start start 2023-07-12T02:02:08.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.540+0000 7fa247281700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa24006bda0 0x7fa2400b76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:08.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.540+0000 7fa247281700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa24006cce0 0x7fa2400b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:08.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.540+0000 7fa247281700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa240071980 0x7fa2401e0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:08.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.540+0000 7fa247281700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2400b7c20 con 0x7fa240071980 2023-07-12T02:02:08.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.540+0000 7fa247281700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2401dfaf0 con 0x7fa24006bda0 2023-07-12T02:02:08.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.540+0000 7fa247281700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2400b61c0 con 0x7fa24006cce0 2023-07-12T02:02:08.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.541+0000 7fa24581e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa240071980 0x7fa2401e0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:08.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.541+0000 7fa24501d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa24006bda0 0x7fa2400b76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:08.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.541+0000 7fa24581e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa240071980 0x7fa2401e0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36540/0 (socket says 172.21.15.60:36540) 2023-07-12T02:02:08.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.541+0000 7fa24581e700 1 -- 172.21.15.60:0/3738753357 learned_addr learned my addr 172.21.15.60:0/3738753357 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:08.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.541+0000 7fa24481c700 1 --2- 172.21.15.60:0/3738753357 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa24006cce0 0x7fa2400b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:08.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.541+0000 7fa24581e700 1 -- 172.21.15.60:0/3738753357 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa24006cce0 msgr2=0x7fa2400b40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:08.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.541+0000 7fa24581e700 1 --2- 172.21.15.60:0/3738753357 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa24006cce0 0x7fa2400b40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:08.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.541+0000 7fa24581e700 1 -- 172.21.15.60:0/3738753357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa24006bda0 msgr2=0x7fa2400b76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:08.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.541+0000 7fa24581e700 1 --2- 172.21.15.60:0/3738753357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa24006bda0 0x7fa2400b76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:08.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.541+0000 7fa24581e700 1 -- 172.21.15.60:0/3738753357 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23c0094a0 con 0x7fa240071980 2023-07-12T02:02:08.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.541+0000 7fa24581e700 1 --2- 172.21.15.60:0/3738753357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa240071980 0x7fa2401e0180 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa23800cc20 tx=0x7fa23800cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:08.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.541+0000 7fa235ffb700 1 -- 172.21.15.60:0/3738753357 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa238003c00 con 0x7fa240071980 2023-07-12T02:02:08.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.541+0000 7fa235ffb700 1 -- 172.21.15.60:0/3738753357 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa238003d60 con 0x7fa240071980 2023-07-12T02:02:08.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.541+0000 7fa247281700 1 -- 172.21.15.60:0/3738753357 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2400b5920 con 0x7fa240071980 2023-07-12T02:02:08.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.541+0000 7fa235ffb700 1 -- 172.21.15.60:0/3738753357 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23800aa80 con 0x7fa240071980 2023-07-12T02:02:08.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.541+0000 7fa247281700 1 -- 172.21.15.60:0/3738753357 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2400b5ee0 con 0x7fa240071980 2023-07-12T02:02:08.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.542+0000 7fa247281700 1 -- 172.21.15.60:0/3738753357 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2400b3dd0 con 0x7fa240071980 2023-07-12T02:02:08.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.543+0000 7fa235ffb700 1 -- 172.21.15.60:0/3738753357 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa23800abe0 con 0x7fa240071980 2023-07-12T02:02:08.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.543+0000 7fa235ffb700 1 --2- 172.21.15.60:0/3738753357 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fa22406ace0 0x7fa22406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:08.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.543+0000 7fa235ffb700 1 -- 172.21.15.60:0/3738753357 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa2380890c0 con 0x7fa240071980 2023-07-12T02:02:08.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.543+0000 7fa24501d700 1 --2- 172.21.15.60:0/3738753357 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fa22406ace0 0x7fa22406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:08.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.544+0000 7fa24501d700 1 --2- 172.21.15.60:0/3738753357 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fa22406ace0 0x7fa22406d190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa230007fd0 tx=0x7fa230007de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:08.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.548+0000 7fa235ffb700 1 -- 172.21.15.60:0/3738753357 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fa2400b3dd0 con 0x7fa240071980 2023-07-12T02:02:08.794 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.791+0000 7fa247281700 1 -- 172.21.15.60:0/3738753357 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2400b3dd0 con 0x7fa240071980 2023-07-12T02:02:08.794 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.791+0000 7fa235ffb700 1 -- 172.21.15.60:0/3738753357 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2765 (secure 0 0 0) 0x7fa2400b3dd0 con 0x7fa240071980 2023-07-12T02:02:08.795 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:02:08.795 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2687011977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2687011977},{"type":"v1","addr":"172.21.15.60:6835","nonce":2687011977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/1153134400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1153134400},{"type":"v1","addr":"172.21.15.79:6835","nonce":1153134400}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/825430907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":825430907},{"type":"v1","addr":"172.21.15.60:6833","nonce":825430907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-07-12T02:02:08.796 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.793+0000 7fa247281700 1 -- 172.21.15.60:0/3738753357 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fa22406ace0 msgr2=0x7fa22406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:08.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.793+0000 7fa247281700 1 --2- 172.21.15.60:0/3738753357 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fa22406ace0 0x7fa22406d190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa230007fd0 tx=0x7fa230007de0 comp rx=0 tx=0).stop 2023-07-12T02:02:08.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.793+0000 7fa247281700 1 -- 172.21.15.60:0/3738753357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa240071980 msgr2=0x7fa2401e0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:08.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.793+0000 7fa247281700 1 --2- 172.21.15.60:0/3738753357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa240071980 0x7fa2401e0180 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa23800cc20 tx=0x7fa23800cf30 comp rx=0 tx=0).stop 2023-07-12T02:02:08.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.793+0000 7fa247281700 1 -- 172.21.15.60:0/3738753357 shutdown_connections 2023-07-12T02:02:08.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.793+0000 7fa247281700 1 --2- 172.21.15.60:0/3738753357 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fa22406ace0 0x7fa22406d190 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:08.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.793+0000 7fa247281700 1 --2- 172.21.15.60:0/3738753357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa240071980 0x7fa2401e0180 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:08.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.793+0000 7fa247281700 1 --2- 172.21.15.60:0/3738753357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa24006bda0 0x7fa2400b76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:08.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.793+0000 7fa247281700 1 --2- 172.21.15.60:0/3738753357 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa24006cce0 0x7fa2400b40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:08.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.793+0000 7fa247281700 1 -- 172.21.15.60:0/3738753357 >> 172.21.15.60:0/3738753357 conn(0x7fa2400be670 msgr2=0x7fa2400b8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:08.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.793+0000 7fa247281700 1 -- 172.21.15.60:0/3738753357 shutdown_connections 2023-07-12T02:02:08.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.793+0000 7fa247281700 1 -- 172.21.15.60:0/3738753357 wait complete. 2023-07-12T02:02:08.799 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 3 2023-07-12T02:02:08.809 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:02:08.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.931+0000 7f107e3ce700 1 Processor -- start 2023-07-12T02:02:08.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.931+0000 7f107e3ce700 1 -- start start 2023-07-12T02:02:08.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.932+0000 7f107e3ce700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f10780b9e80 0x7f10780b8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:08.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.932+0000 7f107e3ce700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10780b9430 con 0x7f1078071a90 2023-07-12T02:02:08.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.932+0000 7f107e3ce700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10780b6f20 con 0x7f107806b120 2023-07-12T02:02:08.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.932+0000 7f107e3ce700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10780b7200 con 0x7f10780b9e80 2023-07-12T02:02:08.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.932+0000 7f10777fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f10780b9e80 0x7f10780b8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:08.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.932+0000 7f107c96b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f1078071a90 0x7f1078151d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52436/0 (socket says 172.21.15.60:52436) 2023-07-12T02:02:08.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.932+0000 7f107c96b700 1 -- 172.21.15.60:0/875398918 learned_addr learned my addr 172.21.15.60:0/875398918 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:08.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.933+0000 7f10777fe700 1 -- 172.21.15.60:0/875398918 >> v1:172.21.15.79:6789/0 conn(0x7f107806b120 legacy=0x7f10780b6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:08.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.933+0000 7f10777fe700 1 -- 172.21.15.60:0/875398918 >> v1:172.21.15.60:6789/0 conn(0x7f1078071a90 legacy=0x7f1078151d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:08.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.933+0000 7f10777fe700 1 -- 172.21.15.60:0/875398918 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10780b3d70 con 0x7f10780b9e80 2023-07-12T02:02:08.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.933+0000 7f10777fe700 1 --2- 172.21.15.60:0/875398918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10780b9e80 0x7f10780b8930 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f106c009840 tx=0x7f106c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf4b86b451f1e89 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:08.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.933+0000 7f1076ffd700 1 -- 172.21.15.60:0/875398918 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106c00f8a0 con 0x7f10780b9e80 2023-07-12T02:02:08.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.933+0000 7f1076ffd700 1 -- 172.21.15.60:0/875398918 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106c00fa00 con 0x7f10780b9e80 2023-07-12T02:02:08.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.933+0000 7f1076ffd700 1 -- 172.21.15.60:0/875398918 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106c00fd90 con 0x7f10780b9e80 2023-07-12T02:02:08.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.934+0000 7f107e3ce700 1 -- 172.21.15.60:0/875398918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10780b9e80 msgr2=0x7f10780b8930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:08.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.934+0000 7f107e3ce700 1 --2- 172.21.15.60:0/875398918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10780b9e80 0x7f10780b8930 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f106c009840 tx=0x7f106c009b50 comp rx=0 tx=0).stop 2023-07-12T02:02:08.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.934+0000 7f107e3ce700 1 -- 172.21.15.60:0/875398918 shutdown_connections 2023-07-12T02:02:08.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.934+0000 7f107e3ce700 1 --2- 172.21.15.60:0/875398918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10780b9e80 0x7f10780b8930 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:08.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.934+0000 7f107e3ce700 1 -- 172.21.15.60:0/875398918 >> 172.21.15.60:0/875398918 conn(0x7f10780bd980 msgr2=0x7f10780b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:08.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.934+0000 7f107e3ce700 1 -- 172.21.15.60:0/875398918 shutdown_connections 2023-07-12T02:02:08.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.934+0000 7f107e3ce700 1 -- 172.21.15.60:0/875398918 wait complete. 2023-07-12T02:02:08.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.935+0000 7f107e3ce700 1 Processor -- start 2023-07-12T02:02:08.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.935+0000 7f107e3ce700 1 -- start start 2023-07-12T02:02:08.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.935+0000 7f107e3ce700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f107806b120 0x7f10781d3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:08.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.935+0000 7f107e3ce700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1078071a90 0x7f10781d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:08.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.935+0000 7f107e3ce700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f10780b9e80 0x7f10781d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:08.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.935+0000 7f107e3ce700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1078145530 con 0x7f1078071a90 2023-07-12T02:02:08.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.935+0000 7f107e3ce700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10781d35c0 con 0x7f107806b120 2023-07-12T02:02:08.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.935+0000 7f107e3ce700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1078145710 con 0x7f10780b9e80 2023-07-12T02:02:08.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.936+0000 7f10777fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1078071a90 0x7f10781d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:08.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.936+0000 7f10777fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1078071a90 0x7f10781d0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36564/0 (socket says 172.21.15.60:36564) 2023-07-12T02:02:08.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.936+0000 7f10777fe700 1 -- 172.21.15.60:0/467630695 learned_addr learned my addr 172.21.15.60:0/467630695 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:08.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.936+0000 7f1077fff700 1 --2- 172.21.15.60:0/467630695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f107806b120 0x7f10781d3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:08.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.936+0000 7f107c96b700 1 --2- 172.21.15.60:0/467630695 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f10780b9e80 0x7f10781d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:08.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.936+0000 7f10777fe700 1 -- 172.21.15.60:0/467630695 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f10780b9e80 msgr2=0x7f10781d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:08.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.936+0000 7f10777fe700 1 --2- 172.21.15.60:0/467630695 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f10780b9e80 0x7f10781d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:08.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.936+0000 7f10777fe700 1 -- 172.21.15.60:0/467630695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f107806b120 msgr2=0x7f10781d3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:08.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.936+0000 7f10777fe700 1 --2- 172.21.15.60:0/467630695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f107806b120 0x7f10781d3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:08.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.936+0000 7f10777fe700 1 -- 172.21.15.60:0/467630695 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106c0094a0 con 0x7f1078071a90 2023-07-12T02:02:08.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.936+0000 7f1077fff700 1 --2- 172.21.15.60:0/467630695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f107806b120 0x7f10781d3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:08.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.936+0000 7f10777fe700 1 --2- 172.21.15.60:0/467630695 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1078071a90 0x7f10781d0f90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f106c000c00 tx=0x7f106c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:08.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.936+0000 7f1074ff9700 1 -- 172.21.15.60:0/467630695 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106c003ab0 con 0x7f1078071a90 2023-07-12T02:02:08.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.936+0000 7f1074ff9700 1 -- 172.21.15.60:0/467630695 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106c003c30 con 0x7f1078071a90 2023-07-12T02:02:08.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.936+0000 7f107e3ce700 1 -- 172.21.15.60:0/467630695 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10781463a0 con 0x7f1078071a90 2023-07-12T02:02:08.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.936+0000 7f1074ff9700 1 -- 172.21.15.60:0/467630695 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106c0045d0 con 0x7f1078071a90 2023-07-12T02:02:08.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.936+0000 7f107e3ce700 1 -- 172.21.15.60:0/467630695 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10781d09b0 con 0x7f1078071a90 2023-07-12T02:02:08.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.937+0000 7f107e3ce700 1 -- 172.21.15.60:0/467630695 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10780bc4a0 con 0x7f1078071a90 2023-07-12T02:02:08.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.938+0000 7f1074ff9700 1 -- 172.21.15.60:0/467630695 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f106c02c430 con 0x7f1078071a90 2023-07-12T02:02:08.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.938+0000 7f1074ff9700 1 --2- 172.21.15.60:0/467630695 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f106406ad10 0x7f106406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:08.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.938+0000 7f1074ff9700 1 -- 172.21.15.60:0/467630695 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f106c08a7b0 con 0x7f1078071a90 2023-07-12T02:02:08.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.938+0000 7f1077fff700 1 --2- 172.21.15.60:0/467630695 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f106406ad10 0x7f106406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:08.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.939+0000 7f1077fff700 1 --2- 172.21.15.60:0/467630695 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f106406ad10 0x7f106406d1c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1068000f60 tx=0x7f1068009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:08.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:08.943+0000 7f1074ff9700 1 -- 172.21.15.60:0/467630695 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f10780bc4a0 con 0x7f1078071a90 2023-07-12T02:02:09.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.138+0000 7f107e3ce700 1 -- 172.21.15.60:0/467630695 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10780bc4a0 con 0x7f1078071a90 2023-07-12T02:02:09.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.139+0000 7f1074ff9700 1 -- 172.21.15.60:0/467630695 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+14531 (secure 0 0 0) 0x7f10780bc4a0 con 0x7f1078071a90 2023-07-12T02:02:09.142 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:02:09.143 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":17,"fsid":"97e7c909-e567-472e-a5aa-72fde15171f2","created":"2023-07-12T02:01:53.987086+0000","modified":"2023-07-12T02:02:08.262583+0000","last_up_change":"2023-07-12T02:02:04.031780+0000","last_in_change":"2023-07-12T02:01:56.538621+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-12T02:02:05.375042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-12T02:02:05.857441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ed8b71c2-3895-4952-a118-16ede0b4a98c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6801","nonce":2818935979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6803","nonce":2818935979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6807","nonce":2818935979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6805","nonce":2818935979}]},"public_addr":"172.21.15.60:6801/2818935979","cluster_addr":"172.21.15.60:6803/2818935979","heartbeat_back_addr":"172.21.15.60:6807/2818935979","heartbeat_front_addr":"172.21.15.60:6805/2818935979","state":["exists","up"]},{"osd":1,"uuid":"7cf4d354-78e0-43ce-8c09-4a7d2a0b57a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6817","nonce":1678864191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6819","nonce":1678864191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6823","nonce":1678864191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6821","nonce":1678864191}]},"public_addr":"172.21.15.60:6817/1678864191","cluster_addr":"172.21.15.60:6819/1678864191","heartbeat_back_addr":"172.21.15.60:6823/1678864191","heartbeat_front_addr":"172.21.15.60:6821/1678864191","state":["exists","up"]},{"osd":2,"uuid":"02c958b8-9599-4470-92cb-8f7018ec0189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6809","nonce":1459480680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6811","nonce":1459480680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6815","nonce":1459480680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6813","nonce":1459480680}]},"public_addr":"172.21.15.60:6809/1459480680","cluster_addr":"172.21.15.60:6811/1459480680","heartbeat_back_addr":"172.21.15.60:6815/1459480680","heartbeat_front_addr":"172.21.15.60:6813/1459480680","state":["exists","up"]},{"osd":3,"uuid":"bc300432-a228-4257-be5c-e42dd5f2015f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6825","nonce":3295100060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6827","nonce":3295100060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6831","nonce":3295100060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6829","nonce":3295100060}]},"public_addr":"172.21.15.60:6825/3295100060","cluster_addr":"172.21.15.60:6827/3295100060","heartbeat_back_addr":"172.21.15.60:6831/3295100060","heartbeat_front_addr":"172.21.15.60:6829/3295100060","state":["exists","up"]},{"osd":4,"uuid":"ad9f7dc4-7126-466d-a656-2844880c6060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6809","nonce":4127109138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6811","nonce":4127109138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6815","nonce":4127109138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6813","nonce":4127109138}]},"public_addr":"172.21.15.79:6809/4127109138","cluster_addr":"172.21.15.79:6811/4127109138","heartbeat_back_addr":"172.21.15.79:6815/4127109138","heartbeat_front_addr":"172.21.15.79:6813/4127109138","state":["exists","up"]},{"osd":5,"uuid":"e88d16ca-0b01-4ab9-8aa8-c4aff7f210f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6801","nonce":421449406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6803","nonce":421449406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6807","nonce":421449406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6805","nonce":421449406}]},"public_addr":"172.21.15.79:6801/421449406","cluster_addr":"172.21.15.79:6803/421449406","heartbeat_back_addr":"172.21.15.79:6807/421449406","heartbeat_front_addr":"172.21.15.79:6805/421449406","state":["exists","up"]},{"osd":6,"uuid":"6898cb84-56d1-48a9-bd45-97e4668e2fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6825","nonce":4144355139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6827","nonce":4144355139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6831","nonce":4144355139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6829","nonce":4144355139}]},"public_addr":"172.21.15.79:6825/4144355139","cluster_addr":"172.21.15.79:6827/4144355139","heartbeat_back_addr":"172.21.15.79:6831/4144355139","heartbeat_front_addr":"172.21.15.79:6829/4144355139","state":["exists","up"]},{"osd":7,"uuid":"65c10882-371e-4762-b384-9c3a48f332ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6817","nonce":2845223299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6819","nonce":2845223299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6823","nonce":2845223299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6821","nonce":2845223299}]},"public_addr":"172.21.15.79:6817/2845223299","cluster_addr":"172.21.15.79:6819/2845223299","heartbeat_back_addr":"172.21.15.79:6823/2845223299","heartbeat_front_addr":"172.21.15.79:6821/2845223299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.634716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.758349+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.728366+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.777395+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707262+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.649705+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.693021+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:02:09.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.141+0000 7f107e3ce700 1 -- 172.21.15.60:0/467630695 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f106406ad10 msgr2=0x7f106406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:09.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.141+0000 7f107e3ce700 1 --2- 172.21.15.60:0/467630695 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f106406ad10 0x7f106406d1c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1068000f60 tx=0x7f1068009040 comp rx=0 tx=0).stop 2023-07-12T02:02:09.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.141+0000 7f107e3ce700 1 -- 172.21.15.60:0/467630695 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1078071a90 msgr2=0x7f10781d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:09.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.141+0000 7f107e3ce700 1 --2- 172.21.15.60:0/467630695 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1078071a90 0x7f10781d0f90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f106c000c00 tx=0x7f106c004750 comp rx=0 tx=0).stop 2023-07-12T02:02:09.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.141+0000 7f107e3ce700 1 -- 172.21.15.60:0/467630695 shutdown_connections 2023-07-12T02:02:09.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.141+0000 7f107e3ce700 1 --2- 172.21.15.60:0/467630695 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f106406ad10 0x7f106406d1c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:09.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.141+0000 7f107e3ce700 1 --2- 172.21.15.60:0/467630695 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f10780b9e80 0x7f10781d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:09.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.141+0000 7f107e3ce700 1 --2- 172.21.15.60:0/467630695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f107806b120 0x7f10781d3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:09.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.141+0000 7f107e3ce700 1 --2- 172.21.15.60:0/467630695 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1078071a90 0x7f10781d0f90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:09.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.141+0000 7f107e3ce700 1 -- 172.21.15.60:0/467630695 >> 172.21.15.60:0/467630695 conn(0x7f10780bd980 msgr2=0x7f10780b3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:09.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.141+0000 7f107e3ce700 1 -- 172.21.15.60:0/467630695 shutdown_connections 2023-07-12T02:02:09.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.141+0000 7f107e3ce700 1 -- 172.21.15.60:0/467630695 wait complete. 2023-07-12T02:02:09.156 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-12T02:02:05.375042+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-12T02:02:05.857441+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-12T02:02:09.157 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-12T02:02:09.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.282+0000 7f784f4fd700 1 Processor -- start 2023-07-12T02:02:09.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.283+0000 7f784f4fd700 1 -- start start 2023-07-12T02:02:09.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.283+0000 7f784f4fd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f78481449d0 0x7f784814db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:09.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.283+0000 7f784f4fd700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f78480bc810 0x7f78480ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:09.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.283+0000 7f784f4fd700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78480b8620 con 0x7f78480b8d90 2023-07-12T02:02:09.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.283+0000 7f784f4fd700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78480b97a0 con 0x7f78481449d0 2023-07-12T02:02:09.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.283+0000 7f784f4fd700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7848144da0 con 0x7f78480bc810 2023-07-12T02:02:09.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.283+0000 7f784d299700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f78481449d0 0x7f784814db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:09.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.283+0000 7f784da9a700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f78480b8d90 0x7f784806ade0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52452/0 (socket says 172.21.15.60:52452) 2023-07-12T02:02:09.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.283+0000 7f784d299700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f78481449d0 0x7f784814db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36568/0 (socket says 172.21.15.60:36568) 2023-07-12T02:02:09.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.283+0000 7f784da9a700 1 -- 172.21.15.60:0/1796558249 learned_addr learned my addr 172.21.15.60:0/1796558249 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:09.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.283+0000 7f784ca98700 1 --2- 172.21.15.60:0/1796558249 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f78480bc810 0x7f78480ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:09.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.284+0000 7f784d299700 1 -- 172.21.15.60:0/1796558249 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f78480bc810 msgr2=0x7f78480ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:09.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.284+0000 7f784d299700 1 --2- 172.21.15.60:0/1796558249 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f78480bc810 0x7f78480ba530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:09.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.284+0000 7f784d299700 1 -- 172.21.15.60:0/1796558249 >> v1:172.21.15.60:6789/0 conn(0x7f78480b8d90 legacy=0x7f784806ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:09.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.284+0000 7f784d299700 1 -- 172.21.15.60:0/1796558249 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78480b8900 con 0x7f78481449d0 2023-07-12T02:02:09.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.284+0000 7f783ffff700 1 -- 172.21.15.60:0/1796558249 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3872170058 0 0) 0x7f78480b8620 con 0x7f78480b8d90 2023-07-12T02:02:09.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.284+0000 7f784d299700 1 --2- 172.21.15.60:0/1796558249 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78481449d0 0x7f784814db50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7838009840 tx=0x7f7838009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10f587168b19e30d server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:09.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.284+0000 7f783ffff700 1 -- 172.21.15.60:0/1796558249 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7838011830 con 0x7f78481449d0 2023-07-12T02:02:09.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.284+0000 7f783ffff700 1 -- 172.21.15.60:0/1796558249 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7838011990 con 0x7f78481449d0 2023-07-12T02:02:09.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.284+0000 7f783ffff700 1 -- 172.21.15.60:0/1796558249 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7838011d20 con 0x7f78481449d0 2023-07-12T02:02:09.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.285+0000 7f784f4fd700 1 -- 172.21.15.60:0/1796558249 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78481449d0 msgr2=0x7f784814db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:09.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.285+0000 7f784f4fd700 1 --2- 172.21.15.60:0/1796558249 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78481449d0 0x7f784814db50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7838009840 tx=0x7f7838009b50 comp rx=0 tx=0).stop 2023-07-12T02:02:09.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.285+0000 7f784f4fd700 1 -- 172.21.15.60:0/1796558249 shutdown_connections 2023-07-12T02:02:09.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.285+0000 7f784f4fd700 1 --2- 172.21.15.60:0/1796558249 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78481449d0 0x7f784814db50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:09.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.285+0000 7f784f4fd700 1 --2- 172.21.15.60:0/1796558249 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f78480bc810 0x7f78480ba530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:09.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.285+0000 7f784f4fd700 1 -- 172.21.15.60:0/1796558249 >> 172.21.15.60:0/1796558249 conn(0x7f78480c0860 msgr2=0x7f78480c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:09.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.285+0000 7f784f4fd700 1 -- 172.21.15.60:0/1796558249 shutdown_connections 2023-07-12T02:02:09.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.285+0000 7f784f4fd700 1 -- 172.21.15.60:0/1796558249 wait complete. 2023-07-12T02:02:09.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.286+0000 7f784f4fd700 1 Processor -- start 2023-07-12T02:02:09.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.286+0000 7f784f4fd700 1 -- start start 2023-07-12T02:02:09.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.287+0000 7f784f4fd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78480b8d90 0x7f78480a20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:09.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.287+0000 7f784f4fd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78480bc810 0x7f78480a6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:09.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.287+0000 7f784f4fd700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f78481449d0 0x7f78481df5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:09.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.287+0000 7f784f4fd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78480a3010 con 0x7f78480b8d90 2023-07-12T02:02:09.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.287+0000 7f784f4fd700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78480a6550 con 0x7f78480bc810 2023-07-12T02:02:09.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.287+0000 7f784f4fd700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78481dfae0 con 0x7f78481449d0 2023-07-12T02:02:09.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.287+0000 7f784d299700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78480b8d90 0x7f78480a20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:09.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.287+0000 7f784d299700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78480b8d90 0x7f78480a20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36572/0 (socket says 172.21.15.60:36572) 2023-07-12T02:02:09.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.287+0000 7f784d299700 1 -- 172.21.15.60:0/2242311807 learned_addr learned my addr 172.21.15.60:0/2242311807 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:09.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.287+0000 7f784ca98700 1 --2- 172.21.15.60:0/2242311807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78480bc810 0x7f78480a6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:09.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.287+0000 7f784da9a700 1 --2- 172.21.15.60:0/2242311807 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f78481449d0 0x7f78481df5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:09.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.287+0000 7f784d299700 1 -- 172.21.15.60:0/2242311807 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f78481449d0 msgr2=0x7f78481df5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:09.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.287+0000 7f784d299700 1 --2- 172.21.15.60:0/2242311807 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f78481449d0 0x7f78481df5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:09.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.287+0000 7f784d299700 1 -- 172.21.15.60:0/2242311807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78480bc810 msgr2=0x7f78480a6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:09.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.287+0000 7f784d299700 1 --2- 172.21.15.60:0/2242311807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78480bc810 0x7f78480a6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:09.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.287+0000 7f784d299700 1 -- 172.21.15.60:0/2242311807 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78380094a0 con 0x7f78480b8d90 2023-07-12T02:02:09.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.287+0000 7f784d299700 1 --2- 172.21.15.60:0/2242311807 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78480b8d90 0x7f78480a20e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7838014040 tx=0x7f7838004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:09.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.289+0000 7f783dffb700 1 -- 172.21.15.60:0/2242311807 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78380036a0 con 0x7f78480b8d90 2023-07-12T02:02:09.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.289+0000 7f784f4fd700 1 -- 172.21.15.60:0/2242311807 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78480a1970 con 0x7f78480b8d90 2023-07-12T02:02:09.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.289+0000 7f784f4fd700 1 -- 172.21.15.60:0/2242311807 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78480a1c50 con 0x7f78480b8d90 2023-07-12T02:02:09.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.289+0000 7f783dffb700 1 -- 172.21.15.60:0/2242311807 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f783801e070 con 0x7f78480b8d90 2023-07-12T02:02:09.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.289+0000 7f783dffb700 1 -- 172.21.15.60:0/2242311807 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7838003a00 con 0x7f78480b8d90 2023-07-12T02:02:09.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.290+0000 7f784f4fd700 1 -- 172.21.15.60:0/2242311807 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78280052f0 con 0x7f78480b8d90 2023-07-12T02:02:09.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.290+0000 7f783dffb700 1 -- 172.21.15.60:0/2242311807 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7838003b60 con 0x7f78480b8d90 2023-07-12T02:02:09.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.291+0000 7f783dffb700 1 --2- 172.21.15.60:0/2242311807 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f782c06ace0 0x7f782c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:09.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.291+0000 7f783dffb700 1 -- 172.21.15.60:0/2242311807 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f783808a220 con 0x7f78480b8d90 2023-07-12T02:02:09.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.291+0000 7f784ca98700 1 --2- 172.21.15.60:0/2242311807 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f782c06ace0 0x7f782c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:09.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.291+0000 7f784ca98700 1 --2- 172.21.15.60:0/2242311807 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f782c06ace0 0x7f782c06d190 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f78480c0600 tx=0x7f7844009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:09.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.295+0000 7f783dffb700 1 -- 172.21.15.60:0/2242311807 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f7838055670 con 0x7f78480b8d90 2023-07-12T02:02:09.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.488+0000 7f784f4fd700 1 -- 172.21.15.60:0/2242311807 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7828005b20 con 0x7f78480b8d90 2023-07-12T02:02:09.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.488+0000 7f783dffb700 1 -- 172.21.15.60:0/2242311807 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7838058c90 con 0x7f78480b8d90 2023-07-12T02:02:09.492 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2023-07-12T02:02:09.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.491+0000 7f784f4fd700 1 -- 172.21.15.60:0/2242311807 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f782c06ace0 msgr2=0x7f782c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:09.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.491+0000 7f784f4fd700 1 --2- 172.21.15.60:0/2242311807 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f782c06ace0 0x7f782c06d190 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f78480c0600 tx=0x7f7844009210 comp rx=0 tx=0).stop 2023-07-12T02:02:09.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.491+0000 7f784f4fd700 1 -- 172.21.15.60:0/2242311807 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78480b8d90 msgr2=0x7f78480a20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:09.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.491+0000 7f784f4fd700 1 --2- 172.21.15.60:0/2242311807 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78480b8d90 0x7f78480a20e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7838014040 tx=0x7f7838004750 comp rx=0 tx=0).stop 2023-07-12T02:02:09.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.491+0000 7f784f4fd700 1 -- 172.21.15.60:0/2242311807 shutdown_connections 2023-07-12T02:02:09.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.491+0000 7f784f4fd700 1 --2- 172.21.15.60:0/2242311807 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f782c06ace0 0x7f782c06d190 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:09.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.491+0000 7f784f4fd700 1 --2- 172.21.15.60:0/2242311807 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78480b8d90 0x7f78480a20e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:09.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.491+0000 7f784f4fd700 1 --2- 172.21.15.60:0/2242311807 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f78481449d0 0x7f78481df5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:09.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.491+0000 7f784f4fd700 1 --2- 172.21.15.60:0/2242311807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78480bc810 0x7f78480a6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:09.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.491+0000 7f784f4fd700 1 -- 172.21.15.60:0/2242311807 >> 172.21.15.60:0/2242311807 conn(0x7f78480c0860 msgr2=0x7f7848143810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:09.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.491+0000 7f784f4fd700 1 -- 172.21.15.60:0/2242311807 shutdown_connections 2023-07-12T02:02:09.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.491+0000 7f784f4fd700 1 -- 172.21.15.60:0/2242311807 wait complete. 2023-07-12T02:02:09.506 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-12T02:02:09.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.632+0000 7f8b4f8bc700 1 Processor -- start 2023-07-12T02:02:09.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.632+0000 7f8b4f8bc700 1 -- start start 2023-07-12T02:02:09.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.633+0000 7f8b4f8bc700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b48141780 0x7f8b480ba010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:09.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.633+0000 7f8b4f8bc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8b48071a30 0x7f8b4814ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:09.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.633+0000 7f8b4f8bc700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b48070e70 con 0x7f8b480b96b0 2023-07-12T02:02:09.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.633+0000 7f8b4f8bc700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b48071ea0 con 0x7f8b48071a30 2023-07-12T02:02:09.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.633+0000 7f8b4f8bc700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b480b9b40 con 0x7f8b48141780 2023-07-12T02:02:09.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.633+0000 7f8b4ce57700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8b48071a30 0x7f8b4814ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:09.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.633+0000 7f8b4ce57700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8b48071a30 0x7f8b4814ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36582/0 (socket says 172.21.15.60:36582) 2023-07-12T02:02:09.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.633+0000 7f8b4ce57700 1 -- 172.21.15.60:0/3696175918 learned_addr learned my addr 172.21.15.60:0/3696175918 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:09.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.633+0000 7f8b4d658700 1 --2- 172.21.15.60:0/3696175918 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b48141780 0x7f8b480ba010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:09.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.633+0000 7f8b4ce57700 1 -- 172.21.15.60:0/3696175918 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b48141780 msgr2=0x7f8b480ba010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:09.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.633+0000 7f8b4ce57700 1 --2- 172.21.15.60:0/3696175918 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b48141780 0x7f8b480ba010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:09.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.633+0000 7f8b4ce57700 1 -- 172.21.15.60:0/3696175918 >> v1:172.21.15.79:6789/0 conn(0x7f8b480b96b0 legacy=0x7f8b480b7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:09.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.633+0000 7f8b4ce57700 1 -- 172.21.15.60:0/3696175918 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b48070670 con 0x7f8b48071a30 2023-07-12T02:02:09.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.634+0000 7f8b4ce57700 1 --2- 172.21.15.60:0/3696175918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b48071a30 0x7f8b4814ab20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8b4400bb90 tx=0x7f8b4400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e1f863636cccaef server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:09.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.634+0000 7f8b3ffff700 1 -- 172.21.15.60:0/3696175918 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4400dd50 con 0x7f8b48071a30 2023-07-12T02:02:09.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.634+0000 7f8b3ffff700 1 -- 172.21.15.60:0/3696175918 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b44010470 con 0x7f8b48071a30 2023-07-12T02:02:09.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.634+0000 7f8b3ffff700 1 -- 172.21.15.60:0/3696175918 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b44010800 con 0x7f8b48071a30 2023-07-12T02:02:09.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.634+0000 7f8b4f8bc700 1 -- 172.21.15.60:0/3696175918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b48071a30 msgr2=0x7f8b4814ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:09.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.634+0000 7f8b4f8bc700 1 --2- 172.21.15.60:0/3696175918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b48071a30 0x7f8b4814ab20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8b4400bb90 tx=0x7f8b4400bea0 comp rx=0 tx=0).stop 2023-07-12T02:02:09.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.634+0000 7f8b4f8bc700 1 -- 172.21.15.60:0/3696175918 shutdown_connections 2023-07-12T02:02:09.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.634+0000 7f8b4f8bc700 1 --2- 172.21.15.60:0/3696175918 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b48141780 0x7f8b480ba010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:09.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.634+0000 7f8b4f8bc700 1 --2- 172.21.15.60:0/3696175918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b48071a30 0x7f8b4814ab20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:09.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.634+0000 7f8b4f8bc700 1 -- 172.21.15.60:0/3696175918 >> 172.21.15.60:0/3696175918 conn(0x7f8b4806d0e0 msgr2=0x7f8b4806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:09.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.634+0000 7f8b4f8bc700 1 -- 172.21.15.60:0/3696175918 shutdown_connections 2023-07-12T02:02:09.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.634+0000 7f8b4f8bc700 1 -- 172.21.15.60:0/3696175918 wait complete. 2023-07-12T02:02:09.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.636+0000 7f8b4f8bc700 1 Processor -- start 2023-07-12T02:02:09.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.636+0000 7f8b4f8bc700 1 -- start start 2023-07-12T02:02:09.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.637+0000 7f8b4f8bc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b48071a30 0x7f8b480b7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:09.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.637+0000 7f8b4f8bc700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b480b96b0 0x7f8b480b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:09.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.637+0000 7f8b4f8bc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b48141780 0x7f8b481378b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:09.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.637+0000 7f8b4f8bc700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b480bbf20 con 0x7f8b48141780 2023-07-12T02:02:09.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.637+0000 7f8b4f8bc700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b480b78c0 con 0x7f8b48071a30 2023-07-12T02:02:09.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.637+0000 7f8b4f8bc700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4813da50 con 0x7f8b480b96b0 2023-07-12T02:02:09.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.637+0000 7f8b4de59700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b48141780 0x7f8b481378b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:09.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.637+0000 7f8b4de59700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b48141780 0x7f8b481378b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36590/0 (socket says 172.21.15.60:36590) 2023-07-12T02:02:09.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.637+0000 7f8b4de59700 1 -- 172.21.15.60:0/2931465796 learned_addr learned my addr 172.21.15.60:0/2931465796 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:09.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.637+0000 7f8b4ce57700 1 --2- 172.21.15.60:0/2931465796 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b480b96b0 0x7f8b480b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:09.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.637+0000 7f8b4d658700 1 --2- 172.21.15.60:0/2931465796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b48071a30 0x7f8b480b7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:09.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.637+0000 7f8b4de59700 1 -- 172.21.15.60:0/2931465796 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b480b96b0 msgr2=0x7f8b480b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:09.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.637+0000 7f8b4de59700 1 --2- 172.21.15.60:0/2931465796 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b480b96b0 0x7f8b480b4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:09.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.637+0000 7f8b4de59700 1 -- 172.21.15.60:0/2931465796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b48071a30 msgr2=0x7f8b480b7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:09.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.637+0000 7f8b4de59700 1 --2- 172.21.15.60:0/2931465796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b48071a30 0x7f8b480b7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:09.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.637+0000 7f8b4de59700 1 -- 172.21.15.60:0/2931465796 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b4400b7f0 con 0x7f8b48141780 2023-07-12T02:02:09.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.637+0000 7f8b4d658700 1 --2- 172.21.15.60:0/2931465796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b48071a30 0x7f8b480b7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:09.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.637+0000 7f8b4ce57700 1 --2- 172.21.15.60:0/2931465796 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b480b96b0 0x7f8b480b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:09.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.637+0000 7f8b4de59700 1 --2- 172.21.15.60:0/2931465796 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b48141780 0x7f8b481378b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8b4000cbc0 tx=0x7f8b4000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:09.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.637+0000 7f8b3dffb700 1 -- 172.21.15.60:0/2931465796 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b40003c00 con 0x7f8b48141780 2023-07-12T02:02:09.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.638+0000 7f8b3dffb700 1 -- 172.21.15.60:0/2931465796 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b40003d60 con 0x7f8b48141780 2023-07-12T02:02:09.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.638+0000 7f8b4f8bc700 1 -- 172.21.15.60:0/2931465796 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b480bce00 con 0x7f8b48141780 2023-07-12T02:02:09.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.638+0000 7f8b3dffb700 1 -- 172.21.15.60:0/2931465796 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4000abf0 con 0x7f8b48141780 2023-07-12T02:02:09.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.638+0000 7f8b4f8bc700 1 -- 172.21.15.60:0/2931465796 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b480b51f0 con 0x7f8b48141780 2023-07-12T02:02:09.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.639+0000 7f8b4f8bc700 1 -- 172.21.15.60:0/2931465796 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b480bc060 con 0x7f8b48141780 2023-07-12T02:02:09.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.639+0000 7f8b3dffb700 1 -- 172.21.15.60:0/2931465796 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8b4000ad50 con 0x7f8b48141780 2023-07-12T02:02:09.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.639+0000 7f8b3dffb700 1 --2- 172.21.15.60:0/2931465796 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f8b2c06ace0 0x7f8b2c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:09.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.639+0000 7f8b3dffb700 1 -- 172.21.15.60:0/2931465796 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8b40089180 con 0x7f8b48141780 2023-07-12T02:02:09.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.640+0000 7f8b4d658700 1 --2- 172.21.15.60:0/2931465796 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f8b2c06ace0 0x7f8b2c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:09.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.640+0000 7f8b4d658700 1 --2- 172.21.15.60:0/2931465796 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f8b2c06ace0 0x7f8b2c06d190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8b38007a50 tx=0x7f8b38008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:09.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.644+0000 7f8b3dffb700 1 -- 172.21.15.60:0/2931465796 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f8b480bc060 con 0x7f8b48141780 2023-07-12T02:02:09.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.838+0000 7f8b4f8bc700 1 -- 172.21.15.60:0/2931465796 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8b480bc060 con 0x7f8b48141780 2023-07-12T02:02:09.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.839+0000 7f8b3dffb700 1 -- 172.21.15.60:0/2931465796 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8b480bc060 con 0x7f8b48141780 2023-07-12T02:02:09.842 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-07-12T02:02:09.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.841+0000 7f8b4f8bc700 1 -- 172.21.15.60:0/2931465796 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f8b2c06ace0 msgr2=0x7f8b2c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:09.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.841+0000 7f8b4f8bc700 1 --2- 172.21.15.60:0/2931465796 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f8b2c06ace0 0x7f8b2c06d190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8b38007a50 tx=0x7f8b38008040 comp rx=0 tx=0).stop 2023-07-12T02:02:09.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.841+0000 7f8b4f8bc700 1 -- 172.21.15.60:0/2931465796 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b48141780 msgr2=0x7f8b481378b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:09.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.841+0000 7f8b4f8bc700 1 --2- 172.21.15.60:0/2931465796 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b48141780 0x7f8b481378b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8b4000cbc0 tx=0x7f8b4000cf80 comp rx=0 tx=0).stop 2023-07-12T02:02:09.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.841+0000 7f8b4f8bc700 1 -- 172.21.15.60:0/2931465796 shutdown_connections 2023-07-12T02:02:09.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.841+0000 7f8b4f8bc700 1 --2- 172.21.15.60:0/2931465796 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f8b2c06ace0 0x7f8b2c06d190 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:09.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.841+0000 7f8b4f8bc700 1 --2- 172.21.15.60:0/2931465796 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b48141780 0x7f8b481378b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:09.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.841+0000 7f8b4f8bc700 1 --2- 172.21.15.60:0/2931465796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b48071a30 0x7f8b480b7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:09.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.841+0000 7f8b4f8bc700 1 --2- 172.21.15.60:0/2931465796 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b480b96b0 0x7f8b480b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:09.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.841+0000 7f8b4f8bc700 1 -- 172.21.15.60:0/2931465796 >> 172.21.15.60:0/2931465796 conn(0x7f8b4806d0e0 msgr2=0x7f8b4806f610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:09.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.841+0000 7f8b4f8bc700 1 -- 172.21.15.60:0/2931465796 shutdown_connections 2023-07-12T02:02:09.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.841+0000 7f8b4f8bc700 1 -- 172.21.15.60:0/2931465796 wait complete. 2023-07-12T02:02:09.856 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-12T02:02:09.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.978+0000 7fa8d08a0700 1 Processor -- start 2023-07-12T02:02:09.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.978+0000 7fa8d08a0700 1 -- start start 2023-07-12T02:02:09.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.979+0000 7fa8d08a0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa8cc070560 0x7fa8cc06f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:09.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.979+0000 7fa8d08a0700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa8cc147880 0x7fa8cc151d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:09.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.979+0000 7fa8d08a0700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8cc14b480 con 0x7fa8cc1473e0 2023-07-12T02:02:09.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.979+0000 7fa8d08a0700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8cc147d00 con 0x7fa8cc147880 2023-07-12T02:02:09.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.979+0000 7fa8d08a0700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8cc14b910 con 0x7fa8cc070560 2023-07-12T02:02:09.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.979+0000 7fa8c9d9b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa8cc1473e0 0x7fa8cc140fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52460/0 (socket says 172.21.15.60:52460) 2023-07-12T02:02:09.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.979+0000 7fa8cad9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa8cc147880 0x7fa8cc151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:09.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.979+0000 7fa8c9d9b700 1 -- 172.21.15.60:0/298909421 learned_addr learned my addr 172.21.15.60:0/298909421 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:09.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.980+0000 7fa8ca59c700 1 --2- 172.21.15.60:0/298909421 >> v2:172.21.15.79:3300/0 conn(0x7fa8cc070560 0x7fa8cc06f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:09.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.980+0000 7fa8c959a700 1 -- 172.21.15.60:0/298909421 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2297086682 0 0) 0x7fa8cc14b480 con 0x7fa8cc1473e0 2023-07-12T02:02:09.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.980+0000 7fa8c959a700 1 -- 172.21.15.60:0/298909421 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8b80035b0 con 0x7fa8cc1473e0 2023-07-12T02:02:09.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.980+0000 7fa8cad9d700 1 -- 172.21.15.60:0/298909421 >> v2:172.21.15.79:3300/0 conn(0x7fa8cc070560 msgr2=0x7fa8cc06f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:09.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.980+0000 7fa8cad9d700 1 --2- 172.21.15.60:0/298909421 >> v2:172.21.15.79:3300/0 conn(0x7fa8cc070560 0x7fa8cc06f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:09.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.980+0000 7fa8cad9d700 1 -- 172.21.15.60:0/298909421 >> v1:172.21.15.60:6789/0 conn(0x7fa8cc1473e0 legacy=0x7fa8cc140fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:09.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.980+0000 7fa8cad9d700 1 -- 172.21.15.60:0/298909421 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8cc14ab50 con 0x7fa8cc147880 2023-07-12T02:02:09.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.980+0000 7fa8cad9d700 1 --2- 172.21.15.60:0/298909421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8cc147880 0x7fa8cc151d40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc072750 tx=0x7fa8c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6429ee9669376858 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:09.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.980+0000 7fa8c959a700 1 -- 172.21.15.60:0/298909421 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c400e070 con 0x7fa8cc147880 2023-07-12T02:02:09.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.980+0000 7fa8c959a700 1 -- 172.21.15.60:0/298909421 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c400bae0 con 0x7fa8cc147880 2023-07-12T02:02:09.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.980+0000 7fa8c959a700 1 -- 172.21.15.60:0/298909421 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c400be90 con 0x7fa8cc147880 2023-07-12T02:02:09.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.981+0000 7fa8d08a0700 1 -- 172.21.15.60:0/298909421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8cc147880 msgr2=0x7fa8cc151d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:09.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.981+0000 7fa8d08a0700 1 --2- 172.21.15.60:0/298909421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8cc147880 0x7fa8cc151d40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc072750 tx=0x7fa8c400b330 comp rx=0 tx=0).stop 2023-07-12T02:02:09.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.981+0000 7fa8d08a0700 1 -- 172.21.15.60:0/298909421 shutdown_connections 2023-07-12T02:02:09.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.981+0000 7fa8d08a0700 1 --2- 172.21.15.60:0/298909421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8cc147880 0x7fa8cc151d40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:09.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.981+0000 7fa8d08a0700 1 --2- 172.21.15.60:0/298909421 >> v2:172.21.15.79:3300/0 conn(0x7fa8cc070560 0x7fa8cc06f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:09.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.981+0000 7fa8d08a0700 1 -- 172.21.15.60:0/298909421 >> 172.21.15.60:0/298909421 conn(0x7fa8cc06d0e0 msgr2=0x7fa8cc06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:09.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.981+0000 7fa8d08a0700 1 -- 172.21.15.60:0/298909421 shutdown_connections 2023-07-12T02:02:09.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.981+0000 7fa8d08a0700 1 -- 172.21.15.60:0/298909421 wait complete. 2023-07-12T02:02:09.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.982+0000 7fa8d08a0700 1 Processor -- start 2023-07-12T02:02:09.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.982+0000 7fa8d08a0700 1 -- start start 2023-07-12T02:02:09.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.983+0000 7fa8d08a0700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa8cc070560 0x7fa8cc0b71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:09.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.983+0000 7fa8d08a0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8cc1473e0 0x7fa8cc145d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:09.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.983+0000 7fa8d08a0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8cc147880 0x7fa8cc1e2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:09.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.983+0000 7fa8d08a0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc1462d0 con 0x7fa8cc147880 2023-07-12T02:02:09.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.983+0000 7fa8d08a0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc0b5820 con 0x7fa8cc1473e0 2023-07-12T02:02:09.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.983+0000 7fa8d08a0700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc0b4af0 con 0x7fa8cc070560 2023-07-12T02:02:09.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.983+0000 7fa8cad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8cc147880 0x7fa8cc1e2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:09.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.983+0000 7fa8cad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8cc147880 0x7fa8cc1e2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36596/0 (socket says 172.21.15.60:36596) 2023-07-12T02:02:09.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.983+0000 7fa8cad9d700 1 -- 172.21.15.60:0/3877888635 learned_addr learned my addr 172.21.15.60:0/3877888635 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:09.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.983+0000 7fa8ca59c700 1 --2- 172.21.15.60:0/3877888635 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa8cc070560 0x7fa8cc0b71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:09.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.983+0000 7fa8c9d9b700 1 --2- 172.21.15.60:0/3877888635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8cc1473e0 0x7fa8cc145d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:09.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.983+0000 7fa8cad9d700 1 -- 172.21.15.60:0/3877888635 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa8cc070560 msgr2=0x7fa8cc0b71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:09.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.983+0000 7fa8cad9d700 1 --2- 172.21.15.60:0/3877888635 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa8cc070560 0x7fa8cc0b71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:09.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.983+0000 7fa8cad9d700 1 -- 172.21.15.60:0/3877888635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8cc1473e0 msgr2=0x7fa8cc145d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:09.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.983+0000 7fa8cad9d700 1 --2- 172.21.15.60:0/3877888635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8cc1473e0 0x7fa8cc145d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:09.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.983+0000 7fa8cad9d700 1 -- 172.21.15.60:0/3877888635 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c4009a70 con 0x7fa8cc147880 2023-07-12T02:02:09.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.983+0000 7fa8c9d9b700 1 --2- 172.21.15.60:0/3877888635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8cc1473e0 0x7fa8cc145d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:09.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.983+0000 7fa8cad9d700 1 --2- 172.21.15.60:0/3877888635 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8cc147880 0x7fa8cc1e2fe0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4009f00 tx=0x7fa8c4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:09.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.983+0000 7fa8c2ffd700 1 -- 172.21.15.60:0/3877888635 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c40046b0 con 0x7fa8cc147880 2023-07-12T02:02:09.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.983+0000 7fa8c2ffd700 1 -- 172.21.15.60:0/3877888635 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c4020070 con 0x7fa8cc147880 2023-07-12T02:02:09.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.983+0000 7fa8d08a0700 1 -- 172.21.15.60:0/3877888635 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8cc0b5390 con 0x7fa8cc147880 2023-07-12T02:02:09.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.983+0000 7fa8c2ffd700 1 -- 172.21.15.60:0/3877888635 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4027480 con 0x7fa8cc147880 2023-07-12T02:02:09.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.983+0000 7fa8d08a0700 1 -- 172.21.15.60:0/3877888635 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8cc0b5020 con 0x7fa8cc147880 2023-07-12T02:02:09.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.984+0000 7fa8d08a0700 1 -- 172.21.15.60:0/3877888635 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8cc0b5520 con 0x7fa8cc147880 2023-07-12T02:02:09.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.985+0000 7fa8c2ffd700 1 -- 172.21.15.60:0/3877888635 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa8c4012430 con 0x7fa8cc147880 2023-07-12T02:02:09.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.985+0000 7fa8c2ffd700 1 --2- 172.21.15.60:0/3877888635 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fa8ac06ace0 0x7fa8ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:09.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.985+0000 7fa8c2ffd700 1 -- 172.21.15.60:0/3877888635 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa8c4022070 con 0x7fa8cc147880 2023-07-12T02:02:09.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.985+0000 7fa8ca59c700 1 --2- 172.21.15.60:0/3877888635 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fa8ac06ace0 0x7fa8ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:09.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.986+0000 7fa8ca59c700 1 --2- 172.21.15.60:0/3877888635 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fa8ac06ace0 0x7fa8ac06d190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa8b400b240 tx=0x7fa8b4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:09.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:09.990+0000 7fa8c2ffd700 1 -- 172.21.15.60:0/3877888635 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fa8c405a570 con 0x7fa8cc147880 2023-07-12T02:02:10.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.191+0000 7fa8d08a0700 1 -- 172.21.15.60:0/3877888635 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa8cc0bafb0 con 0x7fa8cc147880 2023-07-12T02:02:10.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.192+0000 7fa8c2ffd700 1 -- 172.21.15.60:0/3877888635 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+126 (secure 0 0 0) 0x7fa8c405a100 con 0x7fa8cc147880 2023-07-12T02:02:10.195 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:02:10.195 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2023-07-12T02:02:10.195 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-07-12T02:02:10.195 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 1, 2023-07-12T02:02:10.196 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": "rbd" 2023-07-12T02:02:10.196 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-07-12T02:02:10.196 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-07-12T02:02:10.196 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 2, 2023-07-12T02:02:10.196 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": ".mgr" 2023-07-12T02:02:10.197 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-07-12T02:02:10.197 INFO:teuthology.orchestra.run.smithi060.stdout:] 2023-07-12T02:02:10.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.194+0000 7fa8d08a0700 1 -- 172.21.15.60:0/3877888635 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fa8ac06ace0 msgr2=0x7fa8ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:10.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.194+0000 7fa8d08a0700 1 --2- 172.21.15.60:0/3877888635 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fa8ac06ace0 0x7fa8ac06d190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa8b400b240 tx=0x7fa8b4008040 comp rx=0 tx=0).stop 2023-07-12T02:02:10.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.194+0000 7fa8d08a0700 1 -- 172.21.15.60:0/3877888635 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8cc147880 msgr2=0x7fa8cc1e2fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:10.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.194+0000 7fa8d08a0700 1 --2- 172.21.15.60:0/3877888635 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8cc147880 0x7fa8cc1e2fe0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4009f00 tx=0x7fa8c4004ad0 comp rx=0 tx=0).stop 2023-07-12T02:02:10.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.194+0000 7fa8d08a0700 1 -- 172.21.15.60:0/3877888635 shutdown_connections 2023-07-12T02:02:10.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.194+0000 7fa8d08a0700 1 --2- 172.21.15.60:0/3877888635 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fa8ac06ace0 0x7fa8ac06d190 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:10.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.194+0000 7fa8d08a0700 1 --2- 172.21.15.60:0/3877888635 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8cc147880 0x7fa8cc1e2fe0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:10.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.194+0000 7fa8d08a0700 1 --2- 172.21.15.60:0/3877888635 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa8cc070560 0x7fa8cc0b71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:10.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.194+0000 7fa8d08a0700 1 --2- 172.21.15.60:0/3877888635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa8cc1473e0 0x7fa8cc145d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:10.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.194+0000 7fa8d08a0700 1 -- 172.21.15.60:0/3877888635 >> 172.21.15.60:0/3877888635 conn(0x7fa8cc06d0e0 msgr2=0x7fa8cc13dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:10.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.194+0000 7fa8d08a0700 1 -- 172.21.15.60:0/3877888635 shutdown_connections 2023-07-12T02:02:10.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.194+0000 7fa8d08a0700 1 -- 172.21.15.60:0/3877888635 wait complete. 2023-07-12T02:02:10.209 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-12T02:02:10.209 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-12T02:02:10.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.336+0000 7fabe24f1700 1 Processor -- start 2023-07-12T02:02:10.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.336+0000 7fabe24f1700 1 -- start start 2023-07-12T02:02:10.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.337+0000 7fabe24f1700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fabdc0b6980 0x7fabdc14a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:10.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.337+0000 7fabe24f1700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fabdc14aae0 0x7fabdc1443d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:10.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.337+0000 7fabe24f1700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fabdc144910 0x7fabdc0bb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:10.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.337+0000 7fabe24f1700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabdc0b7dd0 con 0x7fabdc0b6980 2023-07-12T02:02:10.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.337+0000 7fabe24f1700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabdc0bb380 con 0x7fabdc14aae0 2023-07-12T02:02:10.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.337+0000 7fabe24f1700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabdc0bc4c0 con 0x7fabdc144910 2023-07-12T02:02:10.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.337+0000 7fabdbfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fabdc0b6980 0x7fabdc14a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:10.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.337+0000 7fabdbfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fabdc0b6980 0x7fabdc14a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36604/0 (socket says 172.21.15.60:36604) 2023-07-12T02:02:10.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.337+0000 7fabdbfff700 1 -- 172.21.15.60:0/506208183 learned_addr learned my addr 172.21.15.60:0/506208183 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:10.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.337+0000 7fabdb7fe700 1 --2- 172.21.15.60:0/506208183 >> v2:172.21.15.79:3300/0 conn(0x7fabdc14aae0 0x7fabdc1443d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:10.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.337+0000 7fabe0a8e700 1 --2- 172.21.15.60:0/506208183 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fabdc144910 0x7fabdc0bb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:10.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.337+0000 7fabdbfff700 1 -- 172.21.15.60:0/506208183 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fabdc144910 msgr2=0x7fabdc0bb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:10.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.337+0000 7fabdbfff700 1 --2- 172.21.15.60:0/506208183 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fabdc144910 0x7fabdc0bb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:10.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.337+0000 7fabdbfff700 1 -- 172.21.15.60:0/506208183 >> v2:172.21.15.79:3300/0 conn(0x7fabdc14aae0 msgr2=0x7fabdc1443d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:10.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.337+0000 7fabdbfff700 1 --2- 172.21.15.60:0/506208183 >> v2:172.21.15.79:3300/0 conn(0x7fabdc14aae0 0x7fabdc1443d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:10.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.337+0000 7fabdbfff700 1 -- 172.21.15.60:0/506208183 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabdc14aff0 con 0x7fabdc0b6980 2023-07-12T02:02:10.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.337+0000 7fabdbfff700 1 --2- 172.21.15.60:0/506208183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fabdc0b6980 0x7fabdc14a5a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fabdc0b7140 tx=0x7fabcc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4c46903c2862dc5 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:10.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.337+0000 7fabdaffd700 1 -- 172.21.15.60:0/506208183 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabcc00b870 con 0x7fabdc0b6980 2023-07-12T02:02:10.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.337+0000 7fabdaffd700 1 -- 172.21.15.60:0/506208183 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabcc00b9d0 con 0x7fabdc0b6980 2023-07-12T02:02:10.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.337+0000 7fabdaffd700 1 -- 172.21.15.60:0/506208183 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabcc00bd60 con 0x7fabdc0b6980 2023-07-12T02:02:10.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.338+0000 7fabe24f1700 1 -- 172.21.15.60:0/506208183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fabdc0b6980 msgr2=0x7fabdc14a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:10.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.338+0000 7fabe24f1700 1 --2- 172.21.15.60:0/506208183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fabdc0b6980 0x7fabdc14a5a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fabdc0b7140 tx=0x7fabcc009bd0 comp rx=0 tx=0).stop 2023-07-12T02:02:10.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.338+0000 7fabe24f1700 1 -- 172.21.15.60:0/506208183 shutdown_connections 2023-07-12T02:02:10.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.338+0000 7fabe24f1700 1 --2- 172.21.15.60:0/506208183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fabdc0b6980 0x7fabdc14a5a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:10.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.338+0000 7fabe24f1700 1 --2- 172.21.15.60:0/506208183 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fabdc144910 0x7fabdc0bb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:10.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.338+0000 7fabe24f1700 1 --2- 172.21.15.60:0/506208183 >> v2:172.21.15.79:3300/0 conn(0x7fabdc14aae0 0x7fabdc1443d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:10.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.338+0000 7fabe24f1700 1 -- 172.21.15.60:0/506208183 >> 172.21.15.60:0/506208183 conn(0x7fabdc071660 msgr2=0x7fabdc071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:10.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.338+0000 7fabe24f1700 1 -- 172.21.15.60:0/506208183 shutdown_connections 2023-07-12T02:02:10.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.338+0000 7fabe24f1700 1 -- 172.21.15.60:0/506208183 wait complete. 2023-07-12T02:02:10.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.339+0000 7fabe24f1700 1 Processor -- start 2023-07-12T02:02:10.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.339+0000 7fabe24f1700 1 -- start start 2023-07-12T02:02:10.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.340+0000 7fabe24f1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fabdc0b6980 0x7fabdc13b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:10.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.340+0000 7fabe24f1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabdc144910 0x7fabdc13ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:10.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.340+0000 7fabe24f1700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fabdc14aae0 0x7fabdc1d2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:10.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.340+0000 7fabe24f1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabdc1d45f0 con 0x7fabdc0b6980 2023-07-12T02:02:10.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.340+0000 7fabe24f1700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabdc13b050 con 0x7fabdc144910 2023-07-12T02:02:10.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.340+0000 7fabe24f1700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabdc0ba560 con 0x7fabdc14aae0 2023-07-12T02:02:10.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.340+0000 7fabdbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fabdc0b6980 0x7fabdc13b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:10.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.340+0000 7fabdbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fabdc0b6980 0x7fabdc13b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36618/0 (socket says 172.21.15.60:36618) 2023-07-12T02:02:10.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.340+0000 7fabdbfff700 1 -- 172.21.15.60:0/2986308275 learned_addr learned my addr 172.21.15.60:0/2986308275 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:10.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.340+0000 7fabdb7fe700 1 --2- 172.21.15.60:0/2986308275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabdc144910 0x7fabdc13ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:10.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.340+0000 7fabe0a8e700 1 --2- 172.21.15.60:0/2986308275 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fabdc14aae0 0x7fabdc1d2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:10.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.340+0000 7fabdbfff700 1 -- 172.21.15.60:0/2986308275 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fabdc14aae0 msgr2=0x7fabdc1d2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:10.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.340+0000 7fabdbfff700 1 --2- 172.21.15.60:0/2986308275 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fabdc14aae0 0x7fabdc1d2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:10.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.340+0000 7fabdbfff700 1 -- 172.21.15.60:0/2986308275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabdc144910 msgr2=0x7fabdc13ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:10.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.340+0000 7fabdbfff700 1 --2- 172.21.15.60:0/2986308275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabdc144910 0x7fabdc13ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:10.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.340+0000 7fabdbfff700 1 -- 172.21.15.60:0/2986308275 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabcc009550 con 0x7fabdc0b6980 2023-07-12T02:02:10.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.341+0000 7fabdbfff700 1 --2- 172.21.15.60:0/2986308275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fabdc0b6980 0x7fabdc13b400 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fabcc000c00 tx=0x7fabcc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:10.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.341+0000 7fabd8ff9700 1 -- 172.21.15.60:0/2986308275 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabcc004480 con 0x7fabdc0b6980 2023-07-12T02:02:10.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.341+0000 7fabd8ff9700 1 -- 172.21.15.60:0/2986308275 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabcc0045e0 con 0x7fabdc0b6980 2023-07-12T02:02:10.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.341+0000 7fabe24f1700 1 -- 172.21.15.60:0/2986308275 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabdc1d30f0 con 0x7fabdc0b6980 2023-07-12T02:02:10.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.341+0000 7fabd8ff9700 1 -- 172.21.15.60:0/2986308275 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabcc0038e0 con 0x7fabdc0b6980 2023-07-12T02:02:10.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.341+0000 7fabe24f1700 1 -- 172.21.15.60:0/2986308275 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabdc0b9fa0 con 0x7fabdc0b6980 2023-07-12T02:02:10.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.342+0000 7fabe24f1700 1 -- 172.21.15.60:0/2986308275 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabdc074360 con 0x7fabdc0b6980 2023-07-12T02:02:10.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.342+0000 7fabd8ff9700 1 -- 172.21.15.60:0/2986308275 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fabcc021070 con 0x7fabdc0b6980 2023-07-12T02:02:10.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.342+0000 7fabd8ff9700 1 --2- 172.21.15.60:0/2986308275 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fabc806ace0 0x7fabc806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:10.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.343+0000 7fabd8ff9700 1 -- 172.21.15.60:0/2986308275 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fabcc08a800 con 0x7fabdc0b6980 2023-07-12T02:02:10.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.343+0000 7fabdb7fe700 1 --2- 172.21.15.60:0/2986308275 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fabc806ace0 0x7fabc806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:10.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.343+0000 7fabdb7fe700 1 --2- 172.21.15.60:0/2986308275 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fabc806ace0 0x7fabc806d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fabdc142610 tx=0x7fabd0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:10.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.347+0000 7fabd8ff9700 1 -- 172.21.15.60:0/2986308275 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fabcc055d10 con 0x7fabdc0b6980 2023-07-12T02:02:10.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:10.544+0000 7fabe24f1700 1 -- 172.21.15.60:0/2986308275 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fabdc0c02c0 con 0x7fabdc0b6980 2023-07-12T02:02:11.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.302+0000 7fabd8ff9700 1 -- 172.21.15.60:0/2986308275 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7fabcc059330 con 0x7fabdc0b6980 2023-07-12T02:02:11.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.305+0000 7fabe24f1700 1 -- 172.21.15.60:0/2986308275 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fabc806ace0 msgr2=0x7fabc806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:11.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.305+0000 7fabe24f1700 1 --2- 172.21.15.60:0/2986308275 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fabc806ace0 0x7fabc806d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fabdc142610 tx=0x7fabd0008040 comp rx=0 tx=0).stop 2023-07-12T02:02:11.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.305+0000 7fabe24f1700 1 -- 172.21.15.60:0/2986308275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fabdc0b6980 msgr2=0x7fabdc13b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:11.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.305+0000 7fabe24f1700 1 --2- 172.21.15.60:0/2986308275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fabdc0b6980 0x7fabdc13b400 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fabcc000c00 tx=0x7fabcc004750 comp rx=0 tx=0).stop 2023-07-12T02:02:11.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.305+0000 7fabe24f1700 1 -- 172.21.15.60:0/2986308275 shutdown_connections 2023-07-12T02:02:11.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.305+0000 7fabe24f1700 1 --2- 172.21.15.60:0/2986308275 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fabc806ace0 0x7fabc806d190 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:11.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.305+0000 7fabe24f1700 1 --2- 172.21.15.60:0/2986308275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fabdc0b6980 0x7fabdc13b400 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:11.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.305+0000 7fabe24f1700 1 --2- 172.21.15.60:0/2986308275 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fabdc14aae0 0x7fabdc1d2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:11.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.305+0000 7fabe24f1700 1 --2- 172.21.15.60:0/2986308275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabdc144910 0x7fabdc13ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:11.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.305+0000 7fabe24f1700 1 -- 172.21.15.60:0/2986308275 >> 172.21.15.60:0/2986308275 conn(0x7fabdc071660 msgr2=0x7fabdc1d4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:11.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.305+0000 7fabe24f1700 1 -- 172.21.15.60:0/2986308275 shutdown_connections 2023-07-12T02:02:11.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.305+0000 7fabe24f1700 1 -- 172.21.15.60:0/2986308275 wait complete. 2023-07-12T02:02:11.311 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' created 2023-07-12T02:02:11.327 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-12T02:02:11.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.463+0000 7f9c468f6700 1 Processor -- start 2023-07-12T02:02:11.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.463+0000 7f9c468f6700 1 -- start start 2023-07-12T02:02:11.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.464+0000 7f9c468f6700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9c4006b120 0x7f9c401474f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:11.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.464+0000 7f9c468f6700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9c40147a30 0x7f9c400b6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:11.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.464+0000 7f9c468f6700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c400b3bd0 con 0x7f9c40071b60 2023-07-12T02:02:11.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.464+0000 7f9c468f6700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c40070800 con 0x7f9c40147a30 2023-07-12T02:02:11.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.464+0000 7f9c468f6700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c40141c90 con 0x7f9c4006b120 2023-07-12T02:02:11.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.464+0000 7f9c44e93700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9c40147a30 0x7f9c400b6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:11.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.464+0000 7f9c3f7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f9c40071b60 0x7f9c400b6430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52468/0 (socket says 172.21.15.60:52468) 2023-07-12T02:02:11.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.464+0000 7f9c3f7fe700 1 -- 172.21.15.60:0/3328432412 learned_addr learned my addr 172.21.15.60:0/3328432412 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:11.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.464+0000 7f9c3ffff700 1 --2- 172.21.15.60:0/3328432412 >> v2:172.21.15.79:3300/0 conn(0x7f9c4006b120 0x7f9c401474f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:11.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.465+0000 7f9c44e93700 1 -- 172.21.15.60:0/3328432412 >> v2:172.21.15.79:3300/0 conn(0x7f9c4006b120 msgr2=0x7f9c401474f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:11.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.465+0000 7f9c44e93700 1 --2- 172.21.15.60:0/3328432412 >> v2:172.21.15.79:3300/0 conn(0x7f9c4006b120 0x7f9c401474f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:11.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.465+0000 7f9c44e93700 1 -- 172.21.15.60:0/3328432412 >> v1:172.21.15.60:6789/0 conn(0x7f9c40071b60 legacy=0x7f9c400b6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:11.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.465+0000 7f9c44e93700 1 -- 172.21.15.60:0/3328432412 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c400714d0 con 0x7f9c40147a30 2023-07-12T02:02:11.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.465+0000 7f9c44e93700 1 --2- 172.21.15.60:0/3328432412 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c40147a30 0x7f9c400b6b40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9c4006b830 tx=0x7f9c3800d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfe77ad78cc92e8a server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:11.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.465+0000 7f9c3effd700 1 -- 172.21.15.60:0/3328432412 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c38010070 con 0x7f9c40147a30 2023-07-12T02:02:11.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.465+0000 7f9c3effd700 1 -- 172.21.15.60:0/3328432412 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c3800b2e0 con 0x7f9c40147a30 2023-07-12T02:02:11.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.465+0000 7f9c3effd700 1 -- 172.21.15.60:0/3328432412 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3800dcc0 con 0x7f9c40147a30 2023-07-12T02:02:11.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.465+0000 7f9c468f6700 1 -- 172.21.15.60:0/3328432412 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c40147a30 msgr2=0x7f9c400b6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:11.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.465+0000 7f9c468f6700 1 --2- 172.21.15.60:0/3328432412 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c40147a30 0x7f9c400b6b40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9c4006b830 tx=0x7f9c3800d330 comp rx=0 tx=0).stop 2023-07-12T02:02:11.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.465+0000 7f9c468f6700 1 -- 172.21.15.60:0/3328432412 shutdown_connections 2023-07-12T02:02:11.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.465+0000 7f9c468f6700 1 --2- 172.21.15.60:0/3328432412 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c40147a30 0x7f9c400b6b40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:11.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.465+0000 7f9c468f6700 1 --2- 172.21.15.60:0/3328432412 >> v2:172.21.15.79:3300/0 conn(0x7f9c4006b120 0x7f9c401474f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:11.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.465+0000 7f9c468f6700 1 -- 172.21.15.60:0/3328432412 >> 172.21.15.60:0/3328432412 conn(0x7f9c400bd980 msgr2=0x7f9c400b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:11.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.465+0000 7f9c468f6700 1 -- 172.21.15.60:0/3328432412 shutdown_connections 2023-07-12T02:02:11.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.465+0000 7f9c468f6700 1 -- 172.21.15.60:0/3328432412 wait complete. 2023-07-12T02:02:11.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.467+0000 7f9c468f6700 1 Processor -- start 2023-07-12T02:02:11.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.467+0000 7f9c468f6700 1 -- start start 2023-07-12T02:02:11.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.467+0000 7f9c468f6700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c4006b120 0x7f9c4013f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:11.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.467+0000 7f9c468f6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c40071b60 0x7f9c401df2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:11.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.467+0000 7f9c468f6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c40147a30 0x7f9c401df7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:11.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.467+0000 7f9c468f6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4013f920 con 0x7f9c40071b60 2023-07-12T02:02:11.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.467+0000 7f9c468f6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c401425e0 con 0x7f9c40147a30 2023-07-12T02:02:11.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.467+0000 7f9c468f6700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c401428c0 con 0x7f9c4006b120 2023-07-12T02:02:11.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.467+0000 7f9c3f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c40071b60 0x7f9c401df2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:11.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.467+0000 7f9c3f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c40071b60 0x7f9c401df2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36626/0 (socket says 172.21.15.60:36626) 2023-07-12T02:02:11.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.467+0000 7f9c3f7fe700 1 -- 172.21.15.60:0/1636367588 learned_addr learned my addr 172.21.15.60:0/1636367588 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:11.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.468+0000 7f9c3ffff700 1 --2- 172.21.15.60:0/1636367588 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c4006b120 0x7f9c4013f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:11.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.468+0000 7f9c44e93700 1 --2- 172.21.15.60:0/1636367588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c40147a30 0x7f9c401df7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:11.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.468+0000 7f9c3f7fe700 1 -- 172.21.15.60:0/1636367588 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c4006b120 msgr2=0x7f9c4013f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:11.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.468+0000 7f9c3f7fe700 1 --2- 172.21.15.60:0/1636367588 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c4006b120 0x7f9c4013f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:11.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.468+0000 7f9c3f7fe700 1 -- 172.21.15.60:0/1636367588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c40147a30 msgr2=0x7f9c401df7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:11.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.468+0000 7f9c3f7fe700 1 --2- 172.21.15.60:0/1636367588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c40147a30 0x7f9c401df7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:11.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.468+0000 7f9c3f7fe700 1 -- 172.21.15.60:0/1636367588 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c3800bc80 con 0x7f9c40071b60 2023-07-12T02:02:11.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.468+0000 7f9c3f7fe700 1 --2- 172.21.15.60:0/1636367588 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c40071b60 0x7f9c401df2a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9c3400c500 tx=0x7f9c3400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:11.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.468+0000 7f9c3cff9700 1 -- 172.21.15.60:0/1636367588 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c34005d70 con 0x7f9c40071b60 2023-07-12T02:02:11.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.468+0000 7f9c3cff9700 1 -- 172.21.15.60:0/1636367588 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c340070d0 con 0x7f9c40071b60 2023-07-12T02:02:11.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.468+0000 7f9c468f6700 1 -- 172.21.15.60:0/1636367588 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c401ded80 con 0x7f9c40071b60 2023-07-12T02:02:11.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.468+0000 7f9c3cff9700 1 -- 172.21.15.60:0/1636367588 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c34007440 con 0x7f9c40071b60 2023-07-12T02:02:11.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.468+0000 7f9c468f6700 1 -- 172.21.15.60:0/1636367588 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c401422b0 con 0x7f9c40071b60 2023-07-12T02:02:11.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.469+0000 7f9c468f6700 1 -- 172.21.15.60:0/1636367588 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c40142440 con 0x7f9c40071b60 2023-07-12T02:02:11.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.470+0000 7f9c3cff9700 1 -- 172.21.15.60:0/1636367588 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9c340075a0 con 0x7f9c40071b60 2023-07-12T02:02:11.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.470+0000 7f9c3cff9700 1 --2- 172.21.15.60:0/1636367588 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f9c2c06ace0 0x7f9c2c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:11.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.470+0000 7f9c3cff9700 1 -- 172.21.15.60:0/1636367588 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f9c34088610 con 0x7f9c40071b60 2023-07-12T02:02:11.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.470+0000 7f9c3ffff700 1 --2- 172.21.15.60:0/1636367588 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f9c2c06ace0 0x7f9c2c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:11.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.471+0000 7f9c3ffff700 1 --2- 172.21.15.60:0/1636367588 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f9c2c06ace0 0x7f9c2c06d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9c30009930 tx=0x7f9c30008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:11.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.475+0000 7f9c3cff9700 1 -- 172.21.15.60:0/1636367588 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f9c40142440 con 0x7f9c40071b60 2023-07-12T02:02:11.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:11.669+0000 7f9c468f6700 1 -- 172.21.15.60:0/1636367588 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f9c40142440 con 0x7f9c40071b60 2023-07-12T02:02:12.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.308+0000 7f9c3cff9700 1 -- 172.21.15.60:0/1636367588 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7f9c40142440 con 0x7f9c40071b60 2023-07-12T02:02:12.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.322+0000 7f9c468f6700 1 -- 172.21.15.60:0/1636367588 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f9c2c06ace0 msgr2=0x7f9c2c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:12.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.322+0000 7f9c468f6700 1 --2- 172.21.15.60:0/1636367588 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f9c2c06ace0 0x7f9c2c06d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9c30009930 tx=0x7f9c30008040 comp rx=0 tx=0).stop 2023-07-12T02:02:12.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.322+0000 7f9c468f6700 1 -- 172.21.15.60:0/1636367588 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c40071b60 msgr2=0x7f9c401df2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:12.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.322+0000 7f9c468f6700 1 --2- 172.21.15.60:0/1636367588 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c40071b60 0x7f9c401df2a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9c3400c500 tx=0x7f9c3400c8c0 comp rx=0 tx=0).stop 2023-07-12T02:02:12.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.323+0000 7f9c468f6700 1 -- 172.21.15.60:0/1636367588 shutdown_connections 2023-07-12T02:02:12.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.323+0000 7f9c468f6700 1 --2- 172.21.15.60:0/1636367588 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f9c2c06ace0 0x7f9c2c06d190 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:12.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.323+0000 7f9c468f6700 1 --2- 172.21.15.60:0/1636367588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c40147a30 0x7f9c401df7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:12.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.323+0000 7f9c468f6700 1 --2- 172.21.15.60:0/1636367588 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c4006b120 0x7f9c4013f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:12.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.323+0000 7f9c468f6700 1 --2- 172.21.15.60:0/1636367588 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c40071b60 0x7f9c401df2a0 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9c3400c500 tx=0x7f9c3400c8c0 comp rx=0 tx=0).stop 2023-07-12T02:02:12.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.323+0000 7f9c468f6700 1 -- 172.21.15.60:0/1636367588 >> 172.21.15.60:0/1636367588 conn(0x7f9c400bd980 msgr2=0x7f9c400babf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:12.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.328+0000 7f9c468f6700 1 -- 172.21.15.60:0/1636367588 shutdown_connections 2023-07-12T02:02:12.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.329+0000 7f9c468f6700 1 -- 172.21.15.60:0/1636367588 wait complete. 2023-07-12T02:02:12.333 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' created 2023-07-12T02:02:12.346 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-12T02:02:12.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.479+0000 7ff10177b700 1 Processor -- start 2023-07-12T02:02:12.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.479+0000 7ff10177b700 1 -- start start 2023-07-12T02:02:12.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.480+0000 7ff10177b700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0fc0b3bf0 0x7ff0fc0b2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:12.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.480+0000 7ff10177b700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0fc071cc0 con 0x7ff0fc0b86d0 2023-07-12T02:02:12.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.480+0000 7ff10177b700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0fc147800 con 0x7ff0fc140d20 2023-07-12T02:02:12.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.480+0000 7ff10177b700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc147ae0 con 0x7ff0fc0b3bf0 2023-07-12T02:02:12.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.480+0000 7ff0faffd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff0fc140d20 0x7ff0fc147000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.60:37032/0 (socket says 172.21.15.60:37032) 2023-07-12T02:02:12.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.480+0000 7ff0fb7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff0fc0b86d0 0x7ff0fc151400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52480/0 (socket says 172.21.15.60:52480) 2023-07-12T02:02:12.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.480+0000 7ff0faffd700 1 -- 172.21.15.60:0/2135653297 learned_addr learned my addr 172.21.15.60:0/2135653297 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:12.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.480+0000 7ff0f3fff700 1 --2- 172.21.15.60:0/2135653297 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0fc0b3bf0 0x7ff0fc0b2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:12.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.480+0000 7ff0fa7fc700 1 -- 172.21.15.60:0/2135653297 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2155532943 0 0) 0x7ff0fc071cc0 con 0x7ff0fc0b86d0 2023-07-12T02:02:12.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.480+0000 7ff0fa7fc700 1 -- 172.21.15.60:0/2135653297 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0e80035b0 con 0x7ff0fc0b86d0 2023-07-12T02:02:12.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.480+0000 7ff0fa7fc700 1 -- 172.21.15.60:0/2135653297 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3445582756 0 0) 0x7ff0fc147800 con 0x7ff0fc140d20 2023-07-12T02:02:12.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.480+0000 7ff0fa7fc700 1 -- 172.21.15.60:0/2135653297 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0fc071cc0 con 0x7ff0fc140d20 2023-07-12T02:02:12.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.481+0000 7ff0fa7fc700 1 -- 172.21.15.60:0/2135653297 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3651360492 0 0) 0x7ff0e80035b0 con 0x7ff0fc0b86d0 2023-07-12T02:02:12.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.481+0000 7ff0f3fff700 1 -- 172.21.15.60:0/2135653297 >> v1:172.21.15.79:6789/0 conn(0x7ff0fc140d20 legacy=0x7ff0fc147000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:12.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.481+0000 7ff0f3fff700 1 -- 172.21.15.60:0/2135653297 >> v1:172.21.15.60:6789/0 conn(0x7ff0fc0b86d0 legacy=0x7ff0fc151400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:12.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.481+0000 7ff0f3fff700 1 -- 172.21.15.60:0/2135653297 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0fc0b1f00 con 0x7ff0fc0b3bf0 2023-07-12T02:02:12.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.481+0000 7ff0f3fff700 1 --2- 172.21.15.60:0/2135653297 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0fc0b3bf0 0x7ff0fc0b2700 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4009870 tx=0x7ff0e4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=813f00b599956515 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:12.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.481+0000 7ff0fa7fc700 1 -- 172.21.15.60:0/2135653297 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f40019f0 con 0x7ff0fc0b3bf0 2023-07-12T02:02:12.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.481+0000 7ff0fa7fc700 1 -- 172.21.15.60:0/2135653297 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e4004030 con 0x7ff0fc0b3bf0 2023-07-12T02:02:12.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.481+0000 7ff0fa7fc700 1 -- 172.21.15.60:0/2135653297 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e40043c0 con 0x7ff0fc0b3bf0 2023-07-12T02:02:12.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.481+0000 7ff10177b700 1 -- 172.21.15.60:0/2135653297 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0fc0b3bf0 msgr2=0x7ff0fc0b2700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:12.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.481+0000 7ff10177b700 1 --2- 172.21.15.60:0/2135653297 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0fc0b3bf0 0x7ff0fc0b2700 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4009870 tx=0x7ff0e4009b80 comp rx=0 tx=0).stop 2023-07-12T02:02:12.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.482+0000 7ff10177b700 1 -- 172.21.15.60:0/2135653297 shutdown_connections 2023-07-12T02:02:12.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.482+0000 7ff10177b700 1 --2- 172.21.15.60:0/2135653297 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0fc0b3bf0 0x7ff0fc0b2700 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:12.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.482+0000 7ff10177b700 1 -- 172.21.15.60:0/2135653297 >> 172.21.15.60:0/2135653297 conn(0x7ff0fc0b97c0 msgr2=0x7ff0fc0b9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:12.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.482+0000 7ff10177b700 1 -- 172.21.15.60:0/2135653297 shutdown_connections 2023-07-12T02:02:12.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.482+0000 7ff10177b700 1 -- 172.21.15.60:0/2135653297 wait complete. 2023-07-12T02:02:12.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.483+0000 7ff10177b700 1 Processor -- start 2023-07-12T02:02:12.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.483+0000 7ff10177b700 1 -- start start 2023-07-12T02:02:12.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.484+0000 7ff10177b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0fc0b3bf0 0x7ff0fc145b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:12.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.484+0000 7ff10177b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0fc0b86d0 0x7ff0fc1e0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:12.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.484+0000 7ff10177b700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0fc140d20 0x7ff0fc1e0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:12.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.484+0000 7ff10177b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc146050 con 0x7ff0fc0b3bf0 2023-07-12T02:02:12.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.484+0000 7ff10177b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc148cf0 con 0x7ff0fc0b86d0 2023-07-12T02:02:12.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.484+0000 7ff10177b700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc1499e0 con 0x7ff0fc140d20 2023-07-12T02:02:12.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.484+0000 7ff0faffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0fc0b3bf0 0x7ff0fc145b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:12.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.484+0000 7ff0faffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0fc0b3bf0 0x7ff0fc145b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36640/0 (socket says 172.21.15.60:36640) 2023-07-12T02:02:12.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.484+0000 7ff0faffd700 1 -- 172.21.15.60:0/92208773 learned_addr learned my addr 172.21.15.60:0/92208773 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:12.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.484+0000 7ff0f3fff700 1 --2- 172.21.15.60:0/92208773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0fc0b86d0 0x7ff0fc1e0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:12.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.484+0000 7ff0fb7fe700 1 --2- 172.21.15.60:0/92208773 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0fc140d20 0x7ff0fc1e0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:12.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.484+0000 7ff0faffd700 1 -- 172.21.15.60:0/92208773 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0fc140d20 msgr2=0x7ff0fc1e0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:12.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.484+0000 7ff0faffd700 1 --2- 172.21.15.60:0/92208773 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0fc140d20 0x7ff0fc1e0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:12.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.484+0000 7ff0faffd700 1 -- 172.21.15.60:0/92208773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0fc0b86d0 msgr2=0x7ff0fc1e0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:12.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.484+0000 7ff0faffd700 1 --2- 172.21.15.60:0/92208773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0fc0b86d0 0x7ff0fc1e0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:12.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.484+0000 7ff0faffd700 1 -- 172.21.15.60:0/92208773 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e40094a0 con 0x7ff0fc0b3bf0 2023-07-12T02:02:12.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.484+0000 7ff0f3fff700 1 --2- 172.21.15.60:0/92208773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0fc0b86d0 0x7ff0fc1e0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:02:12.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.485+0000 7ff0faffd700 1 --2- 172.21.15.60:0/92208773 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0fc0b3bf0 0x7ff0fc145b10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec00c4d0 tx=0x7ff0ec00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:12.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.485+0000 7ff0f37fe700 1 -- 172.21.15.60:0/92208773 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec005d70 con 0x7ff0fc0b3bf0 2023-07-12T02:02:12.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.485+0000 7ff0f37fe700 1 -- 172.21.15.60:0/92208773 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0ec0070d0 con 0x7ff0fc0b3bf0 2023-07-12T02:02:12.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.485+0000 7ff10177b700 1 -- 172.21.15.60:0/92208773 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0fc147dc0 con 0x7ff0fc0b3bf0 2023-07-12T02:02:12.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.485+0000 7ff0f37fe700 1 -- 172.21.15.60:0/92208773 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec007460 con 0x7ff0fc0b3bf0 2023-07-12T02:02:12.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.485+0000 7ff10177b700 1 -- 172.21.15.60:0/92208773 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0fc148360 con 0x7ff0fc0b3bf0 2023-07-12T02:02:12.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.486+0000 7ff10177b700 1 -- 172.21.15.60:0/92208773 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0fc074360 con 0x7ff0fc0b3bf0 2023-07-12T02:02:12.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.486+0000 7ff0f37fe700 1 -- 172.21.15.60:0/92208773 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff0ec0075c0 con 0x7ff0fc0b3bf0 2023-07-12T02:02:12.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.487+0000 7ff0f37fe700 1 --2- 172.21.15.60:0/92208773 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ff0dc06ace0 0x7ff0dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:12.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.487+0000 7ff0f37fe700 1 -- 172.21.15.60:0/92208773 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5962+0+0 (secure 0 0 0) 0x7ff0ec088930 con 0x7ff0fc0b3bf0 2023-07-12T02:02:12.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.487+0000 7ff0f3fff700 1 --2- 172.21.15.60:0/92208773 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ff0dc06ace0 0x7ff0dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:12.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.487+0000 7ff0f3fff700 1 --2- 172.21.15.60:0/92208773 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ff0dc06ace0 0x7ff0dc06d190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc13ee00 tx=0x7ff0e4008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:12.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.492+0000 7ff0f37fe700 1 -- 172.21.15.60:0/92208773 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7ff0ec053a40 con 0x7ff0fc0b3bf0 2023-07-12T02:02:12.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:12.732+0000 7ff10177b700 1 -- 172.21.15.60:0/92208773 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff0fc0b7170 con 0x7ff0fc0b3bf0 2023-07-12T02:02:13.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.312+0000 7ff0f37fe700 1 -- 172.21.15.60:0/92208773 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7ff0ec057060 con 0x7ff0fc0b3bf0 2023-07-12T02:02:13.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.318+0000 7ff10177b700 1 -- 172.21.15.60:0/92208773 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ff0dc06ace0 msgr2=0x7ff0dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:13.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.318+0000 7ff10177b700 1 --2- 172.21.15.60:0/92208773 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ff0dc06ace0 0x7ff0dc06d190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc13ee00 tx=0x7ff0e4008030 comp rx=0 tx=0).stop 2023-07-12T02:02:13.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.318+0000 7ff10177b700 1 -- 172.21.15.60:0/92208773 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0fc0b3bf0 msgr2=0x7ff0fc145b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:13.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.318+0000 7ff10177b700 1 --2- 172.21.15.60:0/92208773 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0fc0b3bf0 0x7ff0fc145b10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec00c4d0 tx=0x7ff0ec00c890 comp rx=0 tx=0).stop 2023-07-12T02:02:13.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.321+0000 7ff10177b700 1 -- 172.21.15.60:0/92208773 shutdown_connections 2023-07-12T02:02:13.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.321+0000 7ff10177b700 1 --2- 172.21.15.60:0/92208773 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ff0dc06ace0 0x7ff0dc06d190 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:13.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.321+0000 7ff10177b700 1 --2- 172.21.15.60:0/92208773 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0fc0b3bf0 0x7ff0fc145b10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:13.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.321+0000 7ff10177b700 1 --2- 172.21.15.60:0/92208773 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0fc140d20 0x7ff0fc1e0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:13.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.321+0000 7ff10177b700 1 --2- 172.21.15.60:0/92208773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0fc0b86d0 0x7ff0fc1e0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:13.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.321+0000 7ff10177b700 1 -- 172.21.15.60:0/92208773 >> 172.21.15.60:0/92208773 conn(0x7ff0fc0b97c0 msgr2=0x7ff0fc140290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:13.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.323+0000 7ff10177b700 1 -- 172.21.15.60:0/92208773 shutdown_connections 2023-07-12T02:02:13.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.323+0000 7ff10177b700 1 -- 172.21.15.60:0/92208773 wait complete. 2023-07-12T02:02:13.341 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 3 and data pool 4 2023-07-12T02:02:13.354 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:02:13.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.482+0000 7fc5a0c3d700 1 Processor -- start 2023-07-12T02:02:13.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.482+0000 7fc5a0c3d700 1 -- start start 2023-07-12T02:02:13.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.483+0000 7fc5a0c3d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc59c06b120 0x7fc59c071350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:13.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.483+0000 7fc5a0c3d700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc59c0b5fc0 0x7fc59c0b6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:13.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.483+0000 7fc5a0c3d700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc59c0b7180 con 0x7fc59c0ba160 2023-07-12T02:02:13.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.483+0000 7fc5a0c3d700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc59c0b90b0 con 0x7fc59c06b120 2023-07-12T02:02:13.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.483+0000 7fc5a0c3d700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c0b6980 con 0x7fc59c0b5fc0 2023-07-12T02:02:13.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.483+0000 7fc59ad9d700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc59c0b5fc0 0x7fc59c0b6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:13.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.483+0000 7fc59a59c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc59c06b120 0x7fc59c071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:13.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.483+0000 7fc59ad9d700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc59c0b5fc0 0x7fc59c0b6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.60:52448/0 (socket says 172.21.15.60:52448) 2023-07-12T02:02:13.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.483+0000 7fc59ad9d700 1 -- 172.21.15.60:0/2471926859 learned_addr learned my addr 172.21.15.60:0/2471926859 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:13.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.483+0000 7fc59ad9d700 1 -- 172.21.15.60:0/2471926859 >> v2:172.21.15.79:3300/0 conn(0x7fc59c06b120 msgr2=0x7fc59c071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:13.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.483+0000 7fc59ad9d700 1 --2- 172.21.15.60:0/2471926859 >> v2:172.21.15.79:3300/0 conn(0x7fc59c06b120 0x7fc59c071350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:13.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.483+0000 7fc59ad9d700 1 -- 172.21.15.60:0/2471926859 >> v1:172.21.15.79:6789/0 conn(0x7fc59c0ba160 legacy=0x7fc59c1485e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:13.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.483+0000 7fc59ad9d700 1 -- 172.21.15.60:0/2471926859 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc59c071070 con 0x7fc59c0b5fc0 2023-07-12T02:02:13.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.484+0000 7fc59ad9d700 1 --2- 172.21.15.60:0/2471926859 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc59c0b5fc0 0x7fc59c0b6440 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc594009e50 tx=0x7fc59400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fafd273e186c1c server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:13.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.484+0000 7fc599d9b700 1 -- 172.21.15.60:0/2471926859 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59400e070 con 0x7fc59c0b5fc0 2023-07-12T02:02:13.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.484+0000 7fc599d9b700 1 -- 172.21.15.60:0/2471926859 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc59400b910 con 0x7fc59c0b5fc0 2023-07-12T02:02:13.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.484+0000 7fc599d9b700 1 -- 172.21.15.60:0/2471926859 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59400bcc0 con 0x7fc59c0b5fc0 2023-07-12T02:02:13.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.484+0000 7fc5a0c3d700 1 -- 172.21.15.60:0/2471926859 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc59c0b5fc0 msgr2=0x7fc59c0b6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:13.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.484+0000 7fc5a0c3d700 1 --2- 172.21.15.60:0/2471926859 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc59c0b5fc0 0x7fc59c0b6440 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc594009e50 tx=0x7fc59400b330 comp rx=0 tx=0).stop 2023-07-12T02:02:13.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.484+0000 7fc5a0c3d700 1 -- 172.21.15.60:0/2471926859 shutdown_connections 2023-07-12T02:02:13.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.484+0000 7fc5a0c3d700 1 --2- 172.21.15.60:0/2471926859 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc59c0b5fc0 0x7fc59c0b6440 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:13.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.484+0000 7fc5a0c3d700 1 --2- 172.21.15.60:0/2471926859 >> v2:172.21.15.79:3300/0 conn(0x7fc59c06b120 0x7fc59c071350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:13.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.484+0000 7fc5a0c3d700 1 -- 172.21.15.60:0/2471926859 >> 172.21.15.60:0/2471926859 conn(0x7fc59c0bd980 msgr2=0x7fc59c0b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:13.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.484+0000 7fc5a0c3d700 1 -- 172.21.15.60:0/2471926859 shutdown_connections 2023-07-12T02:02:13.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.484+0000 7fc5a0c3d700 1 -- 172.21.15.60:0/2471926859 wait complete. 2023-07-12T02:02:13.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.486+0000 7fc5a0c3d700 1 Processor -- start 2023-07-12T02:02:13.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.486+0000 7fc5a0c3d700 1 -- start start 2023-07-12T02:02:13.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.486+0000 7fc5a0c3d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc59c06b120 0x7fc59c13f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:13.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.486+0000 7fc5a0c3d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc59c0b5fc0 0x7fc59c146440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:13.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.486+0000 7fc5a0c3d700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc59c0ba160 0x7fc59c13cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:13.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.486+0000 7fc5a0c3d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c1d0f50 con 0x7fc59c0b5fc0 2023-07-12T02:02:13.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.486+0000 7fc5a0c3d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c1d1230 con 0x7fc59c06b120 2023-07-12T02:02:13.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.486+0000 7fc5a0c3d700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c1483e0 con 0x7fc59c0ba160 2023-07-12T02:02:13.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.486+0000 7fc593fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc59c0b5fc0 0x7fc59c146440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:13.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.486+0000 7fc593fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc59c0b5fc0 0x7fc59c146440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36652/0 (socket says 172.21.15.60:36652) 2023-07-12T02:02:13.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.486+0000 7fc59a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc59c06b120 0x7fc59c13f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:13.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.486+0000 7fc593fff700 1 -- 172.21.15.60:0/437269637 learned_addr learned my addr 172.21.15.60:0/437269637 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:13.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.486+0000 7fc59ad9d700 1 --2- 172.21.15.60:0/437269637 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc59c0ba160 0x7fc59c13cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:13.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.487+0000 7fc593fff700 1 -- 172.21.15.60:0/437269637 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc59c0ba160 msgr2=0x7fc59c13cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:13.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.487+0000 7fc593fff700 1 --2- 172.21.15.60:0/437269637 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc59c0ba160 0x7fc59c13cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:13.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.487+0000 7fc593fff700 1 -- 172.21.15.60:0/437269637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc59c06b120 msgr2=0x7fc59c13f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:13.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.487+0000 7fc593fff700 1 --2- 172.21.15.60:0/437269637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc59c06b120 0x7fc59c13f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:13.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.487+0000 7fc593fff700 1 -- 172.21.15.60:0/437269637 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc594009b30 con 0x7fc59c0b5fc0 2023-07-12T02:02:13.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.487+0000 7fc593fff700 1 --2- 172.21.15.60:0/437269637 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc59c0b5fc0 0x7fc59c146440 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc58400c450 tx=0x7fc58400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:13.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.487+0000 7fc592ffd700 1 -- 172.21.15.60:0/437269637 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5840052d0 con 0x7fc59c0b5fc0 2023-07-12T02:02:13.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.487+0000 7fc592ffd700 1 -- 172.21.15.60:0/437269637 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc584005430 con 0x7fc59c0b5fc0 2023-07-12T02:02:13.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.487+0000 7fc5a0c3d700 1 -- 172.21.15.60:0/437269637 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc59c1dd4b0 con 0x7fc59c0b5fc0 2023-07-12T02:02:13.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.487+0000 7fc592ffd700 1 -- 172.21.15.60:0/437269637 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5840038c0 con 0x7fc59c0b5fc0 2023-07-12T02:02:13.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.487+0000 7fc5a0c3d700 1 -- 172.21.15.60:0/437269637 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc59c148040 con 0x7fc59c0b5fc0 2023-07-12T02:02:13.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.488+0000 7fc5a0c3d700 1 -- 172.21.15.60:0/437269637 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc59c1d13a0 con 0x7fc59c0b5fc0 2023-07-12T02:02:13.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.489+0000 7fc592ffd700 1 -- 172.21.15.60:0/437269637 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc584003a20 con 0x7fc59c0b5fc0 2023-07-12T02:02:13.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.489+0000 7fc592ffd700 1 --2- 172.21.15.60:0/437269637 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc57c06ace0 0x7fc57c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:13.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.489+0000 7fc592ffd700 1 -- 172.21.15.60:0/437269637 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc584088710 con 0x7fc59c0b5fc0 2023-07-12T02:02:13.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.490+0000 7fc59a59c700 1 --2- 172.21.15.60:0/437269637 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc57c06ace0 0x7fc57c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:13.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.490+0000 7fc59a59c700 1 --2- 172.21.15.60:0/437269637 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc57c06ace0 0x7fc57c06d190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc58c009be0 tx=0x7fc58c009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:13.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.494+0000 7fc592ffd700 1 -- 172.21.15.60:0/437269637 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fc584053850 con 0x7fc59c0b5fc0 2023-07-12T02:02:13.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.694+0000 7fc5a0c3d700 1 -- 172.21.15.60:0/437269637 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc59c13ee50 con 0x7fc59c0b5fc0 2023-07-12T02:02:13.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.695+0000 7fc592ffd700 1 -- 172.21.15.60:0/437269637 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+18186 (secure 0 0 0) 0x7fc58400ce60 con 0x7fc59c0b5fc0 2023-07-12T02:02:13.698 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:02:13.699 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":20,"fsid":"97e7c909-e567-472e-a5aa-72fde15171f2","created":"2023-07-12T02:01:53.987086+0000","modified":"2023-07-12T02:02:12.733606+0000","last_up_change":"2023-07-12T02:02:04.031780+0000","last_in_change":"2023-07-12T02:01:56.538621+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-12T02:02:05.375042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-12T02:02:05.857441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:02:10.574633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-12T02:02:11.699872+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ed8b71c2-3895-4952-a118-16ede0b4a98c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6801","nonce":2818935979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6803","nonce":2818935979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6807","nonce":2818935979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6805","nonce":2818935979}]},"public_addr":"172.21.15.60:6801/2818935979","cluster_addr":"172.21.15.60:6803/2818935979","heartbeat_back_addr":"172.21.15.60:6807/2818935979","heartbeat_front_addr":"172.21.15.60:6805/2818935979","state":["exists","up"]},{"osd":1,"uuid":"7cf4d354-78e0-43ce-8c09-4a7d2a0b57a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6817","nonce":1678864191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6819","nonce":1678864191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6823","nonce":1678864191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6821","nonce":1678864191}]},"public_addr":"172.21.15.60:6817/1678864191","cluster_addr":"172.21.15.60:6819/1678864191","heartbeat_back_addr":"172.21.15.60:6823/1678864191","heartbeat_front_addr":"172.21.15.60:6821/1678864191","state":["exists","up"]},{"osd":2,"uuid":"02c958b8-9599-4470-92cb-8f7018ec0189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6809","nonce":1459480680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6811","nonce":1459480680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6815","nonce":1459480680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6813","nonce":1459480680}]},"public_addr":"172.21.15.60:6809/1459480680","cluster_addr":"172.21.15.60:6811/1459480680","heartbeat_back_addr":"172.21.15.60:6815/1459480680","heartbeat_front_addr":"172.21.15.60:6813/1459480680","state":["exists","up"]},{"osd":3,"uuid":"bc300432-a228-4257-be5c-e42dd5f2015f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6825","nonce":3295100060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6827","nonce":3295100060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6831","nonce":3295100060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6829","nonce":3295100060}]},"public_addr":"172.21.15.60:6825/3295100060","cluster_addr":"172.21.15.60:6827/3295100060","heartbeat_back_addr":"172.21.15.60:6831/3295100060","heartbeat_front_addr":"172.21.15.60:6829/3295100060","state":["exists","up"]},{"osd":4,"uuid":"ad9f7dc4-7126-466d-a656-2844880c6060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6809","nonce":4127109138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6811","nonce":4127109138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6815","nonce":4127109138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6813","nonce":4127109138}]},"public_addr":"172.21.15.79:6809/4127109138","cluster_addr":"172.21.15.79:6811/4127109138","heartbeat_back_addr":"172.21.15.79:6815/4127109138","heartbeat_front_addr":"172.21.15.79:6813/4127109138","state":["exists","up"]},{"osd":5,"uuid":"e88d16ca-0b01-4ab9-8aa8-c4aff7f210f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6801","nonce":421449406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6803","nonce":421449406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6807","nonce":421449406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6805","nonce":421449406}]},"public_addr":"172.21.15.79:6801/421449406","cluster_addr":"172.21.15.79:6803/421449406","heartbeat_back_addr":"172.21.15.79:6807/421449406","heartbeat_front_addr":"172.21.15.79:6805/421449406","state":["exists","up"]},{"osd":6,"uuid":"6898cb84-56d1-48a9-bd45-97e4668e2fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6825","nonce":4144355139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6827","nonce":4144355139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6831","nonce":4144355139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6829","nonce":4144355139}]},"public_addr":"172.21.15.79:6825/4144355139","cluster_addr":"172.21.15.79:6827/4144355139","heartbeat_back_addr":"172.21.15.79:6831/4144355139","heartbeat_front_addr":"172.21.15.79:6829/4144355139","state":["exists","up"]},{"osd":7,"uuid":"65c10882-371e-4762-b384-9c3a48f332ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6817","nonce":2845223299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6819","nonce":2845223299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6823","nonce":2845223299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6821","nonce":2845223299}]},"public_addr":"172.21.15.79:6817/2845223299","cluster_addr":"172.21.15.79:6819/2845223299","heartbeat_back_addr":"172.21.15.79:6823/2845223299","heartbeat_front_addr":"172.21.15.79:6821/2845223299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.634716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.758349+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.728366+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.777395+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707262+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.649705+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.693021+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:02:13.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.697+0000 7fc5a0c3d700 1 -- 172.21.15.60:0/437269637 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc57c06ace0 msgr2=0x7fc57c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:13.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.697+0000 7fc5a0c3d700 1 --2- 172.21.15.60:0/437269637 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc57c06ace0 0x7fc57c06d190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc58c009be0 tx=0x7fc58c009210 comp rx=0 tx=0).stop 2023-07-12T02:02:13.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.697+0000 7fc5a0c3d700 1 -- 172.21.15.60:0/437269637 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc59c0b5fc0 msgr2=0x7fc59c146440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:13.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.697+0000 7fc5a0c3d700 1 --2- 172.21.15.60:0/437269637 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc59c0b5fc0 0x7fc59c146440 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc58400c450 tx=0x7fc58400c760 comp rx=0 tx=0).stop 2023-07-12T02:02:13.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.697+0000 7fc5a0c3d700 1 -- 172.21.15.60:0/437269637 shutdown_connections 2023-07-12T02:02:13.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.697+0000 7fc5a0c3d700 1 --2- 172.21.15.60:0/437269637 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc57c06ace0 0x7fc57c06d190 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:13.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.697+0000 7fc5a0c3d700 1 --2- 172.21.15.60:0/437269637 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc59c0ba160 0x7fc59c13cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:13.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.697+0000 7fc5a0c3d700 1 --2- 172.21.15.60:0/437269637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc59c06b120 0x7fc59c13f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:13.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.697+0000 7fc5a0c3d700 1 --2- 172.21.15.60:0/437269637 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc59c0b5fc0 0x7fc59c146440 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:13.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.697+0000 7fc5a0c3d700 1 -- 172.21.15.60:0/437269637 >> 172.21.15.60:0/437269637 conn(0x7fc59c0bd980 msgr2=0x7fc59c0b7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:13.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.697+0000 7fc5a0c3d700 1 -- 172.21.15.60:0/437269637 shutdown_connections 2023-07-12T02:02:13.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.697+0000 7fc5a0c3d700 1 -- 172.21.15.60:0/437269637 wait complete. 2023-07-12T02:02:13.713 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:02:13.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.836+0000 7f611e0ff700 1 Processor -- start 2023-07-12T02:02:13.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.836+0000 7f611e0ff700 1 -- start start 2023-07-12T02:02:13.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.836+0000 7f611e0ff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6118147dc0 0x7f61180721e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:13.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.836+0000 7f611e0ff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f611806f680 con 0x7f6118069f30 2023-07-12T02:02:13.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.836+0000 7f611e0ff700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f611806f920 con 0x7f6118071840 2023-07-12T02:02:13.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.836+0000 7f611e0ff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6118070950 con 0x7f6118147dc0 2023-07-12T02:02:13.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.836+0000 7f61177fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6118147dc0 0x7f61180721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:13.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.836+0000 7f610ffff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f6118069f30 0x7f6118071130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52492/0 (socket says 172.21.15.60:52492) 2023-07-12T02:02:13.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.836+0000 7f610ffff700 1 -- 172.21.15.60:0/1723710127 learned_addr learned my addr 172.21.15.60:0/1723710127 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:13.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.837+0000 7f61177fe700 1 -- 172.21.15.60:0/1723710127 >> v1:172.21.15.79:6789/0 conn(0x7f6118071840 legacy=0x7f6118154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:13.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.837+0000 7f61177fe700 1 -- 172.21.15.60:0/1723710127 >> v1:172.21.15.60:6789/0 conn(0x7f6118069f30 legacy=0x7f6118071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:13.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.837+0000 7f61177fe700 1 -- 172.21.15.60:0/1723710127 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61180b9660 con 0x7f6118147dc0 2023-07-12T02:02:13.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.837+0000 7f6116ffd700 1 -- 172.21.15.60:0/1723710127 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1629373459 0 0) 0x7f611806f680 con 0x7f6118069f30 2023-07-12T02:02:13.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.837+0000 7f61177fe700 1 --2- 172.21.15.60:0/1723710127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6118147dc0 0x7f61180721e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6108009840 tx=0x7f6108009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ca5406d57bd0730 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:13.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.837+0000 7f6116ffd700 1 -- 172.21.15.60:0/1723710127 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6108011830 con 0x7f6118147dc0 2023-07-12T02:02:13.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.837+0000 7f6116ffd700 1 -- 172.21.15.60:0/1723710127 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6108011990 con 0x7f6118147dc0 2023-07-12T02:02:13.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.837+0000 7f6116ffd700 1 -- 172.21.15.60:0/1723710127 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6108011d20 con 0x7f6118147dc0 2023-07-12T02:02:13.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.838+0000 7f611e0ff700 1 -- 172.21.15.60:0/1723710127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6118147dc0 msgr2=0x7f61180721e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:13.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.838+0000 7f611e0ff700 1 --2- 172.21.15.60:0/1723710127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6118147dc0 0x7f61180721e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6108009840 tx=0x7f6108009b50 comp rx=0 tx=0).stop 2023-07-12T02:02:13.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.838+0000 7f611e0ff700 1 -- 172.21.15.60:0/1723710127 shutdown_connections 2023-07-12T02:02:13.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.838+0000 7f611e0ff700 1 --2- 172.21.15.60:0/1723710127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6118147dc0 0x7f61180721e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:13.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.838+0000 7f611e0ff700 1 -- 172.21.15.60:0/1723710127 >> 172.21.15.60:0/1723710127 conn(0x7f611806d0e0 msgr2=0x7f611806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:13.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.838+0000 7f611e0ff700 1 -- 172.21.15.60:0/1723710127 shutdown_connections 2023-07-12T02:02:13.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.838+0000 7f611e0ff700 1 -- 172.21.15.60:0/1723710127 wait complete. 2023-07-12T02:02:13.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.839+0000 7f611e0ff700 1 Processor -- start 2023-07-12T02:02:13.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.839+0000 7f611e0ff700 1 -- start start 2023-07-12T02:02:13.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.839+0000 7f611e0ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6118069f30 0x7f611813fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:13.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.839+0000 7f611e0ff700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6118071840 0x7f61181e0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:13.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.839+0000 7f611e0ff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6118147dc0 0x7f611813d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:13.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.839+0000 7f611e0ff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61181400b0 con 0x7f6118147dc0 2023-07-12T02:02:13.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.839+0000 7f611e0ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61181dff30 con 0x7f6118069f30 2023-07-12T02:02:13.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.839+0000 7f611e0ff700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61181e01d0 con 0x7f6118071840 2023-07-12T02:02:13.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.840+0000 7f6117fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6118147dc0 0x7f611813d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:13.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.840+0000 7f6117fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6118147dc0 0x7f611813d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36670/0 (socket says 172.21.15.60:36670) 2023-07-12T02:02:13.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.840+0000 7f6117fff700 1 -- 172.21.15.60:0/749567809 learned_addr learned my addr 172.21.15.60:0/749567809 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:13.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.840+0000 7f61177fe700 1 --2- 172.21.15.60:0/749567809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6118069f30 0x7f611813fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:13.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.840+0000 7f610ffff700 1 --2- 172.21.15.60:0/749567809 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6118071840 0x7f61181e0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:13.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.840+0000 7f6117fff700 1 -- 172.21.15.60:0/749567809 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6118071840 msgr2=0x7f61181e0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:13.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.840+0000 7f6117fff700 1 --2- 172.21.15.60:0/749567809 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6118071840 0x7f61181e0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:13.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.840+0000 7f6117fff700 1 -- 172.21.15.60:0/749567809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6118069f30 msgr2=0x7f611813fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:13.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.840+0000 7f6117fff700 1 --2- 172.21.15.60:0/749567809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6118069f30 0x7f611813fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:13.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.840+0000 7f6117fff700 1 -- 172.21.15.60:0/749567809 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61080094a0 con 0x7f6118147dc0 2023-07-12T02:02:13.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.840+0000 7f6117fff700 1 --2- 172.21.15.60:0/749567809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6118147dc0 0x7f611813d910 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f611000cc80 tx=0x7f611000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:13.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.840+0000 7f6114ff9700 1 -- 172.21.15.60:0/749567809 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6110003c00 con 0x7f6118147dc0 2023-07-12T02:02:13.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.840+0000 7f6114ff9700 1 -- 172.21.15.60:0/749567809 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6110003d60 con 0x7f6118147dc0 2023-07-12T02:02:13.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.840+0000 7f611e0ff700 1 -- 172.21.15.60:0/749567809 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61180b58a0 con 0x7f6118147dc0 2023-07-12T02:02:13.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.840+0000 7f6114ff9700 1 -- 172.21.15.60:0/749567809 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611000aaa0 con 0x7f6118147dc0 2023-07-12T02:02:13.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.840+0000 7f611e0ff700 1 -- 172.21.15.60:0/749567809 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6118141480 con 0x7f6118147dc0 2023-07-12T02:02:13.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.841+0000 7f611e0ff700 1 -- 172.21.15.60:0/749567809 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6118074360 con 0x7f6118147dc0 2023-07-12T02:02:13.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.842+0000 7f6114ff9700 1 -- 172.21.15.60:0/749567809 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f611000ac00 con 0x7f6118147dc0 2023-07-12T02:02:13.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.842+0000 7f6114ff9700 1 --2- 172.21.15.60:0/749567809 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f60f806ace0 0x7f60f806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:13.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.842+0000 7f6114ff9700 1 -- 172.21.15.60:0/749567809 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f61100893f0 con 0x7f6118147dc0 2023-07-12T02:02:13.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.842+0000 7f61177fe700 1 --2- 172.21.15.60:0/749567809 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f60f806ace0 0x7f60f806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:13.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.843+0000 7f61177fe700 1 --2- 172.21.15.60:0/749567809 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f60f806ace0 0x7f60f806d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f61080090b0 tx=0x7f610801c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:13.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:13.847+0000 7f6114ff9700 1 -- 172.21.15.60:0/749567809 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f61100544a0 con 0x7f6118147dc0 2023-07-12T02:02:14.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.044+0000 7f611e0ff700 1 -- 172.21.15.60:0/749567809 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f61181e0310 con 0x7f6118147dc0 2023-07-12T02:02:14.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.046+0000 7f6114ff9700 1 -- 172.21.15.60:0/749567809 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+18186 (secure 0 0 0) 0x7f6110057ac0 con 0x7f6118147dc0 2023-07-12T02:02:14.049 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:02:14.049 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":20,"fsid":"97e7c909-e567-472e-a5aa-72fde15171f2","created":"2023-07-12T02:01:53.987086+0000","modified":"2023-07-12T02:02:12.733606+0000","last_up_change":"2023-07-12T02:02:04.031780+0000","last_in_change":"2023-07-12T02:01:56.538621+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-12T02:02:05.375042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-12T02:02:05.857441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:02:10.574633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-12T02:02:11.699872+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ed8b71c2-3895-4952-a118-16ede0b4a98c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6801","nonce":2818935979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6803","nonce":2818935979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6807","nonce":2818935979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6805","nonce":2818935979}]},"public_addr":"172.21.15.60:6801/2818935979","cluster_addr":"172.21.15.60:6803/2818935979","heartbeat_back_addr":"172.21.15.60:6807/2818935979","heartbeat_front_addr":"172.21.15.60:6805/2818935979","state":["exists","up"]},{"osd":1,"uuid":"7cf4d354-78e0-43ce-8c09-4a7d2a0b57a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6817","nonce":1678864191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6819","nonce":1678864191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6823","nonce":1678864191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6821","nonce":1678864191}]},"public_addr":"172.21.15.60:6817/1678864191","cluster_addr":"172.21.15.60:6819/1678864191","heartbeat_back_addr":"172.21.15.60:6823/1678864191","heartbeat_front_addr":"172.21.15.60:6821/1678864191","state":["exists","up"]},{"osd":2,"uuid":"02c958b8-9599-4470-92cb-8f7018ec0189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6809","nonce":1459480680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6811","nonce":1459480680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6815","nonce":1459480680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6813","nonce":1459480680}]},"public_addr":"172.21.15.60:6809/1459480680","cluster_addr":"172.21.15.60:6811/1459480680","heartbeat_back_addr":"172.21.15.60:6815/1459480680","heartbeat_front_addr":"172.21.15.60:6813/1459480680","state":["exists","up"]},{"osd":3,"uuid":"bc300432-a228-4257-be5c-e42dd5f2015f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6825","nonce":3295100060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6827","nonce":3295100060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6831","nonce":3295100060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6829","nonce":3295100060}]},"public_addr":"172.21.15.60:6825/3295100060","cluster_addr":"172.21.15.60:6827/3295100060","heartbeat_back_addr":"172.21.15.60:6831/3295100060","heartbeat_front_addr":"172.21.15.60:6829/3295100060","state":["exists","up"]},{"osd":4,"uuid":"ad9f7dc4-7126-466d-a656-2844880c6060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6809","nonce":4127109138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6811","nonce":4127109138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6815","nonce":4127109138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6813","nonce":4127109138}]},"public_addr":"172.21.15.79:6809/4127109138","cluster_addr":"172.21.15.79:6811/4127109138","heartbeat_back_addr":"172.21.15.79:6815/4127109138","heartbeat_front_addr":"172.21.15.79:6813/4127109138","state":["exists","up"]},{"osd":5,"uuid":"e88d16ca-0b01-4ab9-8aa8-c4aff7f210f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6801","nonce":421449406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6803","nonce":421449406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6807","nonce":421449406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6805","nonce":421449406}]},"public_addr":"172.21.15.79:6801/421449406","cluster_addr":"172.21.15.79:6803/421449406","heartbeat_back_addr":"172.21.15.79:6807/421449406","heartbeat_front_addr":"172.21.15.79:6805/421449406","state":["exists","up"]},{"osd":6,"uuid":"6898cb84-56d1-48a9-bd45-97e4668e2fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6825","nonce":4144355139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6827","nonce":4144355139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6831","nonce":4144355139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6829","nonce":4144355139}]},"public_addr":"172.21.15.79:6825/4144355139","cluster_addr":"172.21.15.79:6827/4144355139","heartbeat_back_addr":"172.21.15.79:6831/4144355139","heartbeat_front_addr":"172.21.15.79:6829/4144355139","state":["exists","up"]},{"osd":7,"uuid":"65c10882-371e-4762-b384-9c3a48f332ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6817","nonce":2845223299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6819","nonce":2845223299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6823","nonce":2845223299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6821","nonce":2845223299}]},"public_addr":"172.21.15.79:6817/2845223299","cluster_addr":"172.21.15.79:6819/2845223299","heartbeat_back_addr":"172.21.15.79:6823/2845223299","heartbeat_front_addr":"172.21.15.79:6821/2845223299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.634716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.758349+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.728366+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.777395+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707262+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.649705+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.693021+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:02:14.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.048+0000 7f611e0ff700 1 -- 172.21.15.60:0/749567809 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f60f806ace0 msgr2=0x7f60f806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:14.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.048+0000 7f611e0ff700 1 --2- 172.21.15.60:0/749567809 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f60f806ace0 0x7f60f806d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f61080090b0 tx=0x7f610801c040 comp rx=0 tx=0).stop 2023-07-12T02:02:14.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.048+0000 7f611e0ff700 1 -- 172.21.15.60:0/749567809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6118147dc0 msgr2=0x7f611813d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:14.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.048+0000 7f611e0ff700 1 --2- 172.21.15.60:0/749567809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6118147dc0 0x7f611813d910 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f611000cc80 tx=0x7f611000cf90 comp rx=0 tx=0).stop 2023-07-12T02:02:14.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.048+0000 7f611e0ff700 1 -- 172.21.15.60:0/749567809 shutdown_connections 2023-07-12T02:02:14.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.048+0000 7f611e0ff700 1 --2- 172.21.15.60:0/749567809 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f60f806ace0 0x7f60f806d190 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:14.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.048+0000 7f611e0ff700 1 --2- 172.21.15.60:0/749567809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6118147dc0 0x7f611813d910 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:14.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.048+0000 7f611e0ff700 1 --2- 172.21.15.60:0/749567809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6118069f30 0x7f611813fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:14.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.048+0000 7f611e0ff700 1 --2- 172.21.15.60:0/749567809 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6118071840 0x7f61181e0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:14.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.048+0000 7f611e0ff700 1 -- 172.21.15.60:0/749567809 >> 172.21.15.60:0/749567809 conn(0x7f611806d0e0 msgr2=0x7f61181457e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:14.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.048+0000 7f611e0ff700 1 -- 172.21.15.60:0/749567809 shutdown_connections 2023-07-12T02:02:14.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.048+0000 7f611e0ff700 1 -- 172.21.15.60:0/749567809 wait complete. 2023-07-12T02:02:14.063 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-12T02:02:14.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.188+0000 7f76cc849700 1 Processor -- start 2023-07-12T02:02:14.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.188+0000 7f76cc849700 1 -- start start 2023-07-12T02:02:14.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.189+0000 7f76cc849700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f76c81449d0 0x7f76c814db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:14.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.189+0000 7f76cc849700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76c80b8620 con 0x7f76c80b8d90 2023-07-12T02:02:14.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.189+0000 7f76cc849700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76c80b8900 con 0x7f76c80bc810 2023-07-12T02:02:14.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.189+0000 7f76cc849700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76c80b97a0 con 0x7f76c81449d0 2023-07-12T02:02:14.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.189+0000 7f76c659c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f76c81449d0 0x7f76c814db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:14.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.189+0000 7f76c6d9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f76c80b8d90 0x7f76c806ade0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52496/0 (socket says 172.21.15.60:52496) 2023-07-12T02:02:14.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.189+0000 7f76c6d9d700 1 -- 172.21.15.60:0/3253093175 learned_addr learned my addr 172.21.15.60:0/3253093175 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:14.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.190+0000 7f76c659c700 1 -- 172.21.15.60:0/3253093175 >> v1:172.21.15.79:6789/0 conn(0x7f76c80bc810 legacy=0x7f76c80ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:14.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.190+0000 7f76c659c700 1 -- 172.21.15.60:0/3253093175 >> v1:172.21.15.60:6789/0 conn(0x7f76c80b8d90 legacy=0x7f76c806ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:14.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.190+0000 7f76c659c700 1 -- 172.21.15.60:0/3253093175 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c80bac40 con 0x7f76c81449d0 2023-07-12T02:02:14.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.190+0000 7f76c559a700 1 -- 172.21.15.60:0/3253093175 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3988790036 0 0) 0x7f76c80b8620 con 0x7f76c80b8d90 2023-07-12T02:02:14.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.190+0000 7f76c659c700 1 --2- 172.21.15.60:0/3253093175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76c81449d0 0x7f76c814db50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f76b8009840 tx=0x7f76b8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a1cef031aaca06c server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:14.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.190+0000 7f76c559a700 1 -- 172.21.15.60:0/3253093175 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b8011830 con 0x7f76c81449d0 2023-07-12T02:02:14.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.190+0000 7f76c559a700 1 -- 172.21.15.60:0/3253093175 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b8011990 con 0x7f76c81449d0 2023-07-12T02:02:14.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.190+0000 7f76c559a700 1 -- 172.21.15.60:0/3253093175 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b8011d20 con 0x7f76c81449d0 2023-07-12T02:02:14.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.190+0000 7f76cc849700 1 -- 172.21.15.60:0/3253093175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76c81449d0 msgr2=0x7f76c814db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:14.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.190+0000 7f76cc849700 1 --2- 172.21.15.60:0/3253093175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76c81449d0 0x7f76c814db50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f76b8009840 tx=0x7f76b8009b50 comp rx=0 tx=0).stop 2023-07-12T02:02:14.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.191+0000 7f76cc849700 1 -- 172.21.15.60:0/3253093175 shutdown_connections 2023-07-12T02:02:14.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.191+0000 7f76cc849700 1 --2- 172.21.15.60:0/3253093175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76c81449d0 0x7f76c814db50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:14.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.191+0000 7f76cc849700 1 -- 172.21.15.60:0/3253093175 >> 172.21.15.60:0/3253093175 conn(0x7f76c80c0860 msgr2=0x7f76c80c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:14.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.191+0000 7f76cc849700 1 -- 172.21.15.60:0/3253093175 shutdown_connections 2023-07-12T02:02:14.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.191+0000 7f76cc849700 1 -- 172.21.15.60:0/3253093175 wait complete. 2023-07-12T02:02:14.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.192+0000 7f76cc849700 1 Processor -- start 2023-07-12T02:02:14.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.192+0000 7f76cc849700 1 -- start start 2023-07-12T02:02:14.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.192+0000 7f76cc849700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f76c80b8d90 0x7f76c81d4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:14.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.192+0000 7f76cc849700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76c80bc810 0x7f76c814a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:14.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.192+0000 7f76cc849700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76c81449d0 0x7f76c81e0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:14.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.192+0000 7f76cc849700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c814ad70 con 0x7f76c81449d0 2023-07-12T02:02:14.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.192+0000 7f76cc849700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c81d3bc0 con 0x7f76c80bc810 2023-07-12T02:02:14.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.192+0000 7f76cc849700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c81d3970 con 0x7f76c80b8d90 2023-07-12T02:02:14.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.193+0000 7f76c6d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76c81449d0 0x7f76c81e0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:14.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.193+0000 7f76c6d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76c81449d0 0x7f76c81e0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36688/0 (socket says 172.21.15.60:36688) 2023-07-12T02:02:14.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.193+0000 7f76c6d9d700 1 -- 172.21.15.60:0/627620946 learned_addr learned my addr 172.21.15.60:0/627620946 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:14.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.193+0000 7f76c5d9b700 1 --2- 172.21.15.60:0/627620946 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76c80bc810 0x7f76c814a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:14.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.193+0000 7f76c659c700 1 --2- 172.21.15.60:0/627620946 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f76c80b8d90 0x7f76c81d4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:14.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.193+0000 7f76c6d9d700 1 -- 172.21.15.60:0/627620946 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f76c80b8d90 msgr2=0x7f76c81d4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:14.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.193+0000 7f76c6d9d700 1 --2- 172.21.15.60:0/627620946 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f76c80b8d90 0x7f76c81d4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:14.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.193+0000 7f76c6d9d700 1 -- 172.21.15.60:0/627620946 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76c80bc810 msgr2=0x7f76c814a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:14.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.193+0000 7f76c6d9d700 1 --2- 172.21.15.60:0/627620946 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76c80bc810 0x7f76c814a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:14.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.193+0000 7f76c6d9d700 1 -- 172.21.15.60:0/627620946 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b80094a0 con 0x7f76c81449d0 2023-07-12T02:02:14.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.193+0000 7f76c659c700 1 --2- 172.21.15.60:0/627620946 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f76c80b8d90 0x7f76c81d4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:02:14.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.193+0000 7f76c6d9d700 1 --2- 172.21.15.60:0/627620946 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76c81449d0 0x7f76c81e0090 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f76c000cc70 tx=0x7f76c000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:14.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.193+0000 7f76b6ffd700 1 -- 172.21.15.60:0/627620946 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c000ada0 con 0x7f76c81449d0 2023-07-12T02:02:14.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.193+0000 7f76b6ffd700 1 -- 172.21.15.60:0/627620946 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c000ce70 con 0x7f76c81449d0 2023-07-12T02:02:14.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.193+0000 7f76cc849700 1 -- 172.21.15.60:0/627620946 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76c814b060 con 0x7f76c81449d0 2023-07-12T02:02:14.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.193+0000 7f76b6ffd700 1 -- 172.21.15.60:0/627620946 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c00072f0 con 0x7f76c81449d0 2023-07-12T02:02:14.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.193+0000 7f76cc849700 1 -- 172.21.15.60:0/627620946 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c8147bd0 con 0x7f76c81449d0 2023-07-12T02:02:14.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.194+0000 7f76cc849700 1 -- 172.21.15.60:0/627620946 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76c81dfdb0 con 0x7f76c81449d0 2023-07-12T02:02:14.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.195+0000 7f76b6ffd700 1 -- 172.21.15.60:0/627620946 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f76c0007450 con 0x7f76c81449d0 2023-07-12T02:02:14.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.195+0000 7f76b6ffd700 1 --2- 172.21.15.60:0/627620946 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f76a806ace0 0x7f76a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:14.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.195+0000 7f76b6ffd700 1 -- 172.21.15.60:0/627620946 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f76c0088f50 con 0x7f76c81449d0 2023-07-12T02:02:14.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.195+0000 7f76c659c700 1 --2- 172.21.15.60:0/627620946 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f76a806ace0 0x7f76a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:14.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.196+0000 7f76c659c700 1 --2- 172.21.15.60:0/627620946 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f76a806ace0 0x7f76a806d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f76b8000c00 tx=0x7f76b801c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:14.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.200+0000 7f76b6ffd700 1 -- 172.21.15.60:0/627620946 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f76c81dfdb0 con 0x7f76c81449d0 2023-07-12T02:02:14.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:14.442+0000 7f76cc849700 1 -- 172.21.15.60:0/627620946 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f76c81dfdb0 con 0x7f76c81449d0 2023-07-12T02:02:15.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.342+0000 7f76b6ffd700 1 -- 172.21.15.60:0/627620946 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7f76c81dfdb0 con 0x7f76c81449d0 2023-07-12T02:02:15.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.345+0000 7f76cc849700 1 -- 172.21.15.60:0/627620946 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f76a806ace0 msgr2=0x7f76a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:15.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.345+0000 7f76cc849700 1 --2- 172.21.15.60:0/627620946 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f76a806ace0 0x7f76a806d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f76b8000c00 tx=0x7f76b801c040 comp rx=0 tx=0).stop 2023-07-12T02:02:15.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.345+0000 7f76cc849700 1 -- 172.21.15.60:0/627620946 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76c81449d0 msgr2=0x7f76c81e0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:15.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.345+0000 7f76cc849700 1 --2- 172.21.15.60:0/627620946 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76c81449d0 0x7f76c81e0090 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f76c000cc70 tx=0x7f76c000a340 comp rx=0 tx=0).stop 2023-07-12T02:02:15.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.345+0000 7f76cc849700 1 -- 172.21.15.60:0/627620946 shutdown_connections 2023-07-12T02:02:15.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.345+0000 7f76cc849700 1 --2- 172.21.15.60:0/627620946 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f76a806ace0 0x7f76a806d190 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:15.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.345+0000 7f76cc849700 1 --2- 172.21.15.60:0/627620946 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76c81449d0 0x7f76c81e0090 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:15.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.345+0000 7f76cc849700 1 --2- 172.21.15.60:0/627620946 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f76c80b8d90 0x7f76c81d4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:15.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.345+0000 7f76cc849700 1 --2- 172.21.15.60:0/627620946 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76c80bc810 0x7f76c814a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:15.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.345+0000 7f76cc849700 1 -- 172.21.15.60:0/627620946 >> 172.21.15.60:0/627620946 conn(0x7f76c80c0860 msgr2=0x7f76c80bf770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:15.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.345+0000 7f76cc849700 1 -- 172.21.15.60:0/627620946 shutdown_connections 2023-07-12T02:02:15.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.345+0000 7f76cc849700 1 -- 172.21.15.60:0/627620946 wait complete. 2023-07-12T02:02:15.363 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-12T02:02:15.363 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-12T02:02:15.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.496+0000 7efe2b5c4700 1 Processor -- start 2023-07-12T02:02:15.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.496+0000 7efe2b5c4700 1 -- start start 2023-07-12T02:02:15.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.497+0000 7efe2b5c4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efe240717f0 0x7efe240b7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:15.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.497+0000 7efe2b5c4700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efe24071bc0 0x7efe240ba3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:15.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.497+0000 7efe2b5c4700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe240ba010 con 0x7efe240b8e60 2023-07-12T02:02:15.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.497+0000 7efe2b5c4700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe240b85a0 con 0x7efe24071bc0 2023-07-12T02:02:15.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.497+0000 7efe2b5c4700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe240b7470 con 0x7efe240717f0 2023-07-12T02:02:15.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.497+0000 7efe28b5f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efe24071bc0 0x7efe240ba3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:15.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.497+0000 7efe28b5f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efe24071bc0 0x7efe240ba3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36696/0 (socket says 172.21.15.60:36696) 2023-07-12T02:02:15.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.497+0000 7efe28b5f700 1 -- 172.21.15.60:0/2328160007 learned_addr learned my addr 172.21.15.60:0/2328160007 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:15.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.497+0000 7efe29360700 1 --2- 172.21.15.60:0/2328160007 >> v2:172.21.15.79:3300/0 conn(0x7efe240717f0 0x7efe240b7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:15.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.497+0000 7efe28b5f700 1 -- 172.21.15.60:0/2328160007 >> v2:172.21.15.79:3300/0 conn(0x7efe240717f0 msgr2=0x7efe240b7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:15.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.497+0000 7efe28b5f700 1 --2- 172.21.15.60:0/2328160007 >> v2:172.21.15.79:3300/0 conn(0x7efe240717f0 0x7efe240b7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:15.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.497+0000 7efe28b5f700 1 -- 172.21.15.60:0/2328160007 >> v1:172.21.15.79:6789/0 conn(0x7efe240b8e60 legacy=0x7efe24142410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:15.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.497+0000 7efe28b5f700 1 -- 172.21.15.60:0/2328160007 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe240b7750 con 0x7efe24071bc0 2023-07-12T02:02:15.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.497+0000 7efe28b5f700 1 --2- 172.21.15.60:0/2328160007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe24071bc0 0x7efe240ba3e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efe240ba370 tx=0x7efe14009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b4053b64b6ef3dc server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:15.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.497+0000 7efe1bfff700 1 -- 172.21.15.60:0/2328160007 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe14004230 con 0x7efe24071bc0 2023-07-12T02:02:15.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.497+0000 7efe1bfff700 1 -- 172.21.15.60:0/2328160007 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe14004390 con 0x7efe24071bc0 2023-07-12T02:02:15.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.497+0000 7efe1bfff700 1 -- 172.21.15.60:0/2328160007 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe140036a0 con 0x7efe24071bc0 2023-07-12T02:02:15.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.498+0000 7efe2b5c4700 1 -- 172.21.15.60:0/2328160007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe24071bc0 msgr2=0x7efe240ba3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:15.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.498+0000 7efe2b5c4700 1 --2- 172.21.15.60:0/2328160007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe24071bc0 0x7efe240ba3e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efe240ba370 tx=0x7efe14009bd0 comp rx=0 tx=0).stop 2023-07-12T02:02:15.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.498+0000 7efe2b5c4700 1 -- 172.21.15.60:0/2328160007 shutdown_connections 2023-07-12T02:02:15.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.498+0000 7efe2b5c4700 1 --2- 172.21.15.60:0/2328160007 >> v2:172.21.15.79:3300/0 conn(0x7efe240717f0 0x7efe240b7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:15.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.498+0000 7efe2b5c4700 1 --2- 172.21.15.60:0/2328160007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe24071bc0 0x7efe240ba3e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:15.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.498+0000 7efe2b5c4700 1 -- 172.21.15.60:0/2328160007 >> 172.21.15.60:0/2328160007 conn(0x7efe2406d0e0 msgr2=0x7efe2406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:15.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.498+0000 7efe2b5c4700 1 -- 172.21.15.60:0/2328160007 shutdown_connections 2023-07-12T02:02:15.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.498+0000 7efe2b5c4700 1 -- 172.21.15.60:0/2328160007 wait complete. 2023-07-12T02:02:15.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.499+0000 7efe2b5c4700 1 Processor -- start 2023-07-12T02:02:15.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.499+0000 7efe2b5c4700 1 -- start start 2023-07-12T02:02:15.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.500+0000 7efe2b5c4700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe240717f0 0x7efe2413f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:15.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.500+0000 7efe2b5c4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe24071bc0 0x7efe2413e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:15.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.500+0000 7efe2b5c4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe240b8e60 0x7efe241dd960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:15.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.500+0000 7efe2b5c4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2413eb80 con 0x7efe240b8e60 2023-07-12T02:02:15.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.500+0000 7efe2b5c4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe24147350 con 0x7efe24071bc0 2023-07-12T02:02:15.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.500+0000 7efe2b5c4700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe2413fcb0 con 0x7efe240717f0 2023-07-12T02:02:15.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.500+0000 7efe29b61700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe240b8e60 0x7efe241dd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:15.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.500+0000 7efe29b61700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe240b8e60 0x7efe241dd960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36704/0 (socket says 172.21.15.60:36704) 2023-07-12T02:02:15.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.500+0000 7efe29b61700 1 -- 172.21.15.60:0/1979096359 learned_addr learned my addr 172.21.15.60:0/1979096359 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:15.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.500+0000 7efe28b5f700 1 --2- 172.21.15.60:0/1979096359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe24071bc0 0x7efe2413e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:15.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.500+0000 7efe29360700 1 --2- 172.21.15.60:0/1979096359 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe240717f0 0x7efe2413f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:15.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.500+0000 7efe29b61700 1 -- 172.21.15.60:0/1979096359 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe240717f0 msgr2=0x7efe2413f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:15.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.500+0000 7efe29b61700 1 --2- 172.21.15.60:0/1979096359 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe240717f0 0x7efe2413f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:15.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.500+0000 7efe29b61700 1 -- 172.21.15.60:0/1979096359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe24071bc0 msgr2=0x7efe2413e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:15.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.500+0000 7efe29b61700 1 --2- 172.21.15.60:0/1979096359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe24071bc0 0x7efe2413e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:15.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.500+0000 7efe29b61700 1 -- 172.21.15.60:0/1979096359 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe14009550 con 0x7efe240b8e60 2023-07-12T02:02:15.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.500+0000 7efe29b61700 1 --2- 172.21.15.60:0/1979096359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe240b8e60 0x7efe241dd960 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efe1c00b970 tx=0x7efe1c00bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:15.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.501+0000 7efe19ffb700 1 -- 172.21.15.60:0/1979096359 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c00c9b0 con 0x7efe240b8e60 2023-07-12T02:02:15.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.501+0000 7efe19ffb700 1 -- 172.21.15.60:0/1979096359 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe1c00cb10 con 0x7efe240b8e60 2023-07-12T02:02:15.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.501+0000 7efe2b5c4700 1 -- 172.21.15.60:0/1979096359 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe241d2440 con 0x7efe240b8e60 2023-07-12T02:02:15.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.501+0000 7efe19ffb700 1 -- 172.21.15.60:0/1979096359 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c014440 con 0x7efe240b8e60 2023-07-12T02:02:15.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.501+0000 7efe2b5c4700 1 -- 172.21.15.60:0/1979096359 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe2406abe0 con 0x7efe240b8e60 2023-07-12T02:02:15.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.502+0000 7efe2b5c4700 1 -- 172.21.15.60:0/1979096359 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe24142b00 con 0x7efe240b8e60 2023-07-12T02:02:15.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.502+0000 7efe19ffb700 1 -- 172.21.15.60:0/1979096359 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efe1c01d3b0 con 0x7efe240b8e60 2023-07-12T02:02:15.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.503+0000 7efe19ffb700 1 --2- 172.21.15.60:0/1979096359 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7efe0806ace0 0x7efe0806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:15.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.503+0000 7efe19ffb700 1 -- 172.21.15.60:0/1979096359 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efe1c089040 con 0x7efe240b8e60 2023-07-12T02:02:15.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.503+0000 7efe29360700 1 --2- 172.21.15.60:0/1979096359 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7efe0806ace0 0x7efe0806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:15.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.503+0000 7efe29360700 1 --2- 172.21.15.60:0/1979096359 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7efe0806ace0 0x7efe0806d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efe20009930 tx=0x7efe20008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:15.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.507+0000 7efe19ffb700 1 -- 172.21.15.60:0/1979096359 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7efe24142b00 con 0x7efe240b8e60 2023-07-12T02:02:15.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:15.753+0000 7efe2b5c4700 1 -- 172.21.15.60:0/1979096359 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7efe24142b00 con 0x7efe240b8e60 2023-07-12T02:02:16.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.348+0000 7efe19ffb700 1 -- 172.21.15.60:0/1979096359 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7efe24142b00 con 0x7efe240b8e60 2023-07-12T02:02:16.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.351+0000 7efe2b5c4700 1 -- 172.21.15.60:0/1979096359 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7efe0806ace0 msgr2=0x7efe0806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:16.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.351+0000 7efe2b5c4700 1 --2- 172.21.15.60:0/1979096359 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7efe0806ace0 0x7efe0806d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efe20009930 tx=0x7efe20008040 comp rx=0 tx=0).stop 2023-07-12T02:02:16.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.351+0000 7efe2b5c4700 1 -- 172.21.15.60:0/1979096359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe240b8e60 msgr2=0x7efe241dd960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:16.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.351+0000 7efe2b5c4700 1 --2- 172.21.15.60:0/1979096359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe240b8e60 0x7efe241dd960 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efe1c00b970 tx=0x7efe1c00bd30 comp rx=0 tx=0).stop 2023-07-12T02:02:16.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.351+0000 7efe2b5c4700 1 -- 172.21.15.60:0/1979096359 shutdown_connections 2023-07-12T02:02:16.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.351+0000 7efe2b5c4700 1 --2- 172.21.15.60:0/1979096359 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7efe0806ace0 0x7efe0806d190 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:16.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.351+0000 7efe2b5c4700 1 --2- 172.21.15.60:0/1979096359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe240b8e60 0x7efe241dd960 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:16.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.351+0000 7efe2b5c4700 1 --2- 172.21.15.60:0/1979096359 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe240717f0 0x7efe2413f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:16.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.351+0000 7efe2b5c4700 1 --2- 172.21.15.60:0/1979096359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe24071bc0 0x7efe2413e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:16.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.351+0000 7efe2b5c4700 1 -- 172.21.15.60:0/1979096359 >> 172.21.15.60:0/1979096359 conn(0x7efe2406d0e0 msgr2=0x7efe240bbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:16.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.351+0000 7efe2b5c4700 1 -- 172.21.15.60:0/1979096359 shutdown_connections 2023-07-12T02:02:16.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.351+0000 7efe2b5c4700 1 -- 172.21.15.60:0/1979096359 wait complete. 2023-07-12T02:02:16.369 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-12T02:02:16.369 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-12T02:02:16.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.499+0000 7f8cbbefa700 1 Processor -- start 2023-07-12T02:02:16.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.499+0000 7f8cbbefa700 1 -- start start 2023-07-12T02:02:16.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.500+0000 7f8cbbefa700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8cb406b120 0x7f8cb41474f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:16.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.500+0000 7f8cbbefa700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8cb4071b60 0x7f8cb4147a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:16.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.500+0000 7f8cbbefa700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb40b3bd0 con 0x7f8cb40b6430 2023-07-12T02:02:16.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.500+0000 7f8cbbefa700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb4070800 con 0x7f8cb4071b60 2023-07-12T02:02:16.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.500+0000 7f8cbbefa700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb4141c90 con 0x7f8cb406b120 2023-07-12T02:02:16.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.500+0000 7f8cb9495700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8cb4071b60 0x7f8cb4147a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:16.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.500+0000 7f8cba497700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f8cb40b6430 0x7f8cb40b68d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52508/0 (socket says 172.21.15.60:52508) 2023-07-12T02:02:16.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.500+0000 7f8cba497700 1 -- 172.21.15.60:0/3718189299 learned_addr learned my addr 172.21.15.60:0/3718189299 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:16.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.500+0000 7f8cb9c96700 1 --2- 172.21.15.60:0/3718189299 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8cb406b120 0x7f8cb41474f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:16.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.500+0000 7f8cb9495700 1 -- 172.21.15.60:0/3718189299 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8cb406b120 msgr2=0x7f8cb41474f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:16.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.500+0000 7f8cb9495700 1 --2- 172.21.15.60:0/3718189299 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8cb406b120 0x7f8cb41474f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:16.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.500+0000 7f8cb9495700 1 -- 172.21.15.60:0/3718189299 >> v1:172.21.15.60:6789/0 conn(0x7f8cb40b6430 legacy=0x7f8cb40b68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:16.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.500+0000 7f8cb9495700 1 -- 172.21.15.60:0/3718189299 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb40714d0 con 0x7f8cb4071b60 2023-07-12T02:02:16.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.500+0000 7f8cb8c94700 1 -- 172.21.15.60:0/3718189299 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 214244391 0 0) 0x7f8cb40b3bd0 con 0x7f8cb40b6430 2023-07-12T02:02:16.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.501+0000 7f8cb9495700 1 --2- 172.21.15.60:0/3718189299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cb4071b60 0x7f8cb4147a30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4009840 tx=0x7f8ca4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28f7af1516310864 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:16.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.501+0000 7f8cb8c94700 1 -- 172.21.15.60:0/3718189299 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4011830 con 0x7f8cb4071b60 2023-07-12T02:02:16.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.501+0000 7f8cb8c94700 1 -- 172.21.15.60:0/3718189299 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca4011990 con 0x7f8cb4071b60 2023-07-12T02:02:16.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.501+0000 7f8cb8c94700 1 -- 172.21.15.60:0/3718189299 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4011d20 con 0x7f8cb4071b60 2023-07-12T02:02:16.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.501+0000 7f8cbbefa700 1 -- 172.21.15.60:0/3718189299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cb4071b60 msgr2=0x7f8cb4147a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:16.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.501+0000 7f8cbbefa700 1 --2- 172.21.15.60:0/3718189299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cb4071b60 0x7f8cb4147a30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4009840 tx=0x7f8ca4009b50 comp rx=0 tx=0).stop 2023-07-12T02:02:16.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.501+0000 7f8cbbefa700 1 -- 172.21.15.60:0/3718189299 shutdown_connections 2023-07-12T02:02:16.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.501+0000 7f8cbbefa700 1 --2- 172.21.15.60:0/3718189299 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8cb406b120 0x7f8cb41474f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:16.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.501+0000 7f8cbbefa700 1 --2- 172.21.15.60:0/3718189299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cb4071b60 0x7f8cb4147a30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:16.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.501+0000 7f8cbbefa700 1 -- 172.21.15.60:0/3718189299 >> 172.21.15.60:0/3718189299 conn(0x7f8cb40bd980 msgr2=0x7f8cb40b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:16.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.502+0000 7f8cbbefa700 1 -- 172.21.15.60:0/3718189299 shutdown_connections 2023-07-12T02:02:16.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.502+0000 7f8cbbefa700 1 -- 172.21.15.60:0/3718189299 wait complete. 2023-07-12T02:02:16.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.503+0000 7f8cbbefa700 1 Processor -- start 2023-07-12T02:02:16.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.503+0000 7f8cbbefa700 1 -- start start 2023-07-12T02:02:16.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.503+0000 7f8cbbefa700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cb406b120 0x7f8cb41dce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:16.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.503+0000 7f8cbbefa700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8cb4071b60 0x7f8cb41d1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:16.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.503+0000 7f8cbbefa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cb40b6430 0x7f8cb413baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:16.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.503+0000 7f8cbbefa700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb414b300 con 0x7f8cb40b6430 2023-07-12T02:02:16.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.503+0000 7f8cbbefa700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb4142240 con 0x7f8cb406b120 2023-07-12T02:02:16.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.503+0000 7f8cbbefa700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb41dc9d0 con 0x7f8cb4071b60 2023-07-12T02:02:16.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.503+0000 7f8cba497700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cb40b6430 0x7f8cb413baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:16.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.503+0000 7f8cba497700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cb40b6430 0x7f8cb413baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36718/0 (socket says 172.21.15.60:36718) 2023-07-12T02:02:16.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.503+0000 7f8cba497700 1 -- 172.21.15.60:0/4217190780 learned_addr learned my addr 172.21.15.60:0/4217190780 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:16.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.504+0000 7f8cb9495700 1 --2- 172.21.15.60:0/4217190780 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8cb4071b60 0x7f8cb41d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:16.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.504+0000 7f8cb9c96700 1 --2- 172.21.15.60:0/4217190780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cb406b120 0x7f8cb41dce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:16.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.504+0000 7f8cba497700 1 -- 172.21.15.60:0/4217190780 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8cb4071b60 msgr2=0x7f8cb41d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:16.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.504+0000 7f8cba497700 1 --2- 172.21.15.60:0/4217190780 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8cb4071b60 0x7f8cb41d1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:16.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.504+0000 7f8cba497700 1 -- 172.21.15.60:0/4217190780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cb406b120 msgr2=0x7f8cb41dce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:16.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.504+0000 7f8cba497700 1 --2- 172.21.15.60:0/4217190780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cb406b120 0x7f8cb41dce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:16.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.504+0000 7f8cba497700 1 -- 172.21.15.60:0/4217190780 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca40094a0 con 0x7f8cb40b6430 2023-07-12T02:02:16.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.504+0000 7f8cb9495700 1 --2- 172.21.15.60:0/4217190780 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8cb4071b60 0x7f8cb41d1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:16.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.504+0000 7f8cba497700 1 --2- 172.21.15.60:0/4217190780 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cb40b6430 0x7f8cb413baa0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8cac00cba0 tx=0x7f8cac00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:16.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.504+0000 7f8caa7fc700 1 -- 172.21.15.60:0/4217190780 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cac00ab80 con 0x7f8cb40b6430 2023-07-12T02:02:16.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.504+0000 7f8caa7fc700 1 -- 172.21.15.60:0/4217190780 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cac00ad00 con 0x7f8cb40b6430 2023-07-12T02:02:16.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.504+0000 7f8cbbefa700 1 -- 172.21.15.60:0/4217190780 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb41dd3a0 con 0x7f8cb40b6430 2023-07-12T02:02:16.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.504+0000 7f8caa7fc700 1 -- 172.21.15.60:0/4217190780 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cac007310 con 0x7f8cb40b6430 2023-07-12T02:02:16.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.504+0000 7f8cbbefa700 1 -- 172.21.15.60:0/4217190780 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb41dc660 con 0x7f8cb40b6430 2023-07-12T02:02:16.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.505+0000 7f8cbbefa700 1 -- 172.21.15.60:0/4217190780 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cb41dcb40 con 0x7f8cb40b6430 2023-07-12T02:02:16.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.506+0000 7f8caa7fc700 1 -- 172.21.15.60:0/4217190780 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8cac007470 con 0x7f8cb40b6430 2023-07-12T02:02:16.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.506+0000 7f8caa7fc700 1 --2- 172.21.15.60:0/4217190780 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f8c9806ace0 0x7f8c9806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:16.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.506+0000 7f8caa7fc700 1 -- 172.21.15.60:0/4217190780 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8cac089370 con 0x7f8cb40b6430 2023-07-12T02:02:16.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.506+0000 7f8cb9c96700 1 --2- 172.21.15.60:0/4217190780 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f8c9806ace0 0x7f8c9806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:16.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.507+0000 7f8cb9c96700 1 --2- 172.21.15.60:0/4217190780 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f8c9806ace0 0x7f8c9806d190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0009930 tx=0x7f8cb0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:16.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.510+0000 7f8caa7fc700 1 -- 172.21.15.60:0/4217190780 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f8cac054390 con 0x7f8cb40b6430 2023-07-12T02:02:16.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.749+0000 7f8cbbefa700 1 -- 172.21.15.60:0/4217190780 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8cb4074360 con 0x7f8cb40b6430 2023-07-12T02:02:16.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.750+0000 7f8caa7fc700 1 -- 172.21.15.60:0/4217190780 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3906 (secure 0 0 0) 0x7f8cac018090 con 0x7f8cb40b6430 2023-07-12T02:02:16.753 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:02:16.753 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2687011977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2687011977},{"type":"v1","addr":"172.21.15.60:6835","nonce":2687011977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/1153134400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1153134400},{"type":"v1","addr":"172.21.15.79:6835","nonce":1153134400}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-12T02:02:12.733570+0000","modified":"2023-07-12T02:02:15.754293+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6833/825430907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":825430907},{"type":"v1","addr":"172.21.15.60:6833","nonce":825430907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-12T02:02:16.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.752+0000 7f8cbbefa700 1 -- 172.21.15.60:0/4217190780 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f8c9806ace0 msgr2=0x7f8c9806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:16.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.752+0000 7f8cbbefa700 1 --2- 172.21.15.60:0/4217190780 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f8c9806ace0 0x7f8c9806d190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0009930 tx=0x7f8cb0008040 comp rx=0 tx=0).stop 2023-07-12T02:02:16.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.752+0000 7f8cbbefa700 1 -- 172.21.15.60:0/4217190780 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cb40b6430 msgr2=0x7f8cb413baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:16.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.752+0000 7f8cbbefa700 1 --2- 172.21.15.60:0/4217190780 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cb40b6430 0x7f8cb413baa0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8cac00cba0 tx=0x7f8cac00cf60 comp rx=0 tx=0).stop 2023-07-12T02:02:16.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.752+0000 7f8cbbefa700 1 -- 172.21.15.60:0/4217190780 shutdown_connections 2023-07-12T02:02:16.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.752+0000 7f8cbbefa700 1 --2- 172.21.15.60:0/4217190780 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f8c9806ace0 0x7f8c9806d190 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:16.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.752+0000 7f8cbbefa700 1 --2- 172.21.15.60:0/4217190780 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cb40b6430 0x7f8cb413baa0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:16.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.752+0000 7f8cbbefa700 1 --2- 172.21.15.60:0/4217190780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cb406b120 0x7f8cb41dce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:16.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.752+0000 7f8cbbefa700 1 --2- 172.21.15.60:0/4217190780 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8cb4071b60 0x7f8cb41d1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:16.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.752+0000 7f8cbbefa700 1 -- 172.21.15.60:0/4217190780 >> 172.21.15.60:0/4217190780 conn(0x7f8cb40bd980 msgr2=0x7f8cb40babf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:16.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.752+0000 7f8cbbefa700 1 -- 172.21.15.60:0/4217190780 shutdown_connections 2023-07-12T02:02:16.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.752+0000 7f8cbbefa700 1 -- 172.21.15.60:0/4217190780 wait complete. 2023-07-12T02:02:16.757 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 7 2023-07-12T02:02:16.767 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:02:16.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.889+0000 7f3be7b01700 1 Processor -- start 2023-07-12T02:02:16.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.889+0000 7f3be7b01700 1 -- start start 2023-07-12T02:02:16.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.890+0000 7f3be7b01700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3be006b120 0x7f3be00b8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:16.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.890+0000 7f3be7b01700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3be014aa40 0x7f3be014ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:16.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.890+0000 7f3be7b01700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3be0070410 con 0x7f3be01444c0 2023-07-12T02:02:16.894 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.890+0000 7f3be7b01700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3be00b9590 con 0x7f3be006b120 2023-07-12T02:02:16.894 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.890+0000 7f3be7b01700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3be014b3d0 con 0x7f3be014aa40 2023-07-12T02:02:16.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.891+0000 7f3be589d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3be006b120 0x7f3be00b8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:16.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.891+0000 7f3be509c700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3be014aa40 0x7f3be014ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:16.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.891+0000 7f3be589d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3be006b120 0x7f3be00b8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.60:39636/0 (socket says 172.21.15.60:39636) 2023-07-12T02:02:16.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.891+0000 7f3be509c700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3be014aa40 0x7f3be014ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.60:52510/0 (socket says 172.21.15.60:52510) 2023-07-12T02:02:16.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.891+0000 7f3be589d700 1 -- 172.21.15.60:0/417406423 learned_addr learned my addr 172.21.15.60:0/417406423 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:16.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.891+0000 7f3be589d700 1 -- 172.21.15.60:0/417406423 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3be014aa40 msgr2=0x7f3be014ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:16.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.891+0000 7f3be589d700 1 --2- 172.21.15.60:0/417406423 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3be014aa40 0x7f3be014ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:16.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.891+0000 7f3be589d700 1 -- 172.21.15.60:0/417406423 >> v1:172.21.15.79:6789/0 conn(0x7f3be01444c0 legacy=0x7f3be0144920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:16.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.891+0000 7f3be589d700 1 -- 172.21.15.60:0/417406423 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be006ef60 con 0x7f3be006b120 2023-07-12T02:02:16.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.891+0000 7f3be489b700 1 -- 172.21.15.60:0/417406423 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3270849763 0 0) 0x7f3be0070410 con 0x7f3be01444c0 2023-07-12T02:02:16.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.891+0000 7f3be509c700 1 --2- 172.21.15.60:0/417406423 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3be014aa40 0x7f3be014ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:02:16.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.891+0000 7f3be589d700 1 --2- 172.21.15.60:0/417406423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3be006b120 0x7f3be00b8cd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc0098f0 tx=0x7f3bdc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f20b672dcd3507a server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:16.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.891+0000 7f3be489b700 1 -- 172.21.15.60:0/417406423 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc011830 con 0x7f3be006b120 2023-07-12T02:02:16.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.891+0000 7f3be489b700 1 -- 172.21.15.60:0/417406423 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bdc011990 con 0x7f3be006b120 2023-07-12T02:02:16.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.891+0000 7f3be489b700 1 -- 172.21.15.60:0/417406423 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc011d20 con 0x7f3be006b120 2023-07-12T02:02:16.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.892+0000 7f3be7b01700 1 -- 172.21.15.60:0/417406423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3be006b120 msgr2=0x7f3be00b8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:16.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.892+0000 7f3be7b01700 1 --2- 172.21.15.60:0/417406423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3be006b120 0x7f3be00b8cd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc0098f0 tx=0x7f3bdc009c00 comp rx=0 tx=0).stop 2023-07-12T02:02:16.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.892+0000 7f3be7b01700 1 -- 172.21.15.60:0/417406423 shutdown_connections 2023-07-12T02:02:16.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.892+0000 7f3be7b01700 1 --2- 172.21.15.60:0/417406423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3be006b120 0x7f3be00b8cd0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:16.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.892+0000 7f3be7b01700 1 --2- 172.21.15.60:0/417406423 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3be014aa40 0x7f3be014ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:16.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.892+0000 7f3be7b01700 1 -- 172.21.15.60:0/417406423 >> 172.21.15.60:0/417406423 conn(0x7f3be00bd980 msgr2=0x7f3be00b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:16.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.892+0000 7f3be7b01700 1 -- 172.21.15.60:0/417406423 shutdown_connections 2023-07-12T02:02:16.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.892+0000 7f3be7b01700 1 -- 172.21.15.60:0/417406423 wait complete. 2023-07-12T02:02:16.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.893+0000 7f3be7b01700 1 Processor -- start 2023-07-12T02:02:16.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.894+0000 7f3be7b01700 1 -- start start 2023-07-12T02:02:16.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.894+0000 7f3be7b01700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3be006b120 0x7f3be01dfc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:16.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.894+0000 7f3be7b01700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3be01444c0 0x7f3be014c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:16.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.894+0000 7f3be7b01700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3be014aa40 0x7f3be0149e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:16.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.894+0000 7f3be7b01700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be014c2a0 con 0x7f3be006b120 2023-07-12T02:02:16.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.894+0000 7f3be7b01700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be014a350 con 0x7f3be01444c0 2023-07-12T02:02:16.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.894+0000 7f3be7b01700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3be014bc50 con 0x7f3be014aa40 2023-07-12T02:02:16.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.894+0000 7f3be589d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3be006b120 0x7f3be01dfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:16.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.895+0000 7f3be589d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3be006b120 0x7f3be01dfc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36724/0 (socket says 172.21.15.60:36724) 2023-07-12T02:02:16.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.895+0000 7f3be589d700 1 -- 172.21.15.60:0/2059790558 learned_addr learned my addr 172.21.15.60:0/2059790558 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:16.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.895+0000 7f3be509c700 1 --2- 172.21.15.60:0/2059790558 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3be01444c0 0x7f3be014c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:16.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.895+0000 7f3be609e700 1 --2- 172.21.15.60:0/2059790558 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3be014aa40 0x7f3be0149e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:16.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.895+0000 7f3be589d700 1 -- 172.21.15.60:0/2059790558 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3be014aa40 msgr2=0x7f3be0149e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:16.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.895+0000 7f3be589d700 1 --2- 172.21.15.60:0/2059790558 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3be014aa40 0x7f3be0149e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:16.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.895+0000 7f3be589d700 1 -- 172.21.15.60:0/2059790558 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3be01444c0 msgr2=0x7f3be014c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:16.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.895+0000 7f3be589d700 1 --2- 172.21.15.60:0/2059790558 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3be01444c0 0x7f3be014c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:16.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.895+0000 7f3be589d700 1 -- 172.21.15.60:0/2059790558 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd00094a0 con 0x7f3be006b120 2023-07-12T02:02:16.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.895+0000 7f3be609e700 1 --2- 172.21.15.60:0/2059790558 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3be014aa40 0x7f3be0149e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:16.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.895+0000 7f3be589d700 1 --2- 172.21.15.60:0/2059790558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3be006b120 0x7f3be01dfc60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc009c40 tx=0x7f3bdc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:16.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.895+0000 7f3bd67fc700 1 -- 172.21.15.60:0/2059790558 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc004590 con 0x7f3be006b120 2023-07-12T02:02:16.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.895+0000 7f3bd67fc700 1 -- 172.21.15.60:0/2059790558 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bdc01e070 con 0x7f3be006b120 2023-07-12T02:02:16.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.895+0000 7f3be7b01700 1 -- 172.21.15.60:0/2059790558 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bdc009550 con 0x7f3be006b120 2023-07-12T02:02:16.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.895+0000 7f3bd67fc700 1 -- 172.21.15.60:0/2059790558 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc0038c0 con 0x7f3be006b120 2023-07-12T02:02:16.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.895+0000 7f3be7b01700 1 -- 172.21.15.60:0/2059790558 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3be014dbf0 con 0x7f3be006b120 2023-07-12T02:02:16.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.896+0000 7f3be7b01700 1 -- 172.21.15.60:0/2059790558 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3be014c510 con 0x7f3be006b120 2023-07-12T02:02:16.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.897+0000 7f3bd67fc700 1 -- 172.21.15.60:0/2059790558 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3bdc003a20 con 0x7f3be006b120 2023-07-12T02:02:16.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.897+0000 7f3bd67fc700 1 --2- 172.21.15.60:0/2059790558 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f3bc406ace0 0x7f3bc406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:16.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.897+0000 7f3bd67fc700 1 -- 172.21.15.60:0/2059790558 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3bdc08a3d0 con 0x7f3be006b120 2023-07-12T02:02:16.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.897+0000 7f3be509c700 1 --2- 172.21.15.60:0/2059790558 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f3bc406ace0 0x7f3bc406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:16.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.898+0000 7f3be509c700 1 --2- 172.21.15.60:0/2059790558 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f3bc406ace0 0x7f3bc406d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3be01da560 tx=0x7f3bd0009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:16.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:16.902+0000 7f3bd67fc700 1 -- 172.21.15.60:0/2059790558 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f3bdc055510 con 0x7f3be006b120 2023-07-12T02:02:17.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.097+0000 7f3be7b01700 1 -- 172.21.15.60:0/2059790558 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3be00b9de0 con 0x7f3be006b120 2023-07-12T02:02:17.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.098+0000 7f3bd67fc700 1 -- 172.21.15.60:0/2059790558 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18173 (secure 0 0 0) 0x7f3bdc02c3b0 con 0x7f3be006b120 2023-07-12T02:02:17.102 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:02:17.102 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":21,"fsid":"97e7c909-e567-472e-a5aa-72fde15171f2","created":"2023-07-12T02:01:53.987086+0000","modified":"2023-07-12T02:02:14.307912+0000","last_up_change":"2023-07-12T02:02:04.031780+0000","last_in_change":"2023-07-12T02:01:56.538621+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-12T02:02:05.375042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-12T02:02:05.857441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:02:10.574633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-12T02:02:11.699872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ed8b71c2-3895-4952-a118-16ede0b4a98c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6801","nonce":2818935979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6803","nonce":2818935979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6807","nonce":2818935979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6805","nonce":2818935979}]},"public_addr":"172.21.15.60:6801/2818935979","cluster_addr":"172.21.15.60:6803/2818935979","heartbeat_back_addr":"172.21.15.60:6807/2818935979","heartbeat_front_addr":"172.21.15.60:6805/2818935979","state":["exists","up"]},{"osd":1,"uuid":"7cf4d354-78e0-43ce-8c09-4a7d2a0b57a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6817","nonce":1678864191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6819","nonce":1678864191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6823","nonce":1678864191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6821","nonce":1678864191}]},"public_addr":"172.21.15.60:6817/1678864191","cluster_addr":"172.21.15.60:6819/1678864191","heartbeat_back_addr":"172.21.15.60:6823/1678864191","heartbeat_front_addr":"172.21.15.60:6821/1678864191","state":["exists","up"]},{"osd":2,"uuid":"02c958b8-9599-4470-92cb-8f7018ec0189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6809","nonce":1459480680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6811","nonce":1459480680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6815","nonce":1459480680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6813","nonce":1459480680}]},"public_addr":"172.21.15.60:6809/1459480680","cluster_addr":"172.21.15.60:6811/1459480680","heartbeat_back_addr":"172.21.15.60:6815/1459480680","heartbeat_front_addr":"172.21.15.60:6813/1459480680","state":["exists","up"]},{"osd":3,"uuid":"bc300432-a228-4257-be5c-e42dd5f2015f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6825","nonce":3295100060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6827","nonce":3295100060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6831","nonce":3295100060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6829","nonce":3295100060}]},"public_addr":"172.21.15.60:6825/3295100060","cluster_addr":"172.21.15.60:6827/3295100060","heartbeat_back_addr":"172.21.15.60:6831/3295100060","heartbeat_front_addr":"172.21.15.60:6829/3295100060","state":["exists","up"]},{"osd":4,"uuid":"ad9f7dc4-7126-466d-a656-2844880c6060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6809","nonce":4127109138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6811","nonce":4127109138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6815","nonce":4127109138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6813","nonce":4127109138}]},"public_addr":"172.21.15.79:6809/4127109138","cluster_addr":"172.21.15.79:6811/4127109138","heartbeat_back_addr":"172.21.15.79:6815/4127109138","heartbeat_front_addr":"172.21.15.79:6813/4127109138","state":["exists","up"]},{"osd":5,"uuid":"e88d16ca-0b01-4ab9-8aa8-c4aff7f210f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6801","nonce":421449406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6803","nonce":421449406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6807","nonce":421449406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6805","nonce":421449406}]},"public_addr":"172.21.15.79:6801/421449406","cluster_addr":"172.21.15.79:6803/421449406","heartbeat_back_addr":"172.21.15.79:6807/421449406","heartbeat_front_addr":"172.21.15.79:6805/421449406","state":["exists","up"]},{"osd":6,"uuid":"6898cb84-56d1-48a9-bd45-97e4668e2fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6825","nonce":4144355139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6827","nonce":4144355139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6831","nonce":4144355139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6829","nonce":4144355139}]},"public_addr":"172.21.15.79:6825/4144355139","cluster_addr":"172.21.15.79:6827/4144355139","heartbeat_back_addr":"172.21.15.79:6831/4144355139","heartbeat_front_addr":"172.21.15.79:6829/4144355139","state":["exists","up"]},{"osd":7,"uuid":"65c10882-371e-4762-b384-9c3a48f332ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6817","nonce":2845223299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6819","nonce":2845223299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6823","nonce":2845223299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6821","nonce":2845223299}]},"public_addr":"172.21.15.79:6817/2845223299","cluster_addr":"172.21.15.79:6819/2845223299","heartbeat_back_addr":"172.21.15.79:6823/2845223299","heartbeat_front_addr":"172.21.15.79:6821/2845223299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.634716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.758349+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.728366+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.777395+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707262+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.649705+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.693021+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:02:17.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.100+0000 7f3be7b01700 1 -- 172.21.15.60:0/2059790558 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f3bc406ace0 msgr2=0x7f3bc406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:17.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.100+0000 7f3be7b01700 1 --2- 172.21.15.60:0/2059790558 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f3bc406ace0 0x7f3bc406d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3be01da560 tx=0x7f3bd0009210 comp rx=0 tx=0).stop 2023-07-12T02:02:17.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.100+0000 7f3be7b01700 1 -- 172.21.15.60:0/2059790558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3be006b120 msgr2=0x7f3be01dfc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:17.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.100+0000 7f3be7b01700 1 --2- 172.21.15.60:0/2059790558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3be006b120 0x7f3be01dfc60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc009c40 tx=0x7f3bdc004750 comp rx=0 tx=0).stop 2023-07-12T02:02:17.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.100+0000 7f3be7b01700 1 -- 172.21.15.60:0/2059790558 shutdown_connections 2023-07-12T02:02:17.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.100+0000 7f3be7b01700 1 --2- 172.21.15.60:0/2059790558 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f3bc406ace0 0x7f3bc406d190 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:17.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.100+0000 7f3be7b01700 1 --2- 172.21.15.60:0/2059790558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3be006b120 0x7f3be01dfc60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:17.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.100+0000 7f3be7b01700 1 --2- 172.21.15.60:0/2059790558 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3be014aa40 0x7f3be0149e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:17.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.100+0000 7f3be7b01700 1 --2- 172.21.15.60:0/2059790558 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3be01444c0 0x7f3be014c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:17.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.100+0000 7f3be7b01700 1 -- 172.21.15.60:0/2059790558 >> 172.21.15.60:0/2059790558 conn(0x7f3be00bd980 msgr2=0x7f3be00b96d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:17.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.100+0000 7f3be7b01700 1 -- 172.21.15.60:0/2059790558 shutdown_connections 2023-07-12T02:02:17.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.100+0000 7f3be7b01700 1 -- 172.21.15.60:0/2059790558 wait complete. 2023-07-12T02:02:17.115 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-12T02:02:17.116 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-12T02:02:17.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.238+0000 7f3c61796700 1 Processor -- start 2023-07-12T02:02:17.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.238+0000 7f3c61796700 1 -- start start 2023-07-12T02:02:17.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.239+0000 7f3c61796700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3c5c071ab0 0x7f3c5c06edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:17.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.239+0000 7f3c61796700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3c5c06f340 0x7f3c5c146b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:17.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.239+0000 7f3c61796700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c5c0b93e0 con 0x7f3c5c06b120 2023-07-12T02:02:17.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.239+0000 7f3c61796700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c5c071690 con 0x7f3c5c071ab0 2023-07-12T02:02:17.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.239+0000 7f3c61796700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c06fe90 con 0x7f3c5c06f340 2023-07-12T02:02:17.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.240+0000 7f3c53fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3c5c071ab0 0x7f3c5c06edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:17.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.240+0000 7f3c5b7fe700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3c5c06f340 0x7f3c5c146b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:17.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.240+0000 7f3c5affd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f3c5c06b120 0x7f3c5c140af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.60:57840/0 (socket says 172.21.15.60:57840) 2023-07-12T02:02:17.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.240+0000 7f3c5affd700 1 -- 172.21.15.60:0/960114726 learned_addr learned my addr 172.21.15.60:0/960114726 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:17.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.240+0000 7f3c53fff700 1 -- 172.21.15.60:0/960114726 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3c5c06f340 msgr2=0x7f3c5c146b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:17.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.240+0000 7f3c53fff700 1 --2- 172.21.15.60:0/960114726 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3c5c06f340 0x7f3c5c146b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:17.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.240+0000 7f3c53fff700 1 -- 172.21.15.60:0/960114726 >> v1:172.21.15.79:6789/0 conn(0x7f3c5c06b120 legacy=0x7f3c5c140af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:17.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.240+0000 7f3c53fff700 1 -- 172.21.15.60:0/960114726 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5c147060 con 0x7f3c5c071ab0 2023-07-12T02:02:17.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.240+0000 7f3c53fff700 1 --2- 172.21.15.60:0/960114726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c5c071ab0 0x7f3c5c06edc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3c44009840 tx=0x7f3c44009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b852d9d62d6e85c4 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:17.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.240+0000 7f3c5a7fc700 1 -- 172.21.15.60:0/960114726 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c44010800 con 0x7f3c5c071ab0 2023-07-12T02:02:17.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.240+0000 7f3c5a7fc700 1 -- 172.21.15.60:0/960114726 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c44010960 con 0x7f3c5c071ab0 2023-07-12T02:02:17.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.240+0000 7f3c5a7fc700 1 -- 172.21.15.60:0/960114726 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c44010cf0 con 0x7f3c5c071ab0 2023-07-12T02:02:17.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.241+0000 7f3c61796700 1 -- 172.21.15.60:0/960114726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c5c071ab0 msgr2=0x7f3c5c06edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:17.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.241+0000 7f3c61796700 1 --2- 172.21.15.60:0/960114726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c5c071ab0 0x7f3c5c06edc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3c44009840 tx=0x7f3c44009b50 comp rx=0 tx=0).stop 2023-07-12T02:02:17.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.241+0000 7f3c61796700 1 -- 172.21.15.60:0/960114726 shutdown_connections 2023-07-12T02:02:17.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.241+0000 7f3c61796700 1 --2- 172.21.15.60:0/960114726 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3c5c06f340 0x7f3c5c146b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:17.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.241+0000 7f3c61796700 1 --2- 172.21.15.60:0/960114726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c5c071ab0 0x7f3c5c06edc0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:17.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.241+0000 7f3c61796700 1 -- 172.21.15.60:0/960114726 >> 172.21.15.60:0/960114726 conn(0x7f3c5c0bd980 msgr2=0x7f3c5c0b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:17.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.241+0000 7f3c61796700 1 -- 172.21.15.60:0/960114726 shutdown_connections 2023-07-12T02:02:17.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.241+0000 7f3c61796700 1 -- 172.21.15.60:0/960114726 wait complete. 2023-07-12T02:02:17.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.242+0000 7f3c61796700 1 Processor -- start 2023-07-12T02:02:17.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.242+0000 7f3c61796700 1 -- start start 2023-07-12T02:02:17.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.243+0000 7f3c61796700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c5c06b120 0x7f3c5c1d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:17.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.243+0000 7f3c61796700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c5c06f340 0x7f3c5c0b5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:17.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.243+0000 7f3c61796700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3c5c071ab0 0x7f3c5c0b5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:17.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.243+0000 7f3c61796700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c1d1400 con 0x7f3c5c06f340 2023-07-12T02:02:17.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.243+0000 7f3c61796700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c0b35a0 con 0x7f3c5c06b120 2023-07-12T02:02:17.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.243+0000 7f3c61796700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c0b32e0 con 0x7f3c5c071ab0 2023-07-12T02:02:17.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.243+0000 7f3c5affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c5c06b120 0x7f3c5c1d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:17.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.243+0000 7f3c53fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c5c06f340 0x7f3c5c0b5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:17.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.243+0000 7f3c5affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c5c06b120 0x7f3c5c1d0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.60:43152/0 (socket says 172.21.15.60:43152) 2023-07-12T02:02:17.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.243+0000 7f3c5affd700 1 -- 172.21.15.60:0/3233950634 learned_addr learned my addr 172.21.15.60:0/3233950634 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:17.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.243+0000 7f3c5b7fe700 1 --2- 172.21.15.60:0/3233950634 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3c5c071ab0 0x7f3c5c0b5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:17.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.244+0000 7f3c53fff700 1 -- 172.21.15.60:0/3233950634 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3c5c071ab0 msgr2=0x7f3c5c0b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:17.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.244+0000 7f3c53fff700 1 --2- 172.21.15.60:0/3233950634 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3c5c071ab0 0x7f3c5c0b5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:17.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.244+0000 7f3c53fff700 1 -- 172.21.15.60:0/3233950634 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c5c06b120 msgr2=0x7f3c5c1d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:17.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.244+0000 7f3c53fff700 1 --2- 172.21.15.60:0/3233950634 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c5c06b120 0x7f3c5c1d0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:17.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.244+0000 7f3c53fff700 1 -- 172.21.15.60:0/3233950634 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c440094a0 con 0x7f3c5c06f340 2023-07-12T02:02:17.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.244+0000 7f3c5affd700 1 --2- 172.21.15.60:0/3233950634 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c5c06b120 0x7f3c5c1d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:02:17.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.244+0000 7f3c53fff700 1 --2- 172.21.15.60:0/3233950634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c5c06f340 0x7f3c5c0b5a80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3c44017000 tx=0x7f3c44004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:17.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.244+0000 7f3c537fe700 1 -- 172.21.15.60:0/3233950634 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4401d070 con 0x7f3c5c06f340 2023-07-12T02:02:17.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.244+0000 7f3c537fe700 1 -- 172.21.15.60:0/3233950634 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c440036a0 con 0x7f3c5c06f340 2023-07-12T02:02:17.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.244+0000 7f3c61796700 1 -- 172.21.15.60:0/3233950634 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c5c141830 con 0x7f3c5c06f340 2023-07-12T02:02:17.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.244+0000 7f3c537fe700 1 -- 172.21.15.60:0/3233950634 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c44003a50 con 0x7f3c5c06f340 2023-07-12T02:02:17.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.244+0000 7f3c61796700 1 -- 172.21.15.60:0/3233950634 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c5c143f90 con 0x7f3c5c06f340 2023-07-12T02:02:17.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.245+0000 7f3c61796700 1 -- 172.21.15.60:0/3233950634 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c5c074360 con 0x7f3c5c06f340 2023-07-12T02:02:17.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.246+0000 7f3c537fe700 1 -- 172.21.15.60:0/3233950634 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3c44003bb0 con 0x7f3c5c06f340 2023-07-12T02:02:17.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.246+0000 7f3c537fe700 1 --2- 172.21.15.60:0/3233950634 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f3c3c06ace0 0x7f3c3c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:17.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.246+0000 7f3c537fe700 1 -- 172.21.15.60:0/3233950634 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3c4408a370 con 0x7f3c5c06f340 2023-07-12T02:02:17.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.246+0000 7f3c5affd700 1 --2- 172.21.15.60:0/3233950634 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f3c3c06ace0 0x7f3c3c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:17.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.247+0000 7f3c5affd700 1 --2- 172.21.15.60:0/3233950634 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f3c3c06ace0 0x7f3c3c06d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c005910 tx=0x7f3c4c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:17.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.250+0000 7f3c537fe700 1 -- 172.21.15.60:0/3233950634 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f3c44055560 con 0x7f3c5c06f340 2023-07-12T02:02:17.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.444+0000 7f3c61796700 1 -- 172.21.15.60:0/3233950634 --> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3c5c06f8d0 con 0x7f3c3c06ace0 2023-07-12T02:02:17.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.453+0000 7f3c537fe700 1 -- 172.21.15.60:0/3233950634 <== mgr.4105 v2:172.21.15.79:6832/1173177519 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286912 (secure 0 0 0) 0x7f3c4c00fa20 con 0x7f3c3c06ace0 2023-07-12T02:02:17.458 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:02:17.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.456+0000 7f3c61796700 1 -- 172.21.15.60:0/3233950634 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f3c3c06ace0 msgr2=0x7f3c3c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:17.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.456+0000 7f3c61796700 1 --2- 172.21.15.60:0/3233950634 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f3c3c06ace0 0x7f3c3c06d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c005910 tx=0x7f3c4c009040 comp rx=0 tx=0).stop 2023-07-12T02:02:17.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.456+0000 7f3c61796700 1 -- 172.21.15.60:0/3233950634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c5c06f340 msgr2=0x7f3c5c0b5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:17.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.456+0000 7f3c61796700 1 --2- 172.21.15.60:0/3233950634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c5c06f340 0x7f3c5c0b5a80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3c44017000 tx=0x7f3c44004750 comp rx=0 tx=0).stop 2023-07-12T02:02:17.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.456+0000 7f3c61796700 1 -- 172.21.15.60:0/3233950634 shutdown_connections 2023-07-12T02:02:17.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.456+0000 7f3c61796700 1 --2- 172.21.15.60:0/3233950634 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f3c3c06ace0 0x7f3c3c06d190 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:17.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.456+0000 7f3c61796700 1 --2- 172.21.15.60:0/3233950634 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3c5c071ab0 0x7f3c5c0b5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:17.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.456+0000 7f3c61796700 1 --2- 172.21.15.60:0/3233950634 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c5c06b120 0x7f3c5c1d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:17.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.456+0000 7f3c61796700 1 --2- 172.21.15.60:0/3233950634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c5c06f340 0x7f3c5c0b5a80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:17.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.456+0000 7f3c61796700 1 -- 172.21.15.60:0/3233950634 >> 172.21.15.60:0/3233950634 conn(0x7f3c5c0bd980 msgr2=0x7f3c5c1462d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:17.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.456+0000 7f3c61796700 1 -- 172.21.15.60:0/3233950634 shutdown_connections 2023-07-12T02:02:17.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.456+0000 7f3c61796700 1 -- 172.21.15.60:0/3233950634 wait complete. 2023-07-12T02:02:17.462 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-07-12T02:02:17.471 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-07-12T02:02:15.801495+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":134,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219044,"kb_used_data":2840,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755676,"statfs":{"total":773094113280,"available":772869812224,"internally_reserved":0,"allocated":2908160,"data_stored":1780182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.497405"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.339236+0000","last_change":"2023-07-12T02:02:13.337541+0000","last_active":"2023-07-12T02:02:13.339236+0000","last_peered":"2023-07-12T02:02:13.339236+0000","last_clean":"2023-07-12T02:02:13.339236+0000","last_became_active":"2023-07-12T02:02:13.337208+0000","last_became_peered":"2023-07-12T02:02:13.337208+0000","last_unstale":"2023-07-12T02:02:13.339236+0000","last_undegraded":"2023-07-12T02:02:13.339236+0000","last_fullsized":"2023-07-12T02:02:13.339236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:04:15.802706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316831+0000","last_change":"2023-07-12T02:02:13.326771+0000","last_active":"2023-07-12T02:02:14.316831+0000","last_peered":"2023-07-12T02:02:14.316831+0000","last_clean":"2023-07-12T02:02:14.316831+0000","last_became_active":"2023-07-12T02:02:13.326496+0000","last_became_peered":"2023-07-12T02:02:13.326496+0000","last_unstale":"2023-07-12T02:02:14.316831+0000","last_undegraded":"2023-07-12T02:02:14.316831+0000","last_fullsized":"2023-07-12T02:02:14.316831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:15:32.479260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317741+0000","last_change":"2023-07-12T02:02:13.329834+0000","last_active":"2023-07-12T02:02:14.317741+0000","last_peered":"2023-07-12T02:02:14.317741+0000","last_clean":"2023-07-12T02:02:14.317741+0000","last_became_active":"2023-07-12T02:02:13.329474+0000","last_became_peered":"2023-07-12T02:02:13.329474+0000","last_unstale":"2023-07-12T02:02:14.317741+0000","last_undegraded":"2023-07-12T02:02:14.317741+0000","last_fullsized":"2023-07-12T02:02:14.317741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:21:36.117239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.336804+0000","last_change":"2023-07-12T02:02:13.334760+0000","last_active":"2023-07-12T02:02:13.336804+0000","last_peered":"2023-07-12T02:02:13.336804+0000","last_clean":"2023-07-12T02:02:13.336804+0000","last_became_active":"2023-07-12T02:02:13.329155+0000","last_became_peered":"2023-07-12T02:02:13.329155+0000","last_unstale":"2023-07-12T02:02:13.336804+0000","last_undegraded":"2023-07-12T02:02:13.336804+0000","last_fullsized":"2023-07-12T02:02:13.336804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:08:44.750937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.346735+0000","last_change":"2023-07-12T02:02:13.342289+0000","last_active":"2023-07-12T02:02:13.346735+0000","last_peered":"2023-07-12T02:02:13.346735+0000","last_clean":"2023-07-12T02:02:13.346735+0000","last_became_active":"2023-07-12T02:02:13.341024+0000","last_became_peered":"2023-07-12T02:02:13.341024+0000","last_unstale":"2023-07-12T02:02:13.346735+0000","last_undegraded":"2023-07-12T02:02:13.346735+0000","last_fullsized":"2023-07-12T02:02:13.346735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:26:12.486521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316438+0000","last_change":"2023-07-12T02:02:13.328776+0000","last_active":"2023-07-12T02:02:14.316438+0000","last_peered":"2023-07-12T02:02:14.316438+0000","last_clean":"2023-07-12T02:02:14.316438+0000","last_became_active":"2023-07-12T02:02:13.328433+0000","last_became_peered":"2023-07-12T02:02:13.328433+0000","last_unstale":"2023-07-12T02:02:14.316438+0000","last_undegraded":"2023-07-12T02:02:14.316438+0000","last_fullsized":"2023-07-12T02:02:14.316438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:41:14.864536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.315227+0000","last_change":"2023-07-12T02:02:13.333771+0000","last_active":"2023-07-12T02:02:14.315227+0000","last_peered":"2023-07-12T02:02:14.315227+0000","last_clean":"2023-07-12T02:02:14.315227+0000","last_became_active":"2023-07-12T02:02:13.332954+0000","last_became_peered":"2023-07-12T02:02:13.332954+0000","last_unstale":"2023-07-12T02:02:14.315227+0000","last_undegraded":"2023-07-12T02:02:14.315227+0000","last_fullsized":"2023-07-12T02:02:14.315227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:47:51.304545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316880+0000","last_change":"2023-07-12T02:02:13.321126+0000","last_active":"2023-07-12T02:02:14.316880+0000","last_peered":"2023-07-12T02:02:14.316880+0000","last_clean":"2023-07-12T02:02:14.316880+0000","last_became_active":"2023-07-12T02:02:13.320733+0000","last_became_peered":"2023-07-12T02:02:13.320733+0000","last_unstale":"2023-07-12T02:02:14.316880+0000","last_undegraded":"2023-07-12T02:02:14.316880+0000","last_fullsized":"2023-07-12T02:02:14.316880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:09:38.066919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.346741+0000","last_change":"2023-07-12T02:02:13.341524+0000","last_active":"2023-07-12T02:02:13.346741+0000","last_peered":"2023-07-12T02:02:13.346741+0000","last_clean":"2023-07-12T02:02:13.346741+0000","last_became_active":"2023-07-12T02:02:13.341060+0000","last_became_peered":"2023-07-12T02:02:13.341060+0000","last_unstale":"2023-07-12T02:02:13.346741+0000","last_undegraded":"2023-07-12T02:02:13.346741+0000","last_fullsized":"2023-07-12T02:02:13.346741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:12:03.780682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317439+0000","last_change":"2023-07-12T02:02:13.335214+0000","last_active":"2023-07-12T02:02:14.317439+0000","last_peered":"2023-07-12T02:02:14.317439+0000","last_clean":"2023-07-12T02:02:14.317439+0000","last_became_active":"2023-07-12T02:02:13.334928+0000","last_became_peered":"2023-07-12T02:02:13.334928+0000","last_unstale":"2023-07-12T02:02:14.317439+0000","last_undegraded":"2023-07-12T02:02:14.317439+0000","last_fullsized":"2023-07-12T02:02:14.317439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:17:05.090789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317721+0000","last_change":"2023-07-12T02:02:13.327183+0000","last_active":"2023-07-12T02:02:14.317721+0000","last_peered":"2023-07-12T02:02:14.317721+0000","last_clean":"2023-07-12T02:02:14.317721+0000","last_became_active":"2023-07-12T02:02:13.326918+0000","last_became_peered":"2023-07-12T02:02:13.326918+0000","last_unstale":"2023-07-12T02:02:14.317721+0000","last_undegraded":"2023-07-12T02:02:14.317721+0000","last_fullsized":"2023-07-12T02:02:14.317721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:07:26.932388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.334976+0000","last_change":"2023-07-12T02:02:13.330866+0000","last_active":"2023-07-12T02:02:13.334976+0000","last_peered":"2023-07-12T02:02:13.334976+0000","last_clean":"2023-07-12T02:02:13.334976+0000","last_became_active":"2023-07-12T02:02:13.330331+0000","last_became_peered":"2023-07-12T02:02:13.330331+0000","last_unstale":"2023-07-12T02:02:13.334976+0000","last_undegraded":"2023-07-12T02:02:13.334976+0000","last_fullsized":"2023-07-12T02:02:13.334976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:38:51.656153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.339120+0000","last_change":"2023-07-12T02:02:13.337965+0000","last_active":"2023-07-12T02:02:13.339120+0000","last_peered":"2023-07-12T02:02:13.339120+0000","last_clean":"2023-07-12T02:02:13.339120+0000","last_became_active":"2023-07-12T02:02:13.337069+0000","last_became_peered":"2023-07-12T02:02:13.337069+0000","last_unstale":"2023-07-12T02:02:13.339120+0000","last_undegraded":"2023-07-12T02:02:13.339120+0000","last_fullsized":"2023-07-12T02:02:13.339120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:00:02.438999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316721+0000","last_change":"2023-07-12T02:02:13.333391+0000","last_active":"2023-07-12T02:02:14.316721+0000","last_peered":"2023-07-12T02:02:14.316721+0000","last_clean":"2023-07-12T02:02:14.316721+0000","last_became_active":"2023-07-12T02:02:13.333091+0000","last_became_peered":"2023-07-12T02:02:13.333091+0000","last_unstale":"2023-07-12T02:02:14.316721+0000","last_undegraded":"2023-07-12T02:02:14.316721+0000","last_fullsized":"2023-07-12T02:02:14.316721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:17:08.165931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.315629+0000","last_change":"2023-07-12T02:02:13.333879+0000","last_active":"2023-07-12T02:02:14.315629+0000","last_peered":"2023-07-12T02:02:14.315629+0000","last_clean":"2023-07-12T02:02:14.315629+0000","last_became_active":"2023-07-12T02:02:13.333334+0000","last_became_peered":"2023-07-12T02:02:13.333334+0000","last_unstale":"2023-07-12T02:02:14.315629+0000","last_undegraded":"2023-07-12T02:02:14.315629+0000","last_fullsized":"2023-07-12T02:02:14.315629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:52:47.727485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316830+0000","last_change":"2023-07-12T02:02:13.328684+0000","last_active":"2023-07-12T02:02:14.316830+0000","last_peered":"2023-07-12T02:02:14.316830+0000","last_clean":"2023-07-12T02:02:14.316830+0000","last_became_active":"2023-07-12T02:02:13.328364+0000","last_became_peered":"2023-07-12T02:02:13.328364+0000","last_unstale":"2023-07-12T02:02:14.316830+0000","last_undegraded":"2023-07-12T02:02:14.316830+0000","last_fullsized":"2023-07-12T02:02:14.316830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:22:15.093456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.346645+0000","last_change":"2023-07-12T02:02:13.341527+0000","last_active":"2023-07-12T02:02:13.346645+0000","last_peered":"2023-07-12T02:02:13.346645+0000","last_clean":"2023-07-12T02:02:13.346645+0000","last_became_active":"2023-07-12T02:02:13.341127+0000","last_became_peered":"2023-07-12T02:02:13.341127+0000","last_unstale":"2023-07-12T02:02:13.346645+0000","last_undegraded":"2023-07-12T02:02:13.346645+0000","last_fullsized":"2023-07-12T02:02:13.346645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:21:46.349305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317709+0000","last_change":"2023-07-12T02:02:13.330871+0000","last_active":"2023-07-12T02:02:14.317709+0000","last_peered":"2023-07-12T02:02:14.317709+0000","last_clean":"2023-07-12T02:02:14.317709+0000","last_became_active":"2023-07-12T02:02:13.330590+0000","last_became_peered":"2023-07-12T02:02:13.330590+0000","last_unstale":"2023-07-12T02:02:14.317709+0000","last_undegraded":"2023-07-12T02:02:14.317709+0000","last_fullsized":"2023-07-12T02:02:14.317709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:11:43.867415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.331010+0000","last_change":"2023-07-12T02:02:13.326393+0000","last_active":"2023-07-12T02:02:13.331010+0000","last_peered":"2023-07-12T02:02:13.331010+0000","last_clean":"2023-07-12T02:02:13.331010+0000","last_became_active":"2023-07-12T02:02:13.326082+0000","last_became_peered":"2023-07-12T02:02:13.326082+0000","last_unstale":"2023-07-12T02:02:13.331010+0000","last_undegraded":"2023-07-12T02:02:13.331010+0000","last_fullsized":"2023-07-12T02:02:13.331010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:46:17.305989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317826+0000","last_change":"2023-07-12T02:02:13.322548+0000","last_active":"2023-07-12T02:02:14.317826+0000","last_peered":"2023-07-12T02:02:14.317826+0000","last_clean":"2023-07-12T02:02:14.317826+0000","last_became_active":"2023-07-12T02:02:13.322298+0000","last_became_peered":"2023-07-12T02:02:13.322298+0000","last_unstale":"2023-07-12T02:02:14.317826+0000","last_undegraded":"2023-07-12T02:02:14.317826+0000","last_fullsized":"2023-07-12T02:02:14.317826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:31:00.185527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.315759+0000","last_change":"2023-07-12T02:02:13.337864+0000","last_active":"2023-07-12T02:02:14.315759+0000","last_peered":"2023-07-12T02:02:14.315759+0000","last_clean":"2023-07-12T02:02:14.315759+0000","last_became_active":"2023-07-12T02:02:13.337675+0000","last_became_peered":"2023-07-12T02:02:13.337675+0000","last_unstale":"2023-07-12T02:02:14.315759+0000","last_undegraded":"2023-07-12T02:02:14.315759+0000","last_fullsized":"2023-07-12T02:02:14.315759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:31:00.185527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.346709+0000","last_change":"2023-07-12T02:02:13.341938+0000","last_active":"2023-07-12T02:02:13.346709+0000","last_peered":"2023-07-12T02:02:13.346709+0000","last_clean":"2023-07-12T02:02:13.346709+0000","last_became_active":"2023-07-12T02:02:13.341364+0000","last_became_peered":"2023-07-12T02:02:13.341364+0000","last_unstale":"2023-07-12T02:02:13.346709+0000","last_undegraded":"2023-07-12T02:02:13.346709+0000","last_fullsized":"2023-07-12T02:02:13.346709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:51:36.080105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.340395+0000","last_change":"2023-07-12T02:02:13.337225+0000","last_active":"2023-07-12T02:02:13.340395+0000","last_peered":"2023-07-12T02:02:13.340395+0000","last_clean":"2023-07-12T02:02:13.340395+0000","last_became_active":"2023-07-12T02:02:13.336940+0000","last_became_peered":"2023-07-12T02:02:13.336940+0000","last_unstale":"2023-07-12T02:02:13.340395+0000","last_undegraded":"2023-07-12T02:02:13.340395+0000","last_fullsized":"2023-07-12T02:02:13.340395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:09:38.066919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.315161+0000","last_change":"2023-07-12T02:02:13.325230+0000","last_active":"2023-07-12T02:02:14.315161+0000","last_peered":"2023-07-12T02:02:14.315161+0000","last_clean":"2023-07-12T02:02:14.315161+0000","last_became_active":"2023-07-12T02:02:13.324929+0000","last_became_peered":"2023-07-12T02:02:13.324929+0000","last_unstale":"2023-07-12T02:02:14.315161+0000","last_undegraded":"2023-07-12T02:02:14.315161+0000","last_fullsized":"2023-07-12T02:02:14.315161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:25:19.868800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.337865+0000","last_change":"2023-07-12T02:02:13.327418+0000","last_active":"2023-07-12T02:02:13.337865+0000","last_peered":"2023-07-12T02:02:13.337865+0000","last_clean":"2023-07-12T02:02:13.337865+0000","last_became_active":"2023-07-12T02:02:13.327154+0000","last_became_peered":"2023-07-12T02:02:13.327154+0000","last_unstale":"2023-07-12T02:02:13.337865+0000","last_undegraded":"2023-07-12T02:02:13.337865+0000","last_fullsized":"2023-07-12T02:02:13.337865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:07:56.951503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.336135+0000","last_change":"2023-07-12T02:02:13.330432+0000","last_active":"2023-07-12T02:02:13.336135+0000","last_peered":"2023-07-12T02:02:13.336135+0000","last_clean":"2023-07-12T02:02:13.336135+0000","last_became_active":"2023-07-12T02:02:13.330105+0000","last_became_peered":"2023-07-12T02:02:13.330105+0000","last_unstale":"2023-07-12T02:02:13.336135+0000","last_undegraded":"2023-07-12T02:02:13.336135+0000","last_fullsized":"2023-07-12T02:02:13.336135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:26:12.486521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317496+0000","last_change":"2023-07-12T02:02:13.319765+0000","last_active":"2023-07-12T02:02:14.317496+0000","last_peered":"2023-07-12T02:02:14.317496+0000","last_clean":"2023-07-12T02:02:14.317496+0000","last_became_active":"2023-07-12T02:02:13.319286+0000","last_became_peered":"2023-07-12T02:02:13.319286+0000","last_unstale":"2023-07-12T02:02:14.317496+0000","last_undegraded":"2023-07-12T02:02:14.317496+0000","last_fullsized":"2023-07-12T02:02:14.317496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:16:46.331127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316716+0000","last_change":"2023-07-12T02:02:12.321483+0000","last_active":"2023-07-12T02:02:14.316716+0000","last_peered":"2023-07-12T02:02:14.316716+0000","last_clean":"2023-07-12T02:02:14.316716+0000","last_became_active":"2023-07-12T02:02:12.321175+0000","last_became_peered":"2023-07-12T02:02:12.321175+0000","last_unstale":"2023-07-12T02:02:14.316716+0000","last_undegraded":"2023-07-12T02:02:14.316716+0000","last_fullsized":"2023-07-12T02:02:14.316716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:47:50.297258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.335112+0000","last_change":"2023-07-12T02:02:13.330375+0000","last_active":"2023-07-12T02:02:13.335112+0000","last_peered":"2023-07-12T02:02:13.335112+0000","last_clean":"2023-07-12T02:02:13.335112+0000","last_became_active":"2023-07-12T02:02:13.330053+0000","last_became_peered":"2023-07-12T02:02:13.330053+0000","last_unstale":"2023-07-12T02:02:13.335112+0000","last_undegraded":"2023-07-12T02:02:13.335112+0000","last_fullsized":"2023-07-12T02:02:13.335112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:39:36.325900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.310755+0000","last_change":"2023-07-12T02:02:12.329289+0000","last_active":"2023-07-12T02:02:13.310755+0000","last_peered":"2023-07-12T02:02:13.310755+0000","last_clean":"2023-07-12T02:02:13.310755+0000","last_became_active":"2023-07-12T02:02:12.328952+0000","last_became_peered":"2023-07-12T02:02:12.328952+0000","last_unstale":"2023-07-12T02:02:13.310755+0000","last_undegraded":"2023-07-12T02:02:13.310755+0000","last_fullsized":"2023-07-12T02:02:13.310755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:51:35.072818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.340669+0000","last_change":"2023-07-12T02:02:13.328323+0000","last_active":"2023-07-12T02:02:13.340669+0000","last_peered":"2023-07-12T02:02:13.340669+0000","last_clean":"2023-07-12T02:02:13.340669+0000","last_became_active":"2023-07-12T02:02:13.328037+0000","last_became_peered":"2023-07-12T02:02:13.328037+0000","last_unstale":"2023-07-12T02:02:13.340669+0000","last_undegraded":"2023-07-12T02:02:13.340669+0000","last_fullsized":"2023-07-12T02:02:13.340669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:33:47.310331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.318298+0000","last_change":"2023-07-12T02:02:12.327049+0000","last_active":"2023-07-12T02:02:13.318298+0000","last_peered":"2023-07-12T02:02:13.318298+0000","last_clean":"2023-07-12T02:02:13.318298+0000","last_became_active":"2023-07-12T02:02:12.326705+0000","last_became_peered":"2023-07-12T02:02:12.326705+0000","last_unstale":"2023-07-12T02:02:13.318298+0000","last_undegraded":"2023-07-12T02:02:13.318298+0000","last_fullsized":"2023-07-12T02:02:13.318298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:22:50.312910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.326270+0000","last_change":"2023-07-12T02:02:13.324681+0000","last_active":"2023-07-12T02:02:13.326270+0000","last_peered":"2023-07-12T02:02:13.326270+0000","last_clean":"2023-07-12T02:02:13.326270+0000","last_became_active":"2023-07-12T02:02:13.324399+0000","last_became_peered":"2023-07-12T02:02:13.324399+0000","last_unstale":"2023-07-12T02:02:13.326270+0000","last_undegraded":"2023-07-12T02:02:13.326270+0000","last_fullsized":"2023-07-12T02:02:13.326270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:26:12.486521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.324407+0000","last_change":"2023-07-12T02:02:12.325851+0000","last_active":"2023-07-12T02:02:13.324407+0000","last_peered":"2023-07-12T02:02:13.324407+0000","last_clean":"2023-07-12T02:02:13.324407+0000","last_became_active":"2023-07-12T02:02:12.325017+0000","last_became_peered":"2023-07-12T02:02:12.325017+0000","last_unstale":"2023-07-12T02:02:13.324407+0000","last_undegraded":"2023-07-12T02:02:13.324407+0000","last_fullsized":"2023-07-12T02:02:13.324407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:39:35.318613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.337208+0000","last_change":"2023-07-12T02:02:13.334083+0000","last_active":"2023-07-12T02:02:13.337208+0000","last_peered":"2023-07-12T02:02:13.337208+0000","last_clean":"2023-07-12T02:02:13.337208+0000","last_became_active":"2023-07-12T02:02:13.328586+0000","last_became_peered":"2023-07-12T02:02:13.328586+0000","last_unstale":"2023-07-12T02:02:13.337208+0000","last_undegraded":"2023-07-12T02:02:13.337208+0000","last_fullsized":"2023-07-12T02:02:13.337208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:20:47.394363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316972+0000","last_change":"2023-07-12T02:02:12.320616+0000","last_active":"2023-07-12T02:02:14.316972+0000","last_peered":"2023-07-12T02:02:14.316972+0000","last_clean":"2023-07-12T02:02:14.316972+0000","last_became_active":"2023-07-12T02:02:12.320352+0000","last_became_peered":"2023-07-12T02:02:12.320352+0000","last_unstale":"2023-07-12T02:02:14.316972+0000","last_undegraded":"2023-07-12T02:02:14.316972+0000","last_fullsized":"2023-07-12T02:02:14.316972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:38:02.468430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.336753+0000","last_change":"2023-07-12T02:02:13.330996+0000","last_active":"2023-07-12T02:02:13.336753+0000","last_peered":"2023-07-12T02:02:13.336753+0000","last_clean":"2023-07-12T02:02:13.336753+0000","last_became_active":"2023-07-12T02:02:13.330717+0000","last_became_peered":"2023-07-12T02:02:13.330717+0000","last_unstale":"2023-07-12T02:02:13.336753+0000","last_undegraded":"2023-07-12T02:02:13.336753+0000","last_fullsized":"2023-07-12T02:02:13.336753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:53:36.667304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.315527+0000","last_change":"2023-07-12T02:02:12.329122+0000","last_active":"2023-07-12T02:02:14.315527+0000","last_peered":"2023-07-12T02:02:14.315527+0000","last_clean":"2023-07-12T02:02:14.315527+0000","last_became_active":"2023-07-12T02:02:12.328805+0000","last_became_peered":"2023-07-12T02:02:12.328805+0000","last_unstale":"2023-07-12T02:02:14.315527+0000","last_undegraded":"2023-07-12T02:02:14.315527+0000","last_fullsized":"2023-07-12T02:02:14.315527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:20:27.289712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.338178+0000","last_change":"2023-07-12T02:02:13.326651+0000","last_active":"2023-07-12T02:02:13.338178+0000","last_peered":"2023-07-12T02:02:13.338178+0000","last_clean":"2023-07-12T02:02:13.338178+0000","last_became_active":"2023-07-12T02:02:13.326284+0000","last_became_peered":"2023-07-12T02:02:13.326284+0000","last_unstale":"2023-07-12T02:02:13.338178+0000","last_undegraded":"2023-07-12T02:02:13.338178+0000","last_fullsized":"2023-07-12T02:02:13.338178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:20:47.394363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317640+0000","last_change":"2023-07-12T02:02:12.320231+0000","last_active":"2023-07-12T02:02:14.317640+0000","last_peered":"2023-07-12T02:02:14.317640+0000","last_clean":"2023-07-12T02:02:14.317640+0000","last_became_active":"2023-07-12T02:02:12.319927+0000","last_became_peered":"2023-07-12T02:02:12.319927+0000","last_unstale":"2023-07-12T02:02:14.317640+0000","last_undegraded":"2023-07-12T02:02:14.317640+0000","last_fullsized":"2023-07-12T02:02:14.317640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:35:50.916494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317455+0000","last_change":"2023-07-12T02:02:13.322009+0000","last_active":"2023-07-12T02:02:14.317455+0000","last_peered":"2023-07-12T02:02:14.317455+0000","last_clean":"2023-07-12T02:02:14.317455+0000","last_became_active":"2023-07-12T02:02:13.321743+0000","last_became_peered":"2023-07-12T02:02:13.321743+0000","last_unstale":"2023-07-12T02:02:14.317455+0000","last_undegraded":"2023-07-12T02:02:14.317455+0000","last_fullsized":"2023-07-12T02:02:14.317455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:52:47.727485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.315586+0000","last_change":"2023-07-12T02:02:12.324867+0000","last_active":"2023-07-12T02:02:14.315586+0000","last_peered":"2023-07-12T02:02:14.315586+0000","last_clean":"2023-07-12T02:02:14.315586+0000","last_became_active":"2023-07-12T02:02:12.324548+0000","last_became_peered":"2023-07-12T02:02:12.324548+0000","last_unstale":"2023-07-12T02:02:14.315586+0000","last_undegraded":"2023-07-12T02:02:14.315586+0000","last_fullsized":"2023-07-12T02:02:14.315586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:16:16.868913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.337612+0000","last_change":"2023-07-12T02:02:13.331949+0000","last_active":"2023-07-12T02:02:13.337612+0000","last_peered":"2023-07-12T02:02:13.337612+0000","last_clean":"2023-07-12T02:02:13.337612+0000","last_became_active":"2023-07-12T02:02:13.331691+0000","last_became_peered":"2023-07-12T02:02:13.331691+0000","last_unstale":"2023-07-12T02:02:13.337612+0000","last_undegraded":"2023-07-12T02:02:13.337612+0000","last_fullsized":"2023-07-12T02:02:13.337612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:21:46.349305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.323774+0000","last_change":"2023-07-12T02:02:12.323570+0000","last_active":"2023-07-12T02:02:13.323774+0000","last_peered":"2023-07-12T02:02:13.323774+0000","last_clean":"2023-07-12T02:02:13.323774+0000","last_became_active":"2023-07-12T02:02:12.323259+0000","last_became_peered":"2023-07-12T02:02:12.323259+0000","last_unstale":"2023-07-12T02:02:13.323774+0000","last_undegraded":"2023-07-12T02:02:13.323774+0000","last_fullsized":"2023-07-12T02:02:13.323774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:08:43.743650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317309+0000","last_change":"2023-07-12T02:02:13.319909+0000","last_active":"2023-07-12T02:02:14.317309+0000","last_peered":"2023-07-12T02:02:14.317309+0000","last_clean":"2023-07-12T02:02:14.317309+0000","last_became_active":"2023-07-12T02:02:13.319598+0000","last_became_peered":"2023-07-12T02:02:13.319598+0000","last_unstale":"2023-07-12T02:02:14.317309+0000","last_undegraded":"2023-07-12T02:02:14.317309+0000","last_fullsized":"2023-07-12T02:02:14.317309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:41:14.864536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.315384+0000","last_change":"2023-07-12T02:02:12.324817+0000","last_active":"2023-07-12T02:02:14.315384+0000","last_peered":"2023-07-12T02:02:14.315384+0000","last_clean":"2023-07-12T02:02:14.315384+0000","last_became_active":"2023-07-12T02:02:12.324534+0000","last_became_peered":"2023-07-12T02:02:12.324534+0000","last_unstale":"2023-07-12T02:02:14.315384+0000","last_undegraded":"2023-07-12T02:02:14.315384+0000","last_fullsized":"2023-07-12T02:02:14.315384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:57:41.776255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.346759+0000","last_change":"2023-07-12T02:02:13.341596+0000","last_active":"2023-07-12T02:02:13.346759+0000","last_peered":"2023-07-12T02:02:13.346759+0000","last_clean":"2023-07-12T02:02:13.346759+0000","last_became_active":"2023-07-12T02:02:13.341271+0000","last_became_peered":"2023-07-12T02:02:13.341271+0000","last_unstale":"2023-07-12T02:02:13.346759+0000","last_undegraded":"2023-07-12T02:02:13.346759+0000","last_fullsized":"2023-07-12T02:02:13.346759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:53:36.667304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.343616+0000","last_change":"2023-07-12T02:02:12.321840+0000","last_active":"2023-07-12T02:02:13.343616+0000","last_peered":"2023-07-12T02:02:13.343616+0000","last_clean":"2023-07-12T02:02:13.343616+0000","last_became_active":"2023-07-12T02:02:12.321551+0000","last_became_peered":"2023-07-12T02:02:12.321551+0000","last_unstale":"2023-07-12T02:02:13.343616+0000","last_undegraded":"2023-07-12T02:02:13.343616+0000","last_fullsized":"2023-07-12T02:02:13.343616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:33:46.303044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.339315+0000","last_change":"2023-07-12T02:02:13.336049+0000","last_active":"2023-07-12T02:02:13.339315+0000","last_peered":"2023-07-12T02:02:13.339315+0000","last_clean":"2023-07-12T02:02:13.339315+0000","last_became_active":"2023-07-12T02:02:13.334580+0000","last_became_peered":"2023-07-12T02:02:13.334580+0000","last_unstale":"2023-07-12T02:02:13.339315+0000","last_undegraded":"2023-07-12T02:02:13.339315+0000","last_fullsized":"2023-07-12T02:02:13.339315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:35:02.686768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.315399+0000","last_change":"2023-07-12T02:02:12.321103+0000","last_active":"2023-07-12T02:02:14.315399+0000","last_peered":"2023-07-12T02:02:14.315399+0000","last_clean":"2023-07-12T02:02:14.315399+0000","last_became_active":"2023-07-12T02:02:12.320783+0000","last_became_peered":"2023-07-12T02:02:12.320783+0000","last_unstale":"2023-07-12T02:02:14.315399+0000","last_undegraded":"2023-07-12T02:02:14.315399+0000","last_fullsized":"2023-07-12T02:02:14.315399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:46:14.270985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316978+0000","last_change":"2023-07-12T02:02:13.319686+0000","last_active":"2023-07-12T02:02:14.316978+0000","last_peered":"2023-07-12T02:02:14.316978+0000","last_clean":"2023-07-12T02:02:14.316978+0000","last_became_active":"2023-07-12T02:02:13.319473+0000","last_became_peered":"2023-07-12T02:02:13.319473+0000","last_unstale":"2023-07-12T02:02:14.316978+0000","last_undegraded":"2023-07-12T02:02:14.316978+0000","last_fullsized":"2023-07-12T02:02:14.316978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:43:24.727241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.315771+0000","last_change":"2023-07-12T02:02:12.323782+0000","last_active":"2023-07-12T02:02:14.315771+0000","last_peered":"2023-07-12T02:02:14.315771+0000","last_clean":"2023-07-12T02:02:14.315771+0000","last_became_active":"2023-07-12T02:02:12.323508+0000","last_became_peered":"2023-07-12T02:02:12.323508+0000","last_unstale":"2023-07-12T02:02:14.315771+0000","last_undegraded":"2023-07-12T02:02:14.315771+0000","last_fullsized":"2023-07-12T02:02:14.315771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:35:50.916494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316527+0000","last_change":"2023-07-12T02:02:13.326752+0000","last_active":"2023-07-12T02:02:14.316527+0000","last_peered":"2023-07-12T02:02:14.316527+0000","last_clean":"2023-07-12T02:02:14.316527+0000","last_became_active":"2023-07-12T02:02:13.326494+0000","last_became_peered":"2023-07-12T02:02:13.326494+0000","last_unstale":"2023-07-12T02:02:14.316527+0000","last_undegraded":"2023-07-12T02:02:14.316527+0000","last_fullsized":"2023-07-12T02:02:14.316527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:17:31.378437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.315358+0000","last_change":"2023-07-12T02:02:12.323136+0000","last_active":"2023-07-12T02:02:14.315358+0000","last_peered":"2023-07-12T02:02:14.315358+0000","last_clean":"2023-07-12T02:02:14.315358+0000","last_became_active":"2023-07-12T02:02:12.322786+0000","last_became_peered":"2023-07-12T02:02:12.322786+0000","last_unstale":"2023-07-12T02:02:14.315358+0000","last_undegraded":"2023-07-12T02:02:14.315358+0000","last_fullsized":"2023-07-12T02:02:14.315358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:14:42.639913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.335064+0000","last_change":"2023-07-12T02:02:13.328969+0000","last_active":"2023-07-12T02:02:13.335064+0000","last_peered":"2023-07-12T02:02:13.335064+0000","last_clean":"2023-07-12T02:02:13.335064+0000","last_became_active":"2023-07-12T02:02:13.328727+0000","last_became_peered":"2023-07-12T02:02:13.328727+0000","last_unstale":"2023-07-12T02:02:13.335064+0000","last_undegraded":"2023-07-12T02:02:13.335064+0000","last_fullsized":"2023-07-12T02:02:13.335064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:12:44.190253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316868+0000","last_change":"2023-07-12T02:02:12.329043+0000","last_active":"2023-07-12T02:02:14.316868+0000","last_peered":"2023-07-12T02:02:14.316868+0000","last_clean":"2023-07-12T02:02:14.316868+0000","last_became_active":"2023-07-12T02:02:12.328739+0000","last_became_peered":"2023-07-12T02:02:12.328739+0000","last_unstale":"2023-07-12T02:02:14.316868+0000","last_undegraded":"2023-07-12T02:02:14.316868+0000","last_fullsized":"2023-07-12T02:02:14.316868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:35:01.679481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.346705+0000","last_change":"2023-07-12T02:02:13.341847+0000","last_active":"2023-07-12T02:02:13.346705+0000","last_peered":"2023-07-12T02:02:13.346705+0000","last_clean":"2023-07-12T02:02:13.346705+0000","last_became_active":"2023-07-12T02:02:13.341458+0000","last_became_peered":"2023-07-12T02:02:13.341458+0000","last_unstale":"2023-07-12T02:02:13.346705+0000","last_undegraded":"2023-07-12T02:02:13.346705+0000","last_fullsized":"2023-07-12T02:02:13.346705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:07:56.951503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.347270+0000","last_change":"2023-07-12T02:02:12.328920+0000","last_active":"2023-07-12T02:02:13.347270+0000","last_peered":"2023-07-12T02:02:13.347270+0000","last_clean":"2023-07-12T02:02:13.347270+0000","last_became_active":"2023-07-12T02:02:12.328621+0000","last_became_peered":"2023-07-12T02:02:12.328621+0000","last_unstale":"2023-07-12T02:02:13.347270+0000","last_undegraded":"2023-07-12T02:02:13.347270+0000","last_fullsized":"2023-07-12T02:02:13.347270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:17:07.158644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317790+0000","last_change":"2023-07-12T02:02:13.325579+0000","last_active":"2023-07-12T02:02:14.317790+0000","last_peered":"2023-07-12T02:02:14.317790+0000","last_clean":"2023-07-12T02:02:14.317790+0000","last_became_active":"2023-07-12T02:02:13.325322+0000","last_became_peered":"2023-07-12T02:02:13.325322+0000","last_unstale":"2023-07-12T02:02:14.317790+0000","last_undegraded":"2023-07-12T02:02:14.317790+0000","last_fullsized":"2023-07-12T02:02:14.317790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:44:33.522394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.322450+0000","last_change":"2023-07-12T02:02:12.326368+0000","last_active":"2023-07-12T02:02:13.322450+0000","last_peered":"2023-07-12T02:02:13.322450+0000","last_clean":"2023-07-12T02:02:13.322450+0000","last_became_active":"2023-07-12T02:02:12.326046+0000","last_became_peered":"2023-07-12T02:02:12.326046+0000","last_unstale":"2023-07-12T02:02:13.322450+0000","last_undegraded":"2023-07-12T02:02:13.322450+0000","last_fullsized":"2023-07-12T02:02:13.322450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:39:35.318613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317887+0000","last_change":"2023-07-12T02:02:13.333650+0000","last_active":"2023-07-12T02:02:14.317887+0000","last_peered":"2023-07-12T02:02:14.317887+0000","last_clean":"2023-07-12T02:02:14.317887+0000","last_became_active":"2023-07-12T02:02:13.333379+0000","last_became_peered":"2023-07-12T02:02:13.333379+0000","last_unstale":"2023-07-12T02:02:14.317887+0000","last_undegraded":"2023-07-12T02:02:14.317887+0000","last_fullsized":"2023-07-12T02:02:14.317887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:40:15.684880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316971+0000","last_change":"2023-07-12T02:02:12.322163+0000","last_active":"2023-07-12T02:02:14.316971+0000","last_peered":"2023-07-12T02:02:14.316971+0000","last_clean":"2023-07-12T02:02:14.316971+0000","last_became_active":"2023-07-12T02:02:12.321873+0000","last_became_peered":"2023-07-12T02:02:12.321873+0000","last_unstale":"2023-07-12T02:02:14.316971+0000","last_undegraded":"2023-07-12T02:02:14.316971+0000","last_fullsized":"2023-07-12T02:02:14.316971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:57:41.776255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317708+0000","last_change":"2023-07-12T02:02:13.324741+0000","last_active":"2023-07-12T02:02:14.317708+0000","last_peered":"2023-07-12T02:02:14.317708+0000","last_clean":"2023-07-12T02:02:14.317708+0000","last_became_active":"2023-07-12T02:02:13.324436+0000","last_became_peered":"2023-07-12T02:02:13.324436+0000","last_unstale":"2023-07-12T02:02:14.317708+0000","last_undegraded":"2023-07-12T02:02:14.317708+0000","last_fullsized":"2023-07-12T02:02:14.317708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:30:11.751660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.318115+0000","last_change":"2023-07-12T02:02:12.328371+0000","last_active":"2023-07-12T02:02:13.318115+0000","last_peered":"2023-07-12T02:02:13.318115+0000","last_clean":"2023-07-12T02:02:13.318115+0000","last_became_active":"2023-07-12T02:02:12.328097+0000","last_became_peered":"2023-07-12T02:02:12.328097+0000","last_unstale":"2023-07-12T02:02:13.318115+0000","last_undegraded":"2023-07-12T02:02:13.318115+0000","last_fullsized":"2023-07-12T02:02:13.318115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:42:54.976285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.337886+0000","last_change":"2023-07-12T02:02:13.327528+0000","last_active":"2023-07-12T02:02:13.337886+0000","last_peered":"2023-07-12T02:02:13.337886+0000","last_clean":"2023-07-12T02:02:13.337886+0000","last_became_active":"2023-07-12T02:02:13.327211+0000","last_became_peered":"2023-07-12T02:02:13.327211+0000","last_unstale":"2023-07-12T02:02:13.337886+0000","last_undegraded":"2023-07-12T02:02:13.337886+0000","last_fullsized":"2023-07-12T02:02:13.337886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:53:36.667304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.345123+0000","last_change":"2023-07-12T02:02:12.326201+0000","last_active":"2023-07-12T02:02:13.345123+0000","last_peered":"2023-07-12T02:02:13.345123+0000","last_clean":"2023-07-12T02:02:13.345123+0000","last_became_active":"2023-07-12T02:02:12.325620+0000","last_became_peered":"2023-07-12T02:02:12.325620+0000","last_unstale":"2023-07-12T02:02:13.345123+0000","last_undegraded":"2023-07-12T02:02:13.345123+0000","last_fullsized":"2023-07-12T02:02:13.345123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:20:50.862038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317820+0000","last_change":"2023-07-12T02:02:07.598601+0000","last_active":"2023-07-12T02:02:14.317820+0000","last_peered":"2023-07-12T02:02:14.317820+0000","last_clean":"2023-07-12T02:02:14.317820+0000","last_became_active":"2023-07-12T02:02:07.598343+0000","last_became_peered":"2023-07-12T02:02:07.598343+0000","last_unstale":"2023-07-12T02:02:14.317820+0000","last_undegraded":"2023-07-12T02:02:14.317820+0000","last_fullsized":"2023-07-12T02:02:14.317820+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:27:59.906561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.336381+0000","last_change":"2023-07-12T02:02:13.323317+0000","last_active":"2023-07-12T02:02:13.336381+0000","last_peered":"2023-07-12T02:02:13.336381+0000","last_clean":"2023-07-12T02:02:13.336381+0000","last_became_active":"2023-07-12T02:02:13.323003+0000","last_became_peered":"2023-07-12T02:02:13.323003+0000","last_unstale":"2023-07-12T02:02:13.336381+0000","last_undegraded":"2023-07-12T02:02:13.336381+0000","last_fullsized":"2023-07-12T02:02:13.336381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:08:44.750937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.318595+0000","last_change":"2023-07-12T02:02:07.268647+0000","last_active":"2023-07-12T02:02:13.318595+0000","last_peered":"2023-07-12T02:02:13.318595+0000","last_clean":"2023-07-12T02:02:13.318595+0000","last_became_active":"2023-07-12T02:02:07.268304+0000","last_became_peered":"2023-07-12T02:02:07.268304+0000","last_unstale":"2023-07-12T02:02:13.318595+0000","last_undegraded":"2023-07-12T02:02:13.318595+0000","last_fullsized":"2023-07-12T02:02:13.318595+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:37:24.250223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.326494+0000","last_change":"2023-07-12T02:02:12.322468+0000","last_active":"2023-07-12T02:02:13.326494+0000","last_peered":"2023-07-12T02:02:13.326494+0000","last_clean":"2023-07-12T02:02:13.326494+0000","last_became_active":"2023-07-12T02:02:12.322170+0000","last_became_peered":"2023-07-12T02:02:12.322170+0000","last_unstale":"2023-07-12T02:02:13.326494+0000","last_undegraded":"2023-07-12T02:02:13.326494+0000","last_fullsized":"2023-07-12T02:02:13.326494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:22:50.312910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317131+0000","last_change":"2023-07-12T02:02:13.317131+0000","last_active":"2023-07-12T02:02:14.317131+0000","last_peered":"2023-07-12T02:02:14.317131+0000","last_clean":"2023-07-12T02:02:14.317131+0000","last_became_active":"2023-07-12T02:02:13.316528+0000","last_became_peered":"2023-07-12T02:02:13.316528+0000","last_unstale":"2023-07-12T02:02:14.317131+0000","last_undegraded":"2023-07-12T02:02:14.317131+0000","last_fullsized":"2023-07-12T02:02:14.317131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:46:15.278272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.312149+0000","last_change":"2023-07-12T02:02:07.270653+0000","last_active":"2023-07-12T02:02:13.312149+0000","last_peered":"2023-07-12T02:02:13.312149+0000","last_clean":"2023-07-12T02:02:13.312149+0000","last_became_active":"2023-07-12T02:02:07.270293+0000","last_became_peered":"2023-07-12T02:02:07.270293+0000","last_unstale":"2023-07-12T02:02:13.312149+0000","last_undegraded":"2023-07-12T02:02:13.312149+0000","last_fullsized":"2023-07-12T02:02:13.312149+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:33:41.266032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":169,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.315265+0000","last_change":"2023-07-12T02:02:07.268364+0000","last_active":"2023-07-12T02:02:14.315265+0000","last_peered":"2023-07-12T02:02:14.315265+0000","last_clean":"2023-07-12T02:02:14.315265+0000","last_became_active":"2023-07-12T02:02:07.268074+0000","last_became_peered":"2023-07-12T02:02:07.268074+0000","last_unstale":"2023-07-12T02:02:14.315265+0000","last_undegraded":"2023-07-12T02:02:14.315265+0000","last_fullsized":"2023-07-12T02:02:14.315265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:22:09.049157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.323724+0000","last_change":"2023-07-12T02:02:12.324904+0000","last_active":"2023-07-12T02:02:13.323724+0000","last_peered":"2023-07-12T02:02:13.323724+0000","last_clean":"2023-07-12T02:02:13.323724+0000","last_became_active":"2023-07-12T02:02:12.324574+0000","last_became_peered":"2023-07-12T02:02:12.324574+0000","last_unstale":"2023-07-12T02:02:13.323724+0000","last_undegraded":"2023-07-12T02:02:13.323724+0000","last_fullsized":"2023-07-12T02:02:13.323724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:20:46.387075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.346744+0000","last_change":"2023-07-12T02:02:13.342641+0000","last_active":"2023-07-12T02:02:13.346744+0000","last_peered":"2023-07-12T02:02:13.346744+0000","last_clean":"2023-07-12T02:02:13.346744+0000","last_became_active":"2023-07-12T02:02:13.341464+0000","last_became_peered":"2023-07-12T02:02:13.341464+0000","last_unstale":"2023-07-12T02:02:13.346744+0000","last_undegraded":"2023-07-12T02:02:13.346744+0000","last_fullsized":"2023-07-12T02:02:13.346744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:35:01.956683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.314955+0000","last_change":"2023-07-12T02:02:07.599189+0000","last_active":"2023-07-12T02:02:14.314955+0000","last_peered":"2023-07-12T02:02:14.314955+0000","last_clean":"2023-07-12T02:02:14.314955+0000","last_became_active":"2023-07-12T02:02:07.598898+0000","last_became_peered":"2023-07-12T02:02:07.598898+0000","last_unstale":"2023-07-12T02:02:14.314955+0000","last_undegraded":"2023-07-12T02:02:14.314955+0000","last_fullsized":"2023-07-12T02:02:14.314955+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:16:40.286828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.310757+0000","last_change":"2023-07-12T02:02:12.327140+0000","last_active":"2023-07-12T02:02:13.310757+0000","last_peered":"2023-07-12T02:02:13.310757+0000","last_clean":"2023-07-12T02:02:13.310757+0000","last_became_active":"2023-07-12T02:02:12.326857+0000","last_became_peered":"2023-07-12T02:02:12.326857+0000","last_unstale":"2023-07-12T02:02:13.310757+0000","last_undegraded":"2023-07-12T02:02:13.310757+0000","last_fullsized":"2023-07-12T02:02:13.310757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:12:02.773394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.327397+0000","last_change":"2023-07-12T02:02:13.317477+0000","last_active":"2023-07-12T02:02:13.327397+0000","last_peered":"2023-07-12T02:02:13.327397+0000","last_clean":"2023-07-12T02:02:13.327397+0000","last_became_active":"2023-07-12T02:02:13.317140+0000","last_became_peered":"2023-07-12T02:02:13.317140+0000","last_unstale":"2023-07-12T02:02:13.327397+0000","last_undegraded":"2023-07-12T02:02:13.327397+0000","last_fullsized":"2023-07-12T02:02:13.327397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:39:36.325900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.314948+0000","last_change":"2023-07-12T02:02:07.599193+0000","last_active":"2023-07-12T02:02:14.314948+0000","last_peered":"2023-07-12T02:02:14.314948+0000","last_clean":"2023-07-12T02:02:14.314948+0000","last_became_active":"2023-07-12T02:02:07.598910+0000","last_became_peered":"2023-07-12T02:02:07.598910+0000","last_unstale":"2023-07-12T02:02:14.314948+0000","last_undegraded":"2023-07-12T02:02:14.314948+0000","last_fullsized":"2023-07-12T02:02:14.314948+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:17:25.334138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.319302+0000","last_change":"2023-07-12T02:02:12.325450+0000","last_active":"2023-07-12T02:02:13.319302+0000","last_peered":"2023-07-12T02:02:13.319302+0000","last_clean":"2023-07-12T02:02:13.319302+0000","last_became_active":"2023-07-12T02:02:12.325156+0000","last_became_peered":"2023-07-12T02:02:12.325156+0000","last_unstale":"2023-07-12T02:02:13.319302+0000","last_undegraded":"2023-07-12T02:02:13.319302+0000","last_fullsized":"2023-07-12T02:02:13.319302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:15:31.471972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.335112+0000","last_change":"2023-07-12T02:02:13.328081+0000","last_active":"2023-07-12T02:02:13.335112+0000","last_peered":"2023-07-12T02:02:13.335112+0000","last_clean":"2023-07-12T02:02:13.335112+0000","last_became_active":"2023-07-12T02:02:13.327699+0000","last_became_peered":"2023-07-12T02:02:13.327699+0000","last_unstale":"2023-07-12T02:02:13.335112+0000","last_undegraded":"2023-07-12T02:02:13.335112+0000","last_fullsized":"2023-07-12T02:02:13.335112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:07:56.951503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317109+0000","last_change":"2023-07-12T02:02:07.599477+0000","last_active":"2023-07-12T02:02:14.317109+0000","last_peered":"2023-07-12T02:02:14.317109+0000","last_clean":"2023-07-12T02:02:14.317109+0000","last_became_active":"2023-07-12T02:02:07.599111+0000","last_became_peered":"2023-07-12T02:02:07.599111+0000","last_unstale":"2023-07-12T02:02:14.317109+0000","last_undegraded":"2023-07-12T02:02:14.317109+0000","last_fullsized":"2023-07-12T02:02:14.317109+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:40:00.932400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317421+0000","last_change":"2023-07-12T02:02:12.324686+0000","last_active":"2023-07-12T02:02:14.317421+0000","last_peered":"2023-07-12T02:02:14.317421+0000","last_clean":"2023-07-12T02:02:14.317421+0000","last_became_active":"2023-07-12T02:02:12.324422+0000","last_became_peered":"2023-07-12T02:02:12.324422+0000","last_unstale":"2023-07-12T02:02:14.317421+0000","last_undegraded":"2023-07-12T02:02:14.317421+0000","last_fullsized":"2023-07-12T02:02:14.317421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:16:16.868913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.337932+0000","last_change":"2023-07-12T02:02:13.334295+0000","last_active":"2023-07-12T02:02:13.337932+0000","last_peered":"2023-07-12T02:02:13.337932+0000","last_clean":"2023-07-12T02:02:13.337932+0000","last_became_active":"2023-07-12T02:02:13.333688+0000","last_became_peered":"2023-07-12T02:02:13.333688+0000","last_unstale":"2023-07-12T02:02:13.337932+0000","last_undegraded":"2023-07-12T02:02:13.337932+0000","last_fullsized":"2023-07-12T02:02:13.337932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:42:55.983573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.322697+0000","last_change":"2023-07-12T02:02:07.599427+0000","last_active":"2023-07-12T02:02:13.322697+0000","last_peered":"2023-07-12T02:02:13.322697+0000","last_clean":"2023-07-12T02:02:13.322697+0000","last_became_active":"2023-07-12T02:02:07.599063+0000","last_became_peered":"2023-07-12T02:02:07.599063+0000","last_unstale":"2023-07-12T02:02:13.322697+0000","last_undegraded":"2023-07-12T02:02:13.322697+0000","last_fullsized":"2023-07-12T02:02:13.322697+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:42:49.939273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.311637+0000","last_change":"2023-07-12T02:02:12.327460+0000","last_active":"2023-07-12T02:02:13.311637+0000","last_peered":"2023-07-12T02:02:13.311637+0000","last_clean":"2023-07-12T02:02:13.311637+0000","last_became_active":"2023-07-12T02:02:12.327176+0000","last_became_peered":"2023-07-12T02:02:12.327176+0000","last_unstale":"2023-07-12T02:02:13.311637+0000","last_undegraded":"2023-07-12T02:02:13.311637+0000","last_fullsized":"2023-07-12T02:02:13.311637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:12:43.182965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.342395+0000","last_change":"2023-07-12T02:02:13.340465+0000","last_active":"2023-07-12T02:02:13.342395+0000","last_peered":"2023-07-12T02:02:13.342395+0000","last_clean":"2023-07-12T02:02:13.342395+0000","last_became_active":"2023-07-12T02:02:13.328675+0000","last_became_peered":"2023-07-12T02:02:13.328675+0000","last_unstale":"2023-07-12T02:02:13.342395+0000","last_undegraded":"2023-07-12T02:02:13.342395+0000","last_fullsized":"2023-07-12T02:02:13.342395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:07:41.064033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.322140+0000","last_change":"2023-07-12T02:02:07.272059+0000","last_active":"2023-07-12T02:02:13.322140+0000","last_peered":"2023-07-12T02:02:13.322140+0000","last_clean":"2023-07-12T02:02:13.322140+0000","last_became_active":"2023-07-12T02:02:07.271770+0000","last_became_peered":"2023-07-12T02:02:07.271770+0000","last_unstale":"2023-07-12T02:02:13.322140+0000","last_undegraded":"2023-07-12T02:02:13.322140+0000","last_fullsized":"2023-07-12T02:02:13.322140+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:21:40.305006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317463+0000","last_change":"2023-07-12T02:02:12.328981+0000","last_active":"2023-07-12T02:02:14.317463+0000","last_peered":"2023-07-12T02:02:14.317463+0000","last_clean":"2023-07-12T02:02:14.317463+0000","last_became_active":"2023-07-12T02:02:12.328737+0000","last_became_peered":"2023-07-12T02:02:12.328737+0000","last_unstale":"2023-07-12T02:02:14.317463+0000","last_undegraded":"2023-07-12T02:02:14.317463+0000","last_fullsized":"2023-07-12T02:02:14.317463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:17:30.371150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.326749+0000","last_change":"2023-07-12T02:02:13.321482+0000","last_active":"2023-07-12T02:02:13.326749+0000","last_peered":"2023-07-12T02:02:13.326749+0000","last_clean":"2023-07-12T02:02:13.326749+0000","last_became_active":"2023-07-12T02:02:13.321146+0000","last_became_peered":"2023-07-12T02:02:13.321146+0000","last_unstale":"2023-07-12T02:02:13.326749+0000","last_undegraded":"2023-07-12T02:02:13.326749+0000","last_fullsized":"2023-07-12T02:02:13.326749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:21:46.349305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.346824+0000","last_change":"2023-07-12T02:02:12.324771+0000","last_active":"2023-07-12T02:02:13.346824+0000","last_peered":"2023-07-12T02:02:13.346824+0000","last_clean":"2023-07-12T02:02:13.346824+0000","last_became_active":"2023-07-12T02:02:12.324451+0000","last_became_peered":"2023-07-12T02:02:12.324451+0000","last_unstale":"2023-07-12T02:02:13.346824+0000","last_undegraded":"2023-07-12T02:02:13.346824+0000","last_fullsized":"2023-07-12T02:02:13.346824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:12:43.182965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.334952+0000","last_change":"2023-07-12T02:02:13.330617+0000","last_active":"2023-07-12T02:02:13.334952+0000","last_peered":"2023-07-12T02:02:13.334952+0000","last_clean":"2023-07-12T02:02:13.334952+0000","last_became_active":"2023-07-12T02:02:13.329921+0000","last_became_peered":"2023-07-12T02:02:13.329921+0000","last_unstale":"2023-07-12T02:02:13.334952+0000","last_undegraded":"2023-07-12T02:02:13.334952+0000","last_fullsized":"2023-07-12T02:02:13.334952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:02:38.589333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316667+0000","last_change":"2023-07-12T02:02:12.324065+0000","last_active":"2023-07-12T02:02:14.316667+0000","last_peered":"2023-07-12T02:02:14.316667+0000","last_clean":"2023-07-12T02:02:14.316667+0000","last_became_active":"2023-07-12T02:02:12.323792+0000","last_became_peered":"2023-07-12T02:02:12.323792+0000","last_unstale":"2023-07-12T02:02:14.316667+0000","last_undegraded":"2023-07-12T02:02:14.316667+0000","last_fullsized":"2023-07-12T02:02:14.316667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:37:29.287235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317154+0000","last_change":"2023-07-12T02:02:13.324540+0000","last_active":"2023-07-12T02:02:14.317154+0000","last_peered":"2023-07-12T02:02:14.317154+0000","last_clean":"2023-07-12T02:02:14.317154+0000","last_became_active":"2023-07-12T02:02:13.324245+0000","last_became_peered":"2023-07-12T02:02:13.324245+0000","last_unstale":"2023-07-12T02:02:14.317154+0000","last_undegraded":"2023-07-12T02:02:14.317154+0000","last_fullsized":"2023-07-12T02:02:14.317154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:20:28.296999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317616+0000","last_change":"2023-07-12T02:02:12.323954+0000","last_active":"2023-07-12T02:02:14.317616+0000","last_peered":"2023-07-12T02:02:14.317616+0000","last_clean":"2023-07-12T02:02:14.317616+0000","last_became_active":"2023-07-12T02:02:12.323681+0000","last_became_peered":"2023-07-12T02:02:12.323681+0000","last_unstale":"2023-07-12T02:02:14.317616+0000","last_undegraded":"2023-07-12T02:02:14.317616+0000","last_fullsized":"2023-07-12T02:02:14.317616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:25:18.861513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316914+0000","last_change":"2023-07-12T02:02:13.325210+0000","last_active":"2023-07-12T02:02:14.316914+0000","last_peered":"2023-07-12T02:02:14.316914+0000","last_clean":"2023-07-12T02:02:14.316914+0000","last_became_active":"2023-07-12T02:02:13.324920+0000","last_became_peered":"2023-07-12T02:02:13.324920+0000","last_unstale":"2023-07-12T02:02:14.316914+0000","last_undegraded":"2023-07-12T02:02:14.316914+0000","last_fullsized":"2023-07-12T02:02:14.316914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:14:43.647200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.345656+0000","last_change":"2023-07-12T02:02:12.325289+0000","last_active":"2023-07-12T02:02:13.345656+0000","last_peered":"2023-07-12T02:02:13.345656+0000","last_clean":"2023-07-12T02:02:13.345656+0000","last_became_active":"2023-07-12T02:02:12.324997+0000","last_became_peered":"2023-07-12T02:02:12.324997+0000","last_unstale":"2023-07-12T02:02:13.345656+0000","last_undegraded":"2023-07-12T02:02:13.345656+0000","last_fullsized":"2023-07-12T02:02:13.345656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:33:46.303044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.336775+0000","last_change":"2023-07-12T02:02:13.333732+0000","last_active":"2023-07-12T02:02:13.336775+0000","last_peered":"2023-07-12T02:02:13.336775+0000","last_clean":"2023-07-12T02:02:13.336775+0000","last_became_active":"2023-07-12T02:02:13.332925+0000","last_became_peered":"2023-07-12T02:02:13.332925+0000","last_unstale":"2023-07-12T02:02:13.336775+0000","last_undegraded":"2023-07-12T02:02:13.336775+0000","last_fullsized":"2023-07-12T02:02:13.336775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:12:44.190253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.347068+0000","last_change":"2023-07-12T02:02:12.326847+0000","last_active":"2023-07-12T02:02:13.347068+0000","last_peered":"2023-07-12T02:02:13.347068+0000","last_clean":"2023-07-12T02:02:13.347068+0000","last_became_active":"2023-07-12T02:02:12.326564+0000","last_became_peered":"2023-07-12T02:02:12.326564+0000","last_unstale":"2023-07-12T02:02:13.347068+0000","last_undegraded":"2023-07-12T02:02:13.347068+0000","last_fullsized":"2023-07-12T02:02:13.347068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:42:54.976285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316667+0000","last_change":"2023-07-12T02:02:13.324603+0000","last_active":"2023-07-12T02:02:14.316667+0000","last_peered":"2023-07-12T02:02:14.316667+0000","last_clean":"2023-07-12T02:02:14.316667+0000","last_became_active":"2023-07-12T02:02:13.324373+0000","last_became_peered":"2023-07-12T02:02:13.324373+0000","last_unstale":"2023-07-12T02:02:14.316667+0000","last_undegraded":"2023-07-12T02:02:14.316667+0000","last_fullsized":"2023-07-12T02:02:14.316667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:25:19.868800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.337267+0000","last_change":"2023-07-12T02:02:13.335337+0000","last_active":"2023-07-12T02:02:13.337267+0000","last_peered":"2023-07-12T02:02:13.337267+0000","last_clean":"2023-07-12T02:02:13.337267+0000","last_became_active":"2023-07-12T02:02:13.335059+0000","last_became_peered":"2023-07-12T02:02:13.335059+0000","last_unstale":"2023-07-12T02:02:13.337267+0000","last_undegraded":"2023-07-12T02:02:13.337267+0000","last_fullsized":"2023-07-12T02:02:13.337267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:20:47.394363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.340416+0000","last_change":"2023-07-12T02:02:13.338052+0000","last_active":"2023-07-12T02:02:13.340416+0000","last_peered":"2023-07-12T02:02:13.340416+0000","last_clean":"2023-07-12T02:02:13.340416+0000","last_became_active":"2023-07-12T02:02:13.337744+0000","last_became_peered":"2023-07-12T02:02:13.337744+0000","last_unstale":"2023-07-12T02:02:13.340416+0000","last_undegraded":"2023-07-12T02:02:13.340416+0000","last_fullsized":"2023-07-12T02:02:13.340416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:51:50.388106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316568+0000","last_change":"2023-07-12T02:02:13.323841+0000","last_active":"2023-07-12T02:02:14.316568+0000","last_peered":"2023-07-12T02:02:14.316568+0000","last_clean":"2023-07-12T02:02:14.316568+0000","last_became_active":"2023-07-12T02:02:13.323558+0000","last_became_peered":"2023-07-12T02:02:13.323558+0000","last_unstale":"2023-07-12T02:02:14.316568+0000","last_undegraded":"2023-07-12T02:02:14.316568+0000","last_fullsized":"2023-07-12T02:02:14.316568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:16:46.331127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.337326+0000","last_change":"2023-07-12T02:02:13.333951+0000","last_active":"2023-07-12T02:02:13.337326+0000","last_peered":"2023-07-12T02:02:13.337326+0000","last_clean":"2023-07-12T02:02:13.337326+0000","last_became_active":"2023-07-12T02:02:13.332574+0000","last_became_peered":"2023-07-12T02:02:13.332574+0000","last_unstale":"2023-07-12T02:02:13.337326+0000","last_undegraded":"2023-07-12T02:02:13.337326+0000","last_fullsized":"2023-07-12T02:02:13.337326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:35:01.956683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.326656+0000","last_change":"2023-07-12T02:02:13.320239+0000","last_active":"2023-07-12T02:02:13.326656+0000","last_peered":"2023-07-12T02:02:13.326656+0000","last_clean":"2023-07-12T02:02:13.326656+0000","last_became_active":"2023-07-12T02:02:13.319332+0000","last_became_peered":"2023-07-12T02:02:13.319332+0000","last_unstale":"2023-07-12T02:02:13.326656+0000","last_undegraded":"2023-07-12T02:02:13.326656+0000","last_fullsized":"2023-07-12T02:02:13.326656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:08:44.750937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":835584,"data_stored":670286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":72446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":794624,"data_stored":661853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.253}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":72067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":200704,"data_stored":71485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":72536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":79758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":79751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-12T02:02:17.480 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-12T02:02:17.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.633+0000 7f34ce3b5700 1 Processor -- start 2023-07-12T02:02:17.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.633+0000 7f34ce3b5700 1 -- start start 2023-07-12T02:02:17.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.634+0000 7f34ce3b5700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f34c8141780 0x7f34c80ba010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:17.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.634+0000 7f34ce3b5700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34c8070e70 con 0x7f34c8071a30 2023-07-12T02:02:17.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.634+0000 7f34ce3b5700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34c8071ea0 con 0x7f34c80b96b0 2023-07-12T02:02:17.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.634+0000 7f34ce3b5700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34c80b9b40 con 0x7f34c8141780 2023-07-12T02:02:17.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.634+0000 7f34c7fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f34c8141780 0x7f34c80ba010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:17.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.634+0000 7f34c77fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f34c8071a30 0x7f34c814ab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46014/0 (socket says 172.21.15.60:46014) 2023-07-12T02:02:17.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.634+0000 7f34c7fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f34c8141780 0x7f34c80ba010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50280/0 (socket says 172.21.15.60:50280) 2023-07-12T02:02:17.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.634+0000 7f34c77fe700 1 -- 172.21.15.60:0/2931893040 learned_addr learned my addr 172.21.15.60:0/2931893040 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:17.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.635+0000 7f34c7fff700 1 -- 172.21.15.60:0/2931893040 >> v1:172.21.15.79:6789/0 conn(0x7f34c80b96b0 legacy=0x7f34c8151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:17.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.635+0000 7f34c7fff700 1 -- 172.21.15.60:0/2931893040 >> v1:172.21.15.60:6789/0 conn(0x7f34c8071a30 legacy=0x7f34c814ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:17.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.635+0000 7f34c7fff700 1 -- 172.21.15.60:0/2931893040 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c8070670 con 0x7f34c8141780 2023-07-12T02:02:17.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.635+0000 7f34c6ffd700 1 -- 172.21.15.60:0/2931893040 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 906728262 0 0) 0x7f34c8070e70 con 0x7f34c8071a30 2023-07-12T02:02:17.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.635+0000 7f34c7fff700 1 --2- 172.21.15.60:0/2931893040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34c8141780 0x7f34c80ba010 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f34b800bae0 tx=0x7f34b800bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2032e751db163662 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:17.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.635+0000 7f34c6ffd700 1 -- 172.21.15.60:0/2931893040 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b800dd30 con 0x7f34c8141780 2023-07-12T02:02:17.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.635+0000 7f34c6ffd700 1 -- 172.21.15.60:0/2931893040 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b800de90 con 0x7f34c8141780 2023-07-12T02:02:17.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.635+0000 7f34c6ffd700 1 -- 172.21.15.60:0/2931893040 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b8010690 con 0x7f34c8141780 2023-07-12T02:02:17.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.635+0000 7f34ce3b5700 1 -- 172.21.15.60:0/2931893040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34c8141780 msgr2=0x7f34c80ba010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:17.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.635+0000 7f34ce3b5700 1 --2- 172.21.15.60:0/2931893040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34c8141780 0x7f34c80ba010 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f34b800bae0 tx=0x7f34b800bdf0 comp rx=0 tx=0).stop 2023-07-12T02:02:17.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.635+0000 7f34ce3b5700 1 -- 172.21.15.60:0/2931893040 shutdown_connections 2023-07-12T02:02:17.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.635+0000 7f34ce3b5700 1 --2- 172.21.15.60:0/2931893040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34c8141780 0x7f34c80ba010 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:17.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.635+0000 7f34ce3b5700 1 -- 172.21.15.60:0/2931893040 >> 172.21.15.60:0/2931893040 conn(0x7f34c806d0e0 msgr2=0x7f34c806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:17.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.636+0000 7f34ce3b5700 1 -- 172.21.15.60:0/2931893040 shutdown_connections 2023-07-12T02:02:17.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.636+0000 7f34ce3b5700 1 -- 172.21.15.60:0/2931893040 wait complete. 2023-07-12T02:02:17.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.637+0000 7f34ce3b5700 1 Processor -- start 2023-07-12T02:02:17.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.637+0000 7f34ce3b5700 1 -- start start 2023-07-12T02:02:17.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.637+0000 7f34ce3b5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34c8071a30 0x7f34c81d0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:17.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.637+0000 7f34ce3b5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34c80b96b0 0x7f34c81d1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:17.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.637+0000 7f34ce3b5700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f34c8141780 0x7f34c81d1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:17.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.637+0000 7f34ce3b5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c81d37f0 con 0x7f34c80b96b0 2023-07-12T02:02:17.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.637+0000 7f34ce3b5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c81d16a0 con 0x7f34c8071a30 2023-07-12T02:02:17.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.637+0000 7f34ce3b5700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34c81d2f10 con 0x7f34c8141780 2023-07-12T02:02:17.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.637+0000 7f34c77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34c80b96b0 0x7f34c81d1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:17.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.637+0000 7f34c77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34c80b96b0 0x7f34c81d1960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50284/0 (socket says 172.21.15.60:50284) 2023-07-12T02:02:17.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.637+0000 7f34c77fe700 1 -- 172.21.15.60:0/1758610652 learned_addr learned my addr 172.21.15.60:0/1758610652 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:17.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.638+0000 7f34c7fff700 1 --2- 172.21.15.60:0/1758610652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34c8071a30 0x7f34c81d0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:17.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.638+0000 7f34cc952700 1 --2- 172.21.15.60:0/1758610652 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f34c8141780 0x7f34c81d1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:17.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.638+0000 7f34c77fe700 1 -- 172.21.15.60:0/1758610652 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f34c8141780 msgr2=0x7f34c81d1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:17.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.638+0000 7f34c77fe700 1 --2- 172.21.15.60:0/1758610652 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f34c8141780 0x7f34c81d1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:17.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.638+0000 7f34c77fe700 1 -- 172.21.15.60:0/1758610652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34c8071a30 msgr2=0x7f34c81d0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:17.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.638+0000 7f34c77fe700 1 --2- 172.21.15.60:0/1758610652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34c8071a30 0x7f34c81d0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:17.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.638+0000 7f34c77fe700 1 -- 172.21.15.60:0/1758610652 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b800b740 con 0x7f34c80b96b0 2023-07-12T02:02:17.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.638+0000 7f34c77fe700 1 --2- 172.21.15.60:0/1758610652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34c80b96b0 0x7f34c81d1960 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f34b000c580 tx=0x7f34b000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:17.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.638+0000 7f34c4ff9700 1 -- 172.21.15.60:0/1758610652 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b0004c80 con 0x7f34c80b96b0 2023-07-12T02:02:17.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.638+0000 7f34c4ff9700 1 -- 172.21.15.60:0/1758610652 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b0004e20 con 0x7f34c80b96b0 2023-07-12T02:02:17.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.638+0000 7f34ce3b5700 1 -- 172.21.15.60:0/1758610652 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34c8138a90 con 0x7f34c80b96b0 2023-07-12T02:02:17.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.638+0000 7f34c4ff9700 1 -- 172.21.15.60:0/1758610652 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b0007310 con 0x7f34c80b96b0 2023-07-12T02:02:17.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.638+0000 7f34ce3b5700 1 -- 172.21.15.60:0/1758610652 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34c81dbfa0 con 0x7f34c80b96b0 2023-07-12T02:02:17.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.639+0000 7f34ce3b5700 1 -- 172.21.15.60:0/1758610652 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34c8074360 con 0x7f34c80b96b0 2023-07-12T02:02:17.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.640+0000 7f34c4ff9700 1 -- 172.21.15.60:0/1758610652 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f34b0007470 con 0x7f34c80b96b0 2023-07-12T02:02:17.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.640+0000 7f34c4ff9700 1 --2- 172.21.15.60:0/1758610652 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f34a806ace0 0x7f34a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:17.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.640+0000 7f34c4ff9700 1 -- 172.21.15.60:0/1758610652 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f34b0089050 con 0x7f34c80b96b0 2023-07-12T02:02:17.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.640+0000 7f34c7fff700 1 --2- 172.21.15.60:0/1758610652 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f34a806ace0 0x7f34a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:17.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.641+0000 7f34c7fff700 1 --2- 172.21.15.60:0/1758610652 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f34a806ace0 0x7f34a806d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f34b800b2c0 tx=0x7f34b8013000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:17.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.645+0000 7f34c4ff9700 1 -- 172.21.15.60:0/1758610652 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f34b0054190 con 0x7f34c80b96b0 2023-07-12T02:02:17.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.838+0000 7f34ce3b5700 1 -- 172.21.15.60:0/1758610652 --> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f34c8141b50 con 0x7f34a806ace0 2023-07-12T02:02:17.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.846+0000 7f34c4ff9700 1 -- 172.21.15.60:0/1758610652 <== mgr.4105 v2:172.21.15.79:6832/1173177519 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286912 (secure 0 0 0) 0x7f34b80105a0 con 0x7f34a806ace0 2023-07-12T02:02:17.851 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:02:17.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.849+0000 7f34ce3b5700 1 -- 172.21.15.60:0/1758610652 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f34a806ace0 msgr2=0x7f34a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:17.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.849+0000 7f34ce3b5700 1 --2- 172.21.15.60:0/1758610652 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f34a806ace0 0x7f34a806d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f34b800b2c0 tx=0x7f34b8013000 comp rx=0 tx=0).stop 2023-07-12T02:02:17.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.849+0000 7f34ce3b5700 1 -- 172.21.15.60:0/1758610652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34c80b96b0 msgr2=0x7f34c81d1960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:17.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.849+0000 7f34ce3b5700 1 --2- 172.21.15.60:0/1758610652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34c80b96b0 0x7f34c81d1960 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f34b000c580 tx=0x7f34b000c890 comp rx=0 tx=0).stop 2023-07-12T02:02:17.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.849+0000 7f34ce3b5700 1 -- 172.21.15.60:0/1758610652 shutdown_connections 2023-07-12T02:02:17.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.849+0000 7f34ce3b5700 1 --2- 172.21.15.60:0/1758610652 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f34a806ace0 0x7f34a806d190 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:17.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.849+0000 7f34ce3b5700 1 --2- 172.21.15.60:0/1758610652 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f34c8141780 0x7f34c81d1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:17.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.849+0000 7f34ce3b5700 1 --2- 172.21.15.60:0/1758610652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34c8071a30 0x7f34c81d0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:17.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.849+0000 7f34ce3b5700 1 --2- 172.21.15.60:0/1758610652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34c80b96b0 0x7f34c81d1960 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:17.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.849+0000 7f34ce3b5700 1 -- 172.21.15.60:0/1758610652 >> 172.21.15.60:0/1758610652 conn(0x7f34c806d0e0 msgr2=0x7f34c81409f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:17.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.849+0000 7f34ce3b5700 1 -- 172.21.15.60:0/1758610652 shutdown_connections 2023-07-12T02:02:17.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:17.849+0000 7f34ce3b5700 1 -- 172.21.15.60:0/1758610652 wait complete. 2023-07-12T02:02:17.855 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-07-12T02:02:17.864 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-07-12T02:02:17.802085+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":134,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219044,"kb_used_data":2840,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755676,"statfs":{"total":773094113280,"available":772869812224,"internally_reserved":0,"allocated":2908160,"data_stored":1780182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001488"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.339236+0000","last_change":"2023-07-12T02:02:13.337541+0000","last_active":"2023-07-12T02:02:13.339236+0000","last_peered":"2023-07-12T02:02:13.339236+0000","last_clean":"2023-07-12T02:02:13.339236+0000","last_became_active":"2023-07-12T02:02:13.337208+0000","last_became_peered":"2023-07-12T02:02:13.337208+0000","last_unstale":"2023-07-12T02:02:13.339236+0000","last_undegraded":"2023-07-12T02:02:13.339236+0000","last_fullsized":"2023-07-12T02:02:13.339236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:04:15.802706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316831+0000","last_change":"2023-07-12T02:02:13.326771+0000","last_active":"2023-07-12T02:02:14.316831+0000","last_peered":"2023-07-12T02:02:14.316831+0000","last_clean":"2023-07-12T02:02:14.316831+0000","last_became_active":"2023-07-12T02:02:13.326496+0000","last_became_peered":"2023-07-12T02:02:13.326496+0000","last_unstale":"2023-07-12T02:02:14.316831+0000","last_undegraded":"2023-07-12T02:02:14.316831+0000","last_fullsized":"2023-07-12T02:02:14.316831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:15:32.479260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317741+0000","last_change":"2023-07-12T02:02:13.329834+0000","last_active":"2023-07-12T02:02:14.317741+0000","last_peered":"2023-07-12T02:02:14.317741+0000","last_clean":"2023-07-12T02:02:14.317741+0000","last_became_active":"2023-07-12T02:02:13.329474+0000","last_became_peered":"2023-07-12T02:02:13.329474+0000","last_unstale":"2023-07-12T02:02:14.317741+0000","last_undegraded":"2023-07-12T02:02:14.317741+0000","last_fullsized":"2023-07-12T02:02:14.317741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:21:36.117239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.336804+0000","last_change":"2023-07-12T02:02:13.334760+0000","last_active":"2023-07-12T02:02:13.336804+0000","last_peered":"2023-07-12T02:02:13.336804+0000","last_clean":"2023-07-12T02:02:13.336804+0000","last_became_active":"2023-07-12T02:02:13.329155+0000","last_became_peered":"2023-07-12T02:02:13.329155+0000","last_unstale":"2023-07-12T02:02:13.336804+0000","last_undegraded":"2023-07-12T02:02:13.336804+0000","last_fullsized":"2023-07-12T02:02:13.336804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:08:44.750937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.346735+0000","last_change":"2023-07-12T02:02:13.342289+0000","last_active":"2023-07-12T02:02:13.346735+0000","last_peered":"2023-07-12T02:02:13.346735+0000","last_clean":"2023-07-12T02:02:13.346735+0000","last_became_active":"2023-07-12T02:02:13.341024+0000","last_became_peered":"2023-07-12T02:02:13.341024+0000","last_unstale":"2023-07-12T02:02:13.346735+0000","last_undegraded":"2023-07-12T02:02:13.346735+0000","last_fullsized":"2023-07-12T02:02:13.346735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:26:12.486521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316438+0000","last_change":"2023-07-12T02:02:13.328776+0000","last_active":"2023-07-12T02:02:14.316438+0000","last_peered":"2023-07-12T02:02:14.316438+0000","last_clean":"2023-07-12T02:02:14.316438+0000","last_became_active":"2023-07-12T02:02:13.328433+0000","last_became_peered":"2023-07-12T02:02:13.328433+0000","last_unstale":"2023-07-12T02:02:14.316438+0000","last_undegraded":"2023-07-12T02:02:14.316438+0000","last_fullsized":"2023-07-12T02:02:14.316438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:41:14.864536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.315227+0000","last_change":"2023-07-12T02:02:13.333771+0000","last_active":"2023-07-12T02:02:14.315227+0000","last_peered":"2023-07-12T02:02:14.315227+0000","last_clean":"2023-07-12T02:02:14.315227+0000","last_became_active":"2023-07-12T02:02:13.332954+0000","last_became_peered":"2023-07-12T02:02:13.332954+0000","last_unstale":"2023-07-12T02:02:14.315227+0000","last_undegraded":"2023-07-12T02:02:14.315227+0000","last_fullsized":"2023-07-12T02:02:14.315227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:47:51.304545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316880+0000","last_change":"2023-07-12T02:02:13.321126+0000","last_active":"2023-07-12T02:02:14.316880+0000","last_peered":"2023-07-12T02:02:14.316880+0000","last_clean":"2023-07-12T02:02:14.316880+0000","last_became_active":"2023-07-12T02:02:13.320733+0000","last_became_peered":"2023-07-12T02:02:13.320733+0000","last_unstale":"2023-07-12T02:02:14.316880+0000","last_undegraded":"2023-07-12T02:02:14.316880+0000","last_fullsized":"2023-07-12T02:02:14.316880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:09:38.066919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.346741+0000","last_change":"2023-07-12T02:02:13.341524+0000","last_active":"2023-07-12T02:02:13.346741+0000","last_peered":"2023-07-12T02:02:13.346741+0000","last_clean":"2023-07-12T02:02:13.346741+0000","last_became_active":"2023-07-12T02:02:13.341060+0000","last_became_peered":"2023-07-12T02:02:13.341060+0000","last_unstale":"2023-07-12T02:02:13.346741+0000","last_undegraded":"2023-07-12T02:02:13.346741+0000","last_fullsized":"2023-07-12T02:02:13.346741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:12:03.780682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317439+0000","last_change":"2023-07-12T02:02:13.335214+0000","last_active":"2023-07-12T02:02:14.317439+0000","last_peered":"2023-07-12T02:02:14.317439+0000","last_clean":"2023-07-12T02:02:14.317439+0000","last_became_active":"2023-07-12T02:02:13.334928+0000","last_became_peered":"2023-07-12T02:02:13.334928+0000","last_unstale":"2023-07-12T02:02:14.317439+0000","last_undegraded":"2023-07-12T02:02:14.317439+0000","last_fullsized":"2023-07-12T02:02:14.317439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:17:05.090789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317721+0000","last_change":"2023-07-12T02:02:13.327183+0000","last_active":"2023-07-12T02:02:14.317721+0000","last_peered":"2023-07-12T02:02:14.317721+0000","last_clean":"2023-07-12T02:02:14.317721+0000","last_became_active":"2023-07-12T02:02:13.326918+0000","last_became_peered":"2023-07-12T02:02:13.326918+0000","last_unstale":"2023-07-12T02:02:14.317721+0000","last_undegraded":"2023-07-12T02:02:14.317721+0000","last_fullsized":"2023-07-12T02:02:14.317721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:07:26.932388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.334976+0000","last_change":"2023-07-12T02:02:13.330866+0000","last_active":"2023-07-12T02:02:13.334976+0000","last_peered":"2023-07-12T02:02:13.334976+0000","last_clean":"2023-07-12T02:02:13.334976+0000","last_became_active":"2023-07-12T02:02:13.330331+0000","last_became_peered":"2023-07-12T02:02:13.330331+0000","last_unstale":"2023-07-12T02:02:13.334976+0000","last_undegraded":"2023-07-12T02:02:13.334976+0000","last_fullsized":"2023-07-12T02:02:13.334976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:38:51.656153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.339120+0000","last_change":"2023-07-12T02:02:13.337965+0000","last_active":"2023-07-12T02:02:13.339120+0000","last_peered":"2023-07-12T02:02:13.339120+0000","last_clean":"2023-07-12T02:02:13.339120+0000","last_became_active":"2023-07-12T02:02:13.337069+0000","last_became_peered":"2023-07-12T02:02:13.337069+0000","last_unstale":"2023-07-12T02:02:13.339120+0000","last_undegraded":"2023-07-12T02:02:13.339120+0000","last_fullsized":"2023-07-12T02:02:13.339120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:00:02.438999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316721+0000","last_change":"2023-07-12T02:02:13.333391+0000","last_active":"2023-07-12T02:02:14.316721+0000","last_peered":"2023-07-12T02:02:14.316721+0000","last_clean":"2023-07-12T02:02:14.316721+0000","last_became_active":"2023-07-12T02:02:13.333091+0000","last_became_peered":"2023-07-12T02:02:13.333091+0000","last_unstale":"2023-07-12T02:02:14.316721+0000","last_undegraded":"2023-07-12T02:02:14.316721+0000","last_fullsized":"2023-07-12T02:02:14.316721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:17:08.165931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.315629+0000","last_change":"2023-07-12T02:02:13.333879+0000","last_active":"2023-07-12T02:02:14.315629+0000","last_peered":"2023-07-12T02:02:14.315629+0000","last_clean":"2023-07-12T02:02:14.315629+0000","last_became_active":"2023-07-12T02:02:13.333334+0000","last_became_peered":"2023-07-12T02:02:13.333334+0000","last_unstale":"2023-07-12T02:02:14.315629+0000","last_undegraded":"2023-07-12T02:02:14.315629+0000","last_fullsized":"2023-07-12T02:02:14.315629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:52:47.727485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316830+0000","last_change":"2023-07-12T02:02:13.328684+0000","last_active":"2023-07-12T02:02:14.316830+0000","last_peered":"2023-07-12T02:02:14.316830+0000","last_clean":"2023-07-12T02:02:14.316830+0000","last_became_active":"2023-07-12T02:02:13.328364+0000","last_became_peered":"2023-07-12T02:02:13.328364+0000","last_unstale":"2023-07-12T02:02:14.316830+0000","last_undegraded":"2023-07-12T02:02:14.316830+0000","last_fullsized":"2023-07-12T02:02:14.316830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:22:15.093456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.346645+0000","last_change":"2023-07-12T02:02:13.341527+0000","last_active":"2023-07-12T02:02:13.346645+0000","last_peered":"2023-07-12T02:02:13.346645+0000","last_clean":"2023-07-12T02:02:13.346645+0000","last_became_active":"2023-07-12T02:02:13.341127+0000","last_became_peered":"2023-07-12T02:02:13.341127+0000","last_unstale":"2023-07-12T02:02:13.346645+0000","last_undegraded":"2023-07-12T02:02:13.346645+0000","last_fullsized":"2023-07-12T02:02:13.346645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:21:46.349305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317709+0000","last_change":"2023-07-12T02:02:13.330871+0000","last_active":"2023-07-12T02:02:14.317709+0000","last_peered":"2023-07-12T02:02:14.317709+0000","last_clean":"2023-07-12T02:02:14.317709+0000","last_became_active":"2023-07-12T02:02:13.330590+0000","last_became_peered":"2023-07-12T02:02:13.330590+0000","last_unstale":"2023-07-12T02:02:14.317709+0000","last_undegraded":"2023-07-12T02:02:14.317709+0000","last_fullsized":"2023-07-12T02:02:14.317709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:11:43.867415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.331010+0000","last_change":"2023-07-12T02:02:13.326393+0000","last_active":"2023-07-12T02:02:13.331010+0000","last_peered":"2023-07-12T02:02:13.331010+0000","last_clean":"2023-07-12T02:02:13.331010+0000","last_became_active":"2023-07-12T02:02:13.326082+0000","last_became_peered":"2023-07-12T02:02:13.326082+0000","last_unstale":"2023-07-12T02:02:13.331010+0000","last_undegraded":"2023-07-12T02:02:13.331010+0000","last_fullsized":"2023-07-12T02:02:13.331010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:46:17.305989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317826+0000","last_change":"2023-07-12T02:02:13.322548+0000","last_active":"2023-07-12T02:02:14.317826+0000","last_peered":"2023-07-12T02:02:14.317826+0000","last_clean":"2023-07-12T02:02:14.317826+0000","last_became_active":"2023-07-12T02:02:13.322298+0000","last_became_peered":"2023-07-12T02:02:13.322298+0000","last_unstale":"2023-07-12T02:02:14.317826+0000","last_undegraded":"2023-07-12T02:02:14.317826+0000","last_fullsized":"2023-07-12T02:02:14.317826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:31:00.185527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.315759+0000","last_change":"2023-07-12T02:02:13.337864+0000","last_active":"2023-07-12T02:02:14.315759+0000","last_peered":"2023-07-12T02:02:14.315759+0000","last_clean":"2023-07-12T02:02:14.315759+0000","last_became_active":"2023-07-12T02:02:13.337675+0000","last_became_peered":"2023-07-12T02:02:13.337675+0000","last_unstale":"2023-07-12T02:02:14.315759+0000","last_undegraded":"2023-07-12T02:02:14.315759+0000","last_fullsized":"2023-07-12T02:02:14.315759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:31:00.185527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.346709+0000","last_change":"2023-07-12T02:02:13.341938+0000","last_active":"2023-07-12T02:02:13.346709+0000","last_peered":"2023-07-12T02:02:13.346709+0000","last_clean":"2023-07-12T02:02:13.346709+0000","last_became_active":"2023-07-12T02:02:13.341364+0000","last_became_peered":"2023-07-12T02:02:13.341364+0000","last_unstale":"2023-07-12T02:02:13.346709+0000","last_undegraded":"2023-07-12T02:02:13.346709+0000","last_fullsized":"2023-07-12T02:02:13.346709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:51:36.080105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.340395+0000","last_change":"2023-07-12T02:02:13.337225+0000","last_active":"2023-07-12T02:02:13.340395+0000","last_peered":"2023-07-12T02:02:13.340395+0000","last_clean":"2023-07-12T02:02:13.340395+0000","last_became_active":"2023-07-12T02:02:13.336940+0000","last_became_peered":"2023-07-12T02:02:13.336940+0000","last_unstale":"2023-07-12T02:02:13.340395+0000","last_undegraded":"2023-07-12T02:02:13.340395+0000","last_fullsized":"2023-07-12T02:02:13.340395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:09:38.066919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.315161+0000","last_change":"2023-07-12T02:02:13.325230+0000","last_active":"2023-07-12T02:02:14.315161+0000","last_peered":"2023-07-12T02:02:14.315161+0000","last_clean":"2023-07-12T02:02:14.315161+0000","last_became_active":"2023-07-12T02:02:13.324929+0000","last_became_peered":"2023-07-12T02:02:13.324929+0000","last_unstale":"2023-07-12T02:02:14.315161+0000","last_undegraded":"2023-07-12T02:02:14.315161+0000","last_fullsized":"2023-07-12T02:02:14.315161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:25:19.868800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.337865+0000","last_change":"2023-07-12T02:02:13.327418+0000","last_active":"2023-07-12T02:02:13.337865+0000","last_peered":"2023-07-12T02:02:13.337865+0000","last_clean":"2023-07-12T02:02:13.337865+0000","last_became_active":"2023-07-12T02:02:13.327154+0000","last_became_peered":"2023-07-12T02:02:13.327154+0000","last_unstale":"2023-07-12T02:02:13.337865+0000","last_undegraded":"2023-07-12T02:02:13.337865+0000","last_fullsized":"2023-07-12T02:02:13.337865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:07:56.951503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.336135+0000","last_change":"2023-07-12T02:02:13.330432+0000","last_active":"2023-07-12T02:02:13.336135+0000","last_peered":"2023-07-12T02:02:13.336135+0000","last_clean":"2023-07-12T02:02:13.336135+0000","last_became_active":"2023-07-12T02:02:13.330105+0000","last_became_peered":"2023-07-12T02:02:13.330105+0000","last_unstale":"2023-07-12T02:02:13.336135+0000","last_undegraded":"2023-07-12T02:02:13.336135+0000","last_fullsized":"2023-07-12T02:02:13.336135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:26:12.486521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317496+0000","last_change":"2023-07-12T02:02:13.319765+0000","last_active":"2023-07-12T02:02:14.317496+0000","last_peered":"2023-07-12T02:02:14.317496+0000","last_clean":"2023-07-12T02:02:14.317496+0000","last_became_active":"2023-07-12T02:02:13.319286+0000","last_became_peered":"2023-07-12T02:02:13.319286+0000","last_unstale":"2023-07-12T02:02:14.317496+0000","last_undegraded":"2023-07-12T02:02:14.317496+0000","last_fullsized":"2023-07-12T02:02:14.317496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:16:46.331127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316716+0000","last_change":"2023-07-12T02:02:12.321483+0000","last_active":"2023-07-12T02:02:14.316716+0000","last_peered":"2023-07-12T02:02:14.316716+0000","last_clean":"2023-07-12T02:02:14.316716+0000","last_became_active":"2023-07-12T02:02:12.321175+0000","last_became_peered":"2023-07-12T02:02:12.321175+0000","last_unstale":"2023-07-12T02:02:14.316716+0000","last_undegraded":"2023-07-12T02:02:14.316716+0000","last_fullsized":"2023-07-12T02:02:14.316716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:47:50.297258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.335112+0000","last_change":"2023-07-12T02:02:13.330375+0000","last_active":"2023-07-12T02:02:13.335112+0000","last_peered":"2023-07-12T02:02:13.335112+0000","last_clean":"2023-07-12T02:02:13.335112+0000","last_became_active":"2023-07-12T02:02:13.330053+0000","last_became_peered":"2023-07-12T02:02:13.330053+0000","last_unstale":"2023-07-12T02:02:13.335112+0000","last_undegraded":"2023-07-12T02:02:13.335112+0000","last_fullsized":"2023-07-12T02:02:13.335112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:39:36.325900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.310755+0000","last_change":"2023-07-12T02:02:12.329289+0000","last_active":"2023-07-12T02:02:13.310755+0000","last_peered":"2023-07-12T02:02:13.310755+0000","last_clean":"2023-07-12T02:02:13.310755+0000","last_became_active":"2023-07-12T02:02:12.328952+0000","last_became_peered":"2023-07-12T02:02:12.328952+0000","last_unstale":"2023-07-12T02:02:13.310755+0000","last_undegraded":"2023-07-12T02:02:13.310755+0000","last_fullsized":"2023-07-12T02:02:13.310755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:51:35.072818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.340669+0000","last_change":"2023-07-12T02:02:13.328323+0000","last_active":"2023-07-12T02:02:13.340669+0000","last_peered":"2023-07-12T02:02:13.340669+0000","last_clean":"2023-07-12T02:02:13.340669+0000","last_became_active":"2023-07-12T02:02:13.328037+0000","last_became_peered":"2023-07-12T02:02:13.328037+0000","last_unstale":"2023-07-12T02:02:13.340669+0000","last_undegraded":"2023-07-12T02:02:13.340669+0000","last_fullsized":"2023-07-12T02:02:13.340669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:33:47.310331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.318298+0000","last_change":"2023-07-12T02:02:12.327049+0000","last_active":"2023-07-12T02:02:13.318298+0000","last_peered":"2023-07-12T02:02:13.318298+0000","last_clean":"2023-07-12T02:02:13.318298+0000","last_became_active":"2023-07-12T02:02:12.326705+0000","last_became_peered":"2023-07-12T02:02:12.326705+0000","last_unstale":"2023-07-12T02:02:13.318298+0000","last_undegraded":"2023-07-12T02:02:13.318298+0000","last_fullsized":"2023-07-12T02:02:13.318298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:22:50.312910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.326270+0000","last_change":"2023-07-12T02:02:13.324681+0000","last_active":"2023-07-12T02:02:13.326270+0000","last_peered":"2023-07-12T02:02:13.326270+0000","last_clean":"2023-07-12T02:02:13.326270+0000","last_became_active":"2023-07-12T02:02:13.324399+0000","last_became_peered":"2023-07-12T02:02:13.324399+0000","last_unstale":"2023-07-12T02:02:13.326270+0000","last_undegraded":"2023-07-12T02:02:13.326270+0000","last_fullsized":"2023-07-12T02:02:13.326270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:26:12.486521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.324407+0000","last_change":"2023-07-12T02:02:12.325851+0000","last_active":"2023-07-12T02:02:13.324407+0000","last_peered":"2023-07-12T02:02:13.324407+0000","last_clean":"2023-07-12T02:02:13.324407+0000","last_became_active":"2023-07-12T02:02:12.325017+0000","last_became_peered":"2023-07-12T02:02:12.325017+0000","last_unstale":"2023-07-12T02:02:13.324407+0000","last_undegraded":"2023-07-12T02:02:13.324407+0000","last_fullsized":"2023-07-12T02:02:13.324407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:39:35.318613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.337208+0000","last_change":"2023-07-12T02:02:13.334083+0000","last_active":"2023-07-12T02:02:13.337208+0000","last_peered":"2023-07-12T02:02:13.337208+0000","last_clean":"2023-07-12T02:02:13.337208+0000","last_became_active":"2023-07-12T02:02:13.328586+0000","last_became_peered":"2023-07-12T02:02:13.328586+0000","last_unstale":"2023-07-12T02:02:13.337208+0000","last_undegraded":"2023-07-12T02:02:13.337208+0000","last_fullsized":"2023-07-12T02:02:13.337208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:20:47.394363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316972+0000","last_change":"2023-07-12T02:02:12.320616+0000","last_active":"2023-07-12T02:02:14.316972+0000","last_peered":"2023-07-12T02:02:14.316972+0000","last_clean":"2023-07-12T02:02:14.316972+0000","last_became_active":"2023-07-12T02:02:12.320352+0000","last_became_peered":"2023-07-12T02:02:12.320352+0000","last_unstale":"2023-07-12T02:02:14.316972+0000","last_undegraded":"2023-07-12T02:02:14.316972+0000","last_fullsized":"2023-07-12T02:02:14.316972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:38:02.468430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.336753+0000","last_change":"2023-07-12T02:02:13.330996+0000","last_active":"2023-07-12T02:02:13.336753+0000","last_peered":"2023-07-12T02:02:13.336753+0000","last_clean":"2023-07-12T02:02:13.336753+0000","last_became_active":"2023-07-12T02:02:13.330717+0000","last_became_peered":"2023-07-12T02:02:13.330717+0000","last_unstale":"2023-07-12T02:02:13.336753+0000","last_undegraded":"2023-07-12T02:02:13.336753+0000","last_fullsized":"2023-07-12T02:02:13.336753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:53:36.667304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.315527+0000","last_change":"2023-07-12T02:02:12.329122+0000","last_active":"2023-07-12T02:02:14.315527+0000","last_peered":"2023-07-12T02:02:14.315527+0000","last_clean":"2023-07-12T02:02:14.315527+0000","last_became_active":"2023-07-12T02:02:12.328805+0000","last_became_peered":"2023-07-12T02:02:12.328805+0000","last_unstale":"2023-07-12T02:02:14.315527+0000","last_undegraded":"2023-07-12T02:02:14.315527+0000","last_fullsized":"2023-07-12T02:02:14.315527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:20:27.289712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.338178+0000","last_change":"2023-07-12T02:02:13.326651+0000","last_active":"2023-07-12T02:02:13.338178+0000","last_peered":"2023-07-12T02:02:13.338178+0000","last_clean":"2023-07-12T02:02:13.338178+0000","last_became_active":"2023-07-12T02:02:13.326284+0000","last_became_peered":"2023-07-12T02:02:13.326284+0000","last_unstale":"2023-07-12T02:02:13.338178+0000","last_undegraded":"2023-07-12T02:02:13.338178+0000","last_fullsized":"2023-07-12T02:02:13.338178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:20:47.394363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317640+0000","last_change":"2023-07-12T02:02:12.320231+0000","last_active":"2023-07-12T02:02:14.317640+0000","last_peered":"2023-07-12T02:02:14.317640+0000","last_clean":"2023-07-12T02:02:14.317640+0000","last_became_active":"2023-07-12T02:02:12.319927+0000","last_became_peered":"2023-07-12T02:02:12.319927+0000","last_unstale":"2023-07-12T02:02:14.317640+0000","last_undegraded":"2023-07-12T02:02:14.317640+0000","last_fullsized":"2023-07-12T02:02:14.317640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:35:50.916494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317455+0000","last_change":"2023-07-12T02:02:13.322009+0000","last_active":"2023-07-12T02:02:14.317455+0000","last_peered":"2023-07-12T02:02:14.317455+0000","last_clean":"2023-07-12T02:02:14.317455+0000","last_became_active":"2023-07-12T02:02:13.321743+0000","last_became_peered":"2023-07-12T02:02:13.321743+0000","last_unstale":"2023-07-12T02:02:14.317455+0000","last_undegraded":"2023-07-12T02:02:14.317455+0000","last_fullsized":"2023-07-12T02:02:14.317455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:52:47.727485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.315586+0000","last_change":"2023-07-12T02:02:12.324867+0000","last_active":"2023-07-12T02:02:14.315586+0000","last_peered":"2023-07-12T02:02:14.315586+0000","last_clean":"2023-07-12T02:02:14.315586+0000","last_became_active":"2023-07-12T02:02:12.324548+0000","last_became_peered":"2023-07-12T02:02:12.324548+0000","last_unstale":"2023-07-12T02:02:14.315586+0000","last_undegraded":"2023-07-12T02:02:14.315586+0000","last_fullsized":"2023-07-12T02:02:14.315586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:16:16.868913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.337612+0000","last_change":"2023-07-12T02:02:13.331949+0000","last_active":"2023-07-12T02:02:13.337612+0000","last_peered":"2023-07-12T02:02:13.337612+0000","last_clean":"2023-07-12T02:02:13.337612+0000","last_became_active":"2023-07-12T02:02:13.331691+0000","last_became_peered":"2023-07-12T02:02:13.331691+0000","last_unstale":"2023-07-12T02:02:13.337612+0000","last_undegraded":"2023-07-12T02:02:13.337612+0000","last_fullsized":"2023-07-12T02:02:13.337612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:21:46.349305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.323774+0000","last_change":"2023-07-12T02:02:12.323570+0000","last_active":"2023-07-12T02:02:13.323774+0000","last_peered":"2023-07-12T02:02:13.323774+0000","last_clean":"2023-07-12T02:02:13.323774+0000","last_became_active":"2023-07-12T02:02:12.323259+0000","last_became_peered":"2023-07-12T02:02:12.323259+0000","last_unstale":"2023-07-12T02:02:13.323774+0000","last_undegraded":"2023-07-12T02:02:13.323774+0000","last_fullsized":"2023-07-12T02:02:13.323774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:08:43.743650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317309+0000","last_change":"2023-07-12T02:02:13.319909+0000","last_active":"2023-07-12T02:02:14.317309+0000","last_peered":"2023-07-12T02:02:14.317309+0000","last_clean":"2023-07-12T02:02:14.317309+0000","last_became_active":"2023-07-12T02:02:13.319598+0000","last_became_peered":"2023-07-12T02:02:13.319598+0000","last_unstale":"2023-07-12T02:02:14.317309+0000","last_undegraded":"2023-07-12T02:02:14.317309+0000","last_fullsized":"2023-07-12T02:02:14.317309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:41:14.864536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.315384+0000","last_change":"2023-07-12T02:02:12.324817+0000","last_active":"2023-07-12T02:02:14.315384+0000","last_peered":"2023-07-12T02:02:14.315384+0000","last_clean":"2023-07-12T02:02:14.315384+0000","last_became_active":"2023-07-12T02:02:12.324534+0000","last_became_peered":"2023-07-12T02:02:12.324534+0000","last_unstale":"2023-07-12T02:02:14.315384+0000","last_undegraded":"2023-07-12T02:02:14.315384+0000","last_fullsized":"2023-07-12T02:02:14.315384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:57:41.776255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.346759+0000","last_change":"2023-07-12T02:02:13.341596+0000","last_active":"2023-07-12T02:02:13.346759+0000","last_peered":"2023-07-12T02:02:13.346759+0000","last_clean":"2023-07-12T02:02:13.346759+0000","last_became_active":"2023-07-12T02:02:13.341271+0000","last_became_peered":"2023-07-12T02:02:13.341271+0000","last_unstale":"2023-07-12T02:02:13.346759+0000","last_undegraded":"2023-07-12T02:02:13.346759+0000","last_fullsized":"2023-07-12T02:02:13.346759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:53:36.667304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.343616+0000","last_change":"2023-07-12T02:02:12.321840+0000","last_active":"2023-07-12T02:02:13.343616+0000","last_peered":"2023-07-12T02:02:13.343616+0000","last_clean":"2023-07-12T02:02:13.343616+0000","last_became_active":"2023-07-12T02:02:12.321551+0000","last_became_peered":"2023-07-12T02:02:12.321551+0000","last_unstale":"2023-07-12T02:02:13.343616+0000","last_undegraded":"2023-07-12T02:02:13.343616+0000","last_fullsized":"2023-07-12T02:02:13.343616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:33:46.303044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.339315+0000","last_change":"2023-07-12T02:02:13.336049+0000","last_active":"2023-07-12T02:02:13.339315+0000","last_peered":"2023-07-12T02:02:13.339315+0000","last_clean":"2023-07-12T02:02:13.339315+0000","last_became_active":"2023-07-12T02:02:13.334580+0000","last_became_peered":"2023-07-12T02:02:13.334580+0000","last_unstale":"2023-07-12T02:02:13.339315+0000","last_undegraded":"2023-07-12T02:02:13.339315+0000","last_fullsized":"2023-07-12T02:02:13.339315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:35:02.686768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.315399+0000","last_change":"2023-07-12T02:02:12.321103+0000","last_active":"2023-07-12T02:02:14.315399+0000","last_peered":"2023-07-12T02:02:14.315399+0000","last_clean":"2023-07-12T02:02:14.315399+0000","last_became_active":"2023-07-12T02:02:12.320783+0000","last_became_peered":"2023-07-12T02:02:12.320783+0000","last_unstale":"2023-07-12T02:02:14.315399+0000","last_undegraded":"2023-07-12T02:02:14.315399+0000","last_fullsized":"2023-07-12T02:02:14.315399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:46:14.270985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316978+0000","last_change":"2023-07-12T02:02:13.319686+0000","last_active":"2023-07-12T02:02:14.316978+0000","last_peered":"2023-07-12T02:02:14.316978+0000","last_clean":"2023-07-12T02:02:14.316978+0000","last_became_active":"2023-07-12T02:02:13.319473+0000","last_became_peered":"2023-07-12T02:02:13.319473+0000","last_unstale":"2023-07-12T02:02:14.316978+0000","last_undegraded":"2023-07-12T02:02:14.316978+0000","last_fullsized":"2023-07-12T02:02:14.316978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:43:24.727241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.315771+0000","last_change":"2023-07-12T02:02:12.323782+0000","last_active":"2023-07-12T02:02:14.315771+0000","last_peered":"2023-07-12T02:02:14.315771+0000","last_clean":"2023-07-12T02:02:14.315771+0000","last_became_active":"2023-07-12T02:02:12.323508+0000","last_became_peered":"2023-07-12T02:02:12.323508+0000","last_unstale":"2023-07-12T02:02:14.315771+0000","last_undegraded":"2023-07-12T02:02:14.315771+0000","last_fullsized":"2023-07-12T02:02:14.315771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:35:50.916494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316527+0000","last_change":"2023-07-12T02:02:13.326752+0000","last_active":"2023-07-12T02:02:14.316527+0000","last_peered":"2023-07-12T02:02:14.316527+0000","last_clean":"2023-07-12T02:02:14.316527+0000","last_became_active":"2023-07-12T02:02:13.326494+0000","last_became_peered":"2023-07-12T02:02:13.326494+0000","last_unstale":"2023-07-12T02:02:14.316527+0000","last_undegraded":"2023-07-12T02:02:14.316527+0000","last_fullsized":"2023-07-12T02:02:14.316527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:17:31.378437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.315358+0000","last_change":"2023-07-12T02:02:12.323136+0000","last_active":"2023-07-12T02:02:14.315358+0000","last_peered":"2023-07-12T02:02:14.315358+0000","last_clean":"2023-07-12T02:02:14.315358+0000","last_became_active":"2023-07-12T02:02:12.322786+0000","last_became_peered":"2023-07-12T02:02:12.322786+0000","last_unstale":"2023-07-12T02:02:14.315358+0000","last_undegraded":"2023-07-12T02:02:14.315358+0000","last_fullsized":"2023-07-12T02:02:14.315358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:14:42.639913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.335064+0000","last_change":"2023-07-12T02:02:13.328969+0000","last_active":"2023-07-12T02:02:13.335064+0000","last_peered":"2023-07-12T02:02:13.335064+0000","last_clean":"2023-07-12T02:02:13.335064+0000","last_became_active":"2023-07-12T02:02:13.328727+0000","last_became_peered":"2023-07-12T02:02:13.328727+0000","last_unstale":"2023-07-12T02:02:13.335064+0000","last_undegraded":"2023-07-12T02:02:13.335064+0000","last_fullsized":"2023-07-12T02:02:13.335064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:12:44.190253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316868+0000","last_change":"2023-07-12T02:02:12.329043+0000","last_active":"2023-07-12T02:02:14.316868+0000","last_peered":"2023-07-12T02:02:14.316868+0000","last_clean":"2023-07-12T02:02:14.316868+0000","last_became_active":"2023-07-12T02:02:12.328739+0000","last_became_peered":"2023-07-12T02:02:12.328739+0000","last_unstale":"2023-07-12T02:02:14.316868+0000","last_undegraded":"2023-07-12T02:02:14.316868+0000","last_fullsized":"2023-07-12T02:02:14.316868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:35:01.679481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.346705+0000","last_change":"2023-07-12T02:02:13.341847+0000","last_active":"2023-07-12T02:02:13.346705+0000","last_peered":"2023-07-12T02:02:13.346705+0000","last_clean":"2023-07-12T02:02:13.346705+0000","last_became_active":"2023-07-12T02:02:13.341458+0000","last_became_peered":"2023-07-12T02:02:13.341458+0000","last_unstale":"2023-07-12T02:02:13.346705+0000","last_undegraded":"2023-07-12T02:02:13.346705+0000","last_fullsized":"2023-07-12T02:02:13.346705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:07:56.951503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.347270+0000","last_change":"2023-07-12T02:02:12.328920+0000","last_active":"2023-07-12T02:02:13.347270+0000","last_peered":"2023-07-12T02:02:13.347270+0000","last_clean":"2023-07-12T02:02:13.347270+0000","last_became_active":"2023-07-12T02:02:12.328621+0000","last_became_peered":"2023-07-12T02:02:12.328621+0000","last_unstale":"2023-07-12T02:02:13.347270+0000","last_undegraded":"2023-07-12T02:02:13.347270+0000","last_fullsized":"2023-07-12T02:02:13.347270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:17:07.158644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317790+0000","last_change":"2023-07-12T02:02:13.325579+0000","last_active":"2023-07-12T02:02:14.317790+0000","last_peered":"2023-07-12T02:02:14.317790+0000","last_clean":"2023-07-12T02:02:14.317790+0000","last_became_active":"2023-07-12T02:02:13.325322+0000","last_became_peered":"2023-07-12T02:02:13.325322+0000","last_unstale":"2023-07-12T02:02:14.317790+0000","last_undegraded":"2023-07-12T02:02:14.317790+0000","last_fullsized":"2023-07-12T02:02:14.317790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:44:33.522394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.322450+0000","last_change":"2023-07-12T02:02:12.326368+0000","last_active":"2023-07-12T02:02:13.322450+0000","last_peered":"2023-07-12T02:02:13.322450+0000","last_clean":"2023-07-12T02:02:13.322450+0000","last_became_active":"2023-07-12T02:02:12.326046+0000","last_became_peered":"2023-07-12T02:02:12.326046+0000","last_unstale":"2023-07-12T02:02:13.322450+0000","last_undegraded":"2023-07-12T02:02:13.322450+0000","last_fullsized":"2023-07-12T02:02:13.322450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:39:35.318613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317887+0000","last_change":"2023-07-12T02:02:13.333650+0000","last_active":"2023-07-12T02:02:14.317887+0000","last_peered":"2023-07-12T02:02:14.317887+0000","last_clean":"2023-07-12T02:02:14.317887+0000","last_became_active":"2023-07-12T02:02:13.333379+0000","last_became_peered":"2023-07-12T02:02:13.333379+0000","last_unstale":"2023-07-12T02:02:14.317887+0000","last_undegraded":"2023-07-12T02:02:14.317887+0000","last_fullsized":"2023-07-12T02:02:14.317887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:40:15.684880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316971+0000","last_change":"2023-07-12T02:02:12.322163+0000","last_active":"2023-07-12T02:02:14.316971+0000","last_peered":"2023-07-12T02:02:14.316971+0000","last_clean":"2023-07-12T02:02:14.316971+0000","last_became_active":"2023-07-12T02:02:12.321873+0000","last_became_peered":"2023-07-12T02:02:12.321873+0000","last_unstale":"2023-07-12T02:02:14.316971+0000","last_undegraded":"2023-07-12T02:02:14.316971+0000","last_fullsized":"2023-07-12T02:02:14.316971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:57:41.776255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317708+0000","last_change":"2023-07-12T02:02:13.324741+0000","last_active":"2023-07-12T02:02:14.317708+0000","last_peered":"2023-07-12T02:02:14.317708+0000","last_clean":"2023-07-12T02:02:14.317708+0000","last_became_active":"2023-07-12T02:02:13.324436+0000","last_became_peered":"2023-07-12T02:02:13.324436+0000","last_unstale":"2023-07-12T02:02:14.317708+0000","last_undegraded":"2023-07-12T02:02:14.317708+0000","last_fullsized":"2023-07-12T02:02:14.317708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:30:11.751660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.318115+0000","last_change":"2023-07-12T02:02:12.328371+0000","last_active":"2023-07-12T02:02:13.318115+0000","last_peered":"2023-07-12T02:02:13.318115+0000","last_clean":"2023-07-12T02:02:13.318115+0000","last_became_active":"2023-07-12T02:02:12.328097+0000","last_became_peered":"2023-07-12T02:02:12.328097+0000","last_unstale":"2023-07-12T02:02:13.318115+0000","last_undegraded":"2023-07-12T02:02:13.318115+0000","last_fullsized":"2023-07-12T02:02:13.318115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:42:54.976285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.337886+0000","last_change":"2023-07-12T02:02:13.327528+0000","last_active":"2023-07-12T02:02:13.337886+0000","last_peered":"2023-07-12T02:02:13.337886+0000","last_clean":"2023-07-12T02:02:13.337886+0000","last_became_active":"2023-07-12T02:02:13.327211+0000","last_became_peered":"2023-07-12T02:02:13.327211+0000","last_unstale":"2023-07-12T02:02:13.337886+0000","last_undegraded":"2023-07-12T02:02:13.337886+0000","last_fullsized":"2023-07-12T02:02:13.337886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:53:36.667304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.345123+0000","last_change":"2023-07-12T02:02:12.326201+0000","last_active":"2023-07-12T02:02:13.345123+0000","last_peered":"2023-07-12T02:02:13.345123+0000","last_clean":"2023-07-12T02:02:13.345123+0000","last_became_active":"2023-07-12T02:02:12.325620+0000","last_became_peered":"2023-07-12T02:02:12.325620+0000","last_unstale":"2023-07-12T02:02:13.345123+0000","last_undegraded":"2023-07-12T02:02:13.345123+0000","last_fullsized":"2023-07-12T02:02:13.345123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:20:50.862038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317820+0000","last_change":"2023-07-12T02:02:07.598601+0000","last_active":"2023-07-12T02:02:14.317820+0000","last_peered":"2023-07-12T02:02:14.317820+0000","last_clean":"2023-07-12T02:02:14.317820+0000","last_became_active":"2023-07-12T02:02:07.598343+0000","last_became_peered":"2023-07-12T02:02:07.598343+0000","last_unstale":"2023-07-12T02:02:14.317820+0000","last_undegraded":"2023-07-12T02:02:14.317820+0000","last_fullsized":"2023-07-12T02:02:14.317820+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:27:59.906561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.336381+0000","last_change":"2023-07-12T02:02:13.323317+0000","last_active":"2023-07-12T02:02:13.336381+0000","last_peered":"2023-07-12T02:02:13.336381+0000","last_clean":"2023-07-12T02:02:13.336381+0000","last_became_active":"2023-07-12T02:02:13.323003+0000","last_became_peered":"2023-07-12T02:02:13.323003+0000","last_unstale":"2023-07-12T02:02:13.336381+0000","last_undegraded":"2023-07-12T02:02:13.336381+0000","last_fullsized":"2023-07-12T02:02:13.336381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:08:44.750937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.318595+0000","last_change":"2023-07-12T02:02:07.268647+0000","last_active":"2023-07-12T02:02:13.318595+0000","last_peered":"2023-07-12T02:02:13.318595+0000","last_clean":"2023-07-12T02:02:13.318595+0000","last_became_active":"2023-07-12T02:02:07.268304+0000","last_became_peered":"2023-07-12T02:02:07.268304+0000","last_unstale":"2023-07-12T02:02:13.318595+0000","last_undegraded":"2023-07-12T02:02:13.318595+0000","last_fullsized":"2023-07-12T02:02:13.318595+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:37:24.250223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.326494+0000","last_change":"2023-07-12T02:02:12.322468+0000","last_active":"2023-07-12T02:02:13.326494+0000","last_peered":"2023-07-12T02:02:13.326494+0000","last_clean":"2023-07-12T02:02:13.326494+0000","last_became_active":"2023-07-12T02:02:12.322170+0000","last_became_peered":"2023-07-12T02:02:12.322170+0000","last_unstale":"2023-07-12T02:02:13.326494+0000","last_undegraded":"2023-07-12T02:02:13.326494+0000","last_fullsized":"2023-07-12T02:02:13.326494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:22:50.312910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317131+0000","last_change":"2023-07-12T02:02:13.317131+0000","last_active":"2023-07-12T02:02:14.317131+0000","last_peered":"2023-07-12T02:02:14.317131+0000","last_clean":"2023-07-12T02:02:14.317131+0000","last_became_active":"2023-07-12T02:02:13.316528+0000","last_became_peered":"2023-07-12T02:02:13.316528+0000","last_unstale":"2023-07-12T02:02:14.317131+0000","last_undegraded":"2023-07-12T02:02:14.317131+0000","last_fullsized":"2023-07-12T02:02:14.317131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:46:15.278272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.312149+0000","last_change":"2023-07-12T02:02:07.270653+0000","last_active":"2023-07-12T02:02:13.312149+0000","last_peered":"2023-07-12T02:02:13.312149+0000","last_clean":"2023-07-12T02:02:13.312149+0000","last_became_active":"2023-07-12T02:02:07.270293+0000","last_became_peered":"2023-07-12T02:02:07.270293+0000","last_unstale":"2023-07-12T02:02:13.312149+0000","last_undegraded":"2023-07-12T02:02:13.312149+0000","last_fullsized":"2023-07-12T02:02:13.312149+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:33:41.266032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":169,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.315265+0000","last_change":"2023-07-12T02:02:07.268364+0000","last_active":"2023-07-12T02:02:14.315265+0000","last_peered":"2023-07-12T02:02:14.315265+0000","last_clean":"2023-07-12T02:02:14.315265+0000","last_became_active":"2023-07-12T02:02:07.268074+0000","last_became_peered":"2023-07-12T02:02:07.268074+0000","last_unstale":"2023-07-12T02:02:14.315265+0000","last_undegraded":"2023-07-12T02:02:14.315265+0000","last_fullsized":"2023-07-12T02:02:14.315265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:22:09.049157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.323724+0000","last_change":"2023-07-12T02:02:12.324904+0000","last_active":"2023-07-12T02:02:13.323724+0000","last_peered":"2023-07-12T02:02:13.323724+0000","last_clean":"2023-07-12T02:02:13.323724+0000","last_became_active":"2023-07-12T02:02:12.324574+0000","last_became_peered":"2023-07-12T02:02:12.324574+0000","last_unstale":"2023-07-12T02:02:13.323724+0000","last_undegraded":"2023-07-12T02:02:13.323724+0000","last_fullsized":"2023-07-12T02:02:13.323724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:20:46.387075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.346744+0000","last_change":"2023-07-12T02:02:13.342641+0000","last_active":"2023-07-12T02:02:13.346744+0000","last_peered":"2023-07-12T02:02:13.346744+0000","last_clean":"2023-07-12T02:02:13.346744+0000","last_became_active":"2023-07-12T02:02:13.341464+0000","last_became_peered":"2023-07-12T02:02:13.341464+0000","last_unstale":"2023-07-12T02:02:13.346744+0000","last_undegraded":"2023-07-12T02:02:13.346744+0000","last_fullsized":"2023-07-12T02:02:13.346744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:35:01.956683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.314955+0000","last_change":"2023-07-12T02:02:07.599189+0000","last_active":"2023-07-12T02:02:14.314955+0000","last_peered":"2023-07-12T02:02:14.314955+0000","last_clean":"2023-07-12T02:02:14.314955+0000","last_became_active":"2023-07-12T02:02:07.598898+0000","last_became_peered":"2023-07-12T02:02:07.598898+0000","last_unstale":"2023-07-12T02:02:14.314955+0000","last_undegraded":"2023-07-12T02:02:14.314955+0000","last_fullsized":"2023-07-12T02:02:14.314955+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:16:40.286828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.310757+0000","last_change":"2023-07-12T02:02:12.327140+0000","last_active":"2023-07-12T02:02:13.310757+0000","last_peered":"2023-07-12T02:02:13.310757+0000","last_clean":"2023-07-12T02:02:13.310757+0000","last_became_active":"2023-07-12T02:02:12.326857+0000","last_became_peered":"2023-07-12T02:02:12.326857+0000","last_unstale":"2023-07-12T02:02:13.310757+0000","last_undegraded":"2023-07-12T02:02:13.310757+0000","last_fullsized":"2023-07-12T02:02:13.310757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:12:02.773394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.327397+0000","last_change":"2023-07-12T02:02:13.317477+0000","last_active":"2023-07-12T02:02:13.327397+0000","last_peered":"2023-07-12T02:02:13.327397+0000","last_clean":"2023-07-12T02:02:13.327397+0000","last_became_active":"2023-07-12T02:02:13.317140+0000","last_became_peered":"2023-07-12T02:02:13.317140+0000","last_unstale":"2023-07-12T02:02:13.327397+0000","last_undegraded":"2023-07-12T02:02:13.327397+0000","last_fullsized":"2023-07-12T02:02:13.327397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:39:36.325900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.314948+0000","last_change":"2023-07-12T02:02:07.599193+0000","last_active":"2023-07-12T02:02:14.314948+0000","last_peered":"2023-07-12T02:02:14.314948+0000","last_clean":"2023-07-12T02:02:14.314948+0000","last_became_active":"2023-07-12T02:02:07.598910+0000","last_became_peered":"2023-07-12T02:02:07.598910+0000","last_unstale":"2023-07-12T02:02:14.314948+0000","last_undegraded":"2023-07-12T02:02:14.314948+0000","last_fullsized":"2023-07-12T02:02:14.314948+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:17:25.334138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.319302+0000","last_change":"2023-07-12T02:02:12.325450+0000","last_active":"2023-07-12T02:02:13.319302+0000","last_peered":"2023-07-12T02:02:13.319302+0000","last_clean":"2023-07-12T02:02:13.319302+0000","last_became_active":"2023-07-12T02:02:12.325156+0000","last_became_peered":"2023-07-12T02:02:12.325156+0000","last_unstale":"2023-07-12T02:02:13.319302+0000","last_undegraded":"2023-07-12T02:02:13.319302+0000","last_fullsized":"2023-07-12T02:02:13.319302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:15:31.471972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.335112+0000","last_change":"2023-07-12T02:02:13.328081+0000","last_active":"2023-07-12T02:02:13.335112+0000","last_peered":"2023-07-12T02:02:13.335112+0000","last_clean":"2023-07-12T02:02:13.335112+0000","last_became_active":"2023-07-12T02:02:13.327699+0000","last_became_peered":"2023-07-12T02:02:13.327699+0000","last_unstale":"2023-07-12T02:02:13.335112+0000","last_undegraded":"2023-07-12T02:02:13.335112+0000","last_fullsized":"2023-07-12T02:02:13.335112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:07:56.951503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317109+0000","last_change":"2023-07-12T02:02:07.599477+0000","last_active":"2023-07-12T02:02:14.317109+0000","last_peered":"2023-07-12T02:02:14.317109+0000","last_clean":"2023-07-12T02:02:14.317109+0000","last_became_active":"2023-07-12T02:02:07.599111+0000","last_became_peered":"2023-07-12T02:02:07.599111+0000","last_unstale":"2023-07-12T02:02:14.317109+0000","last_undegraded":"2023-07-12T02:02:14.317109+0000","last_fullsized":"2023-07-12T02:02:14.317109+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:40:00.932400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317421+0000","last_change":"2023-07-12T02:02:12.324686+0000","last_active":"2023-07-12T02:02:14.317421+0000","last_peered":"2023-07-12T02:02:14.317421+0000","last_clean":"2023-07-12T02:02:14.317421+0000","last_became_active":"2023-07-12T02:02:12.324422+0000","last_became_peered":"2023-07-12T02:02:12.324422+0000","last_unstale":"2023-07-12T02:02:14.317421+0000","last_undegraded":"2023-07-12T02:02:14.317421+0000","last_fullsized":"2023-07-12T02:02:14.317421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:16:16.868913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.337932+0000","last_change":"2023-07-12T02:02:13.334295+0000","last_active":"2023-07-12T02:02:13.337932+0000","last_peered":"2023-07-12T02:02:13.337932+0000","last_clean":"2023-07-12T02:02:13.337932+0000","last_became_active":"2023-07-12T02:02:13.333688+0000","last_became_peered":"2023-07-12T02:02:13.333688+0000","last_unstale":"2023-07-12T02:02:13.337932+0000","last_undegraded":"2023-07-12T02:02:13.337932+0000","last_fullsized":"2023-07-12T02:02:13.337932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:42:55.983573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.322697+0000","last_change":"2023-07-12T02:02:07.599427+0000","last_active":"2023-07-12T02:02:13.322697+0000","last_peered":"2023-07-12T02:02:13.322697+0000","last_clean":"2023-07-12T02:02:13.322697+0000","last_became_active":"2023-07-12T02:02:07.599063+0000","last_became_peered":"2023-07-12T02:02:07.599063+0000","last_unstale":"2023-07-12T02:02:13.322697+0000","last_undegraded":"2023-07-12T02:02:13.322697+0000","last_fullsized":"2023-07-12T02:02:13.322697+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:42:49.939273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.311637+0000","last_change":"2023-07-12T02:02:12.327460+0000","last_active":"2023-07-12T02:02:13.311637+0000","last_peered":"2023-07-12T02:02:13.311637+0000","last_clean":"2023-07-12T02:02:13.311637+0000","last_became_active":"2023-07-12T02:02:12.327176+0000","last_became_peered":"2023-07-12T02:02:12.327176+0000","last_unstale":"2023-07-12T02:02:13.311637+0000","last_undegraded":"2023-07-12T02:02:13.311637+0000","last_fullsized":"2023-07-12T02:02:13.311637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:12:43.182965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.342395+0000","last_change":"2023-07-12T02:02:13.340465+0000","last_active":"2023-07-12T02:02:13.342395+0000","last_peered":"2023-07-12T02:02:13.342395+0000","last_clean":"2023-07-12T02:02:13.342395+0000","last_became_active":"2023-07-12T02:02:13.328675+0000","last_became_peered":"2023-07-12T02:02:13.328675+0000","last_unstale":"2023-07-12T02:02:13.342395+0000","last_undegraded":"2023-07-12T02:02:13.342395+0000","last_fullsized":"2023-07-12T02:02:13.342395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:07:41.064033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.322140+0000","last_change":"2023-07-12T02:02:07.272059+0000","last_active":"2023-07-12T02:02:13.322140+0000","last_peered":"2023-07-12T02:02:13.322140+0000","last_clean":"2023-07-12T02:02:13.322140+0000","last_became_active":"2023-07-12T02:02:07.271770+0000","last_became_peered":"2023-07-12T02:02:07.271770+0000","last_unstale":"2023-07-12T02:02:13.322140+0000","last_undegraded":"2023-07-12T02:02:13.322140+0000","last_fullsized":"2023-07-12T02:02:13.322140+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:21:40.305006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317463+0000","last_change":"2023-07-12T02:02:12.328981+0000","last_active":"2023-07-12T02:02:14.317463+0000","last_peered":"2023-07-12T02:02:14.317463+0000","last_clean":"2023-07-12T02:02:14.317463+0000","last_became_active":"2023-07-12T02:02:12.328737+0000","last_became_peered":"2023-07-12T02:02:12.328737+0000","last_unstale":"2023-07-12T02:02:14.317463+0000","last_undegraded":"2023-07-12T02:02:14.317463+0000","last_fullsized":"2023-07-12T02:02:14.317463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:17:30.371150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.326749+0000","last_change":"2023-07-12T02:02:13.321482+0000","last_active":"2023-07-12T02:02:13.326749+0000","last_peered":"2023-07-12T02:02:13.326749+0000","last_clean":"2023-07-12T02:02:13.326749+0000","last_became_active":"2023-07-12T02:02:13.321146+0000","last_became_peered":"2023-07-12T02:02:13.321146+0000","last_unstale":"2023-07-12T02:02:13.326749+0000","last_undegraded":"2023-07-12T02:02:13.326749+0000","last_fullsized":"2023-07-12T02:02:13.326749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:21:46.349305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.346824+0000","last_change":"2023-07-12T02:02:12.324771+0000","last_active":"2023-07-12T02:02:13.346824+0000","last_peered":"2023-07-12T02:02:13.346824+0000","last_clean":"2023-07-12T02:02:13.346824+0000","last_became_active":"2023-07-12T02:02:12.324451+0000","last_became_peered":"2023-07-12T02:02:12.324451+0000","last_unstale":"2023-07-12T02:02:13.346824+0000","last_undegraded":"2023-07-12T02:02:13.346824+0000","last_fullsized":"2023-07-12T02:02:13.346824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:12:43.182965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.334952+0000","last_change":"2023-07-12T02:02:13.330617+0000","last_active":"2023-07-12T02:02:13.334952+0000","last_peered":"2023-07-12T02:02:13.334952+0000","last_clean":"2023-07-12T02:02:13.334952+0000","last_became_active":"2023-07-12T02:02:13.329921+0000","last_became_peered":"2023-07-12T02:02:13.329921+0000","last_unstale":"2023-07-12T02:02:13.334952+0000","last_undegraded":"2023-07-12T02:02:13.334952+0000","last_fullsized":"2023-07-12T02:02:13.334952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:02:38.589333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316667+0000","last_change":"2023-07-12T02:02:12.324065+0000","last_active":"2023-07-12T02:02:14.316667+0000","last_peered":"2023-07-12T02:02:14.316667+0000","last_clean":"2023-07-12T02:02:14.316667+0000","last_became_active":"2023-07-12T02:02:12.323792+0000","last_became_peered":"2023-07-12T02:02:12.323792+0000","last_unstale":"2023-07-12T02:02:14.316667+0000","last_undegraded":"2023-07-12T02:02:14.316667+0000","last_fullsized":"2023-07-12T02:02:14.316667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:37:29.287235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317154+0000","last_change":"2023-07-12T02:02:13.324540+0000","last_active":"2023-07-12T02:02:14.317154+0000","last_peered":"2023-07-12T02:02:14.317154+0000","last_clean":"2023-07-12T02:02:14.317154+0000","last_became_active":"2023-07-12T02:02:13.324245+0000","last_became_peered":"2023-07-12T02:02:13.324245+0000","last_unstale":"2023-07-12T02:02:14.317154+0000","last_undegraded":"2023-07-12T02:02:14.317154+0000","last_fullsized":"2023-07-12T02:02:14.317154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:20:28.296999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317616+0000","last_change":"2023-07-12T02:02:12.323954+0000","last_active":"2023-07-12T02:02:14.317616+0000","last_peered":"2023-07-12T02:02:14.317616+0000","last_clean":"2023-07-12T02:02:14.317616+0000","last_became_active":"2023-07-12T02:02:12.323681+0000","last_became_peered":"2023-07-12T02:02:12.323681+0000","last_unstale":"2023-07-12T02:02:14.317616+0000","last_undegraded":"2023-07-12T02:02:14.317616+0000","last_fullsized":"2023-07-12T02:02:14.317616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:25:18.861513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316914+0000","last_change":"2023-07-12T02:02:13.325210+0000","last_active":"2023-07-12T02:02:14.316914+0000","last_peered":"2023-07-12T02:02:14.316914+0000","last_clean":"2023-07-12T02:02:14.316914+0000","last_became_active":"2023-07-12T02:02:13.324920+0000","last_became_peered":"2023-07-12T02:02:13.324920+0000","last_unstale":"2023-07-12T02:02:14.316914+0000","last_undegraded":"2023-07-12T02:02:14.316914+0000","last_fullsized":"2023-07-12T02:02:14.316914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:14:43.647200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.345656+0000","last_change":"2023-07-12T02:02:12.325289+0000","last_active":"2023-07-12T02:02:13.345656+0000","last_peered":"2023-07-12T02:02:13.345656+0000","last_clean":"2023-07-12T02:02:13.345656+0000","last_became_active":"2023-07-12T02:02:12.324997+0000","last_became_peered":"2023-07-12T02:02:12.324997+0000","last_unstale":"2023-07-12T02:02:13.345656+0000","last_undegraded":"2023-07-12T02:02:13.345656+0000","last_fullsized":"2023-07-12T02:02:13.345656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:33:46.303044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.336775+0000","last_change":"2023-07-12T02:02:13.333732+0000","last_active":"2023-07-12T02:02:13.336775+0000","last_peered":"2023-07-12T02:02:13.336775+0000","last_clean":"2023-07-12T02:02:13.336775+0000","last_became_active":"2023-07-12T02:02:13.332925+0000","last_became_peered":"2023-07-12T02:02:13.332925+0000","last_unstale":"2023-07-12T02:02:13.336775+0000","last_undegraded":"2023-07-12T02:02:13.336775+0000","last_fullsized":"2023-07-12T02:02:13.336775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:12:44.190253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.347068+0000","last_change":"2023-07-12T02:02:12.326847+0000","last_active":"2023-07-12T02:02:13.347068+0000","last_peered":"2023-07-12T02:02:13.347068+0000","last_clean":"2023-07-12T02:02:13.347068+0000","last_became_active":"2023-07-12T02:02:12.326564+0000","last_became_peered":"2023-07-12T02:02:12.326564+0000","last_unstale":"2023-07-12T02:02:13.347068+0000","last_undegraded":"2023-07-12T02:02:13.347068+0000","last_fullsized":"2023-07-12T02:02:13.347068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:42:54.976285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316667+0000","last_change":"2023-07-12T02:02:13.324603+0000","last_active":"2023-07-12T02:02:14.316667+0000","last_peered":"2023-07-12T02:02:14.316667+0000","last_clean":"2023-07-12T02:02:14.316667+0000","last_became_active":"2023-07-12T02:02:13.324373+0000","last_became_peered":"2023-07-12T02:02:13.324373+0000","last_unstale":"2023-07-12T02:02:14.316667+0000","last_undegraded":"2023-07-12T02:02:14.316667+0000","last_fullsized":"2023-07-12T02:02:14.316667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:25:19.868800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.337267+0000","last_change":"2023-07-12T02:02:13.335337+0000","last_active":"2023-07-12T02:02:13.337267+0000","last_peered":"2023-07-12T02:02:13.337267+0000","last_clean":"2023-07-12T02:02:13.337267+0000","last_became_active":"2023-07-12T02:02:13.335059+0000","last_became_peered":"2023-07-12T02:02:13.335059+0000","last_unstale":"2023-07-12T02:02:13.337267+0000","last_undegraded":"2023-07-12T02:02:13.337267+0000","last_fullsized":"2023-07-12T02:02:13.337267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:20:47.394363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.340416+0000","last_change":"2023-07-12T02:02:13.338052+0000","last_active":"2023-07-12T02:02:13.340416+0000","last_peered":"2023-07-12T02:02:13.340416+0000","last_clean":"2023-07-12T02:02:13.340416+0000","last_became_active":"2023-07-12T02:02:13.337744+0000","last_became_peered":"2023-07-12T02:02:13.337744+0000","last_unstale":"2023-07-12T02:02:13.340416+0000","last_undegraded":"2023-07-12T02:02:13.340416+0000","last_fullsized":"2023-07-12T02:02:13.340416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:51:50.388106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316568+0000","last_change":"2023-07-12T02:02:13.323841+0000","last_active":"2023-07-12T02:02:14.316568+0000","last_peered":"2023-07-12T02:02:14.316568+0000","last_clean":"2023-07-12T02:02:14.316568+0000","last_became_active":"2023-07-12T02:02:13.323558+0000","last_became_peered":"2023-07-12T02:02:13.323558+0000","last_unstale":"2023-07-12T02:02:14.316568+0000","last_undegraded":"2023-07-12T02:02:14.316568+0000","last_fullsized":"2023-07-12T02:02:14.316568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:16:46.331127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.337326+0000","last_change":"2023-07-12T02:02:13.333951+0000","last_active":"2023-07-12T02:02:13.337326+0000","last_peered":"2023-07-12T02:02:13.337326+0000","last_clean":"2023-07-12T02:02:13.337326+0000","last_became_active":"2023-07-12T02:02:13.332574+0000","last_became_peered":"2023-07-12T02:02:13.332574+0000","last_unstale":"2023-07-12T02:02:13.337326+0000","last_undegraded":"2023-07-12T02:02:13.337326+0000","last_fullsized":"2023-07-12T02:02:13.337326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:35:01.956683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-12T02:02:13.326656+0000","last_change":"2023-07-12T02:02:13.320239+0000","last_active":"2023-07-12T02:02:13.326656+0000","last_peered":"2023-07-12T02:02:13.326656+0000","last_clean":"2023-07-12T02:02:13.326656+0000","last_became_active":"2023-07-12T02:02:13.319332+0000","last_became_peered":"2023-07-12T02:02:13.319332+0000","last_unstale":"2023-07-12T02:02:13.326656+0000","last_undegraded":"2023-07-12T02:02:13.326656+0000","last_fullsized":"2023-07-12T02:02:13.326656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:08:44.750937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":835584,"data_stored":670286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":72446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":794624,"data_stored":661853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.253}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":72067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":200704,"data_stored":71485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":72536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":79758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":79751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-12T02:02:17.870 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-12T02:02:17.871 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-07-12T02:02:17.871 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-07-12T02:02:17.871 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-07-12T02:02:17.872 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-07-12T02:02:18.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.028+0000 7f690643f700 1 Processor -- start 2023-07-12T02:02:18.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.028+0000 7f690643f700 1 -- start start 2023-07-12T02:02:18.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.029+0000 7f690643f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f690006b120 0x7f6900071350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:18.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.029+0000 7f690643f700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69000b7180 con 0x7f69000ba160 2023-07-12T02:02:18.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.029+0000 7f690643f700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6900071070 con 0x7f69000b5fc0 2023-07-12T02:02:18.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.029+0000 7f690643f700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69000b90b0 con 0x7f690006b120 2023-07-12T02:02:18.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.029+0000 7f68fffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f690006b120 0x7f6900071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:18.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.029+0000 7f68ff7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f69000ba160 0x7f69001485e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46030/0 (socket says 172.21.15.60:46030) 2023-07-12T02:02:18.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.029+0000 7f68ff7fe700 1 -- 172.21.15.60:0/2691972338 learned_addr learned my addr 172.21.15.60:0/2691972338 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:18.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.029+0000 7f68fffff700 1 -- 172.21.15.60:0/2691972338 >> v1:172.21.15.79:6789/0 conn(0x7f69000b5fc0 legacy=0x7f69000b6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:18.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.029+0000 7f68fffff700 1 -- 172.21.15.60:0/2691972338 >> v1:172.21.15.60:6789/0 conn(0x7f69000ba160 legacy=0x7f69001485e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:18.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.029+0000 7f68feffd700 1 -- 172.21.15.60:0/2691972338 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2773973065 0 0) 0x7f69000b7180 con 0x7f69000ba160 2023-07-12T02:02:18.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.029+0000 7f68fffff700 1 -- 172.21.15.60:0/2691972338 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69000b6e10 con 0x7f690006b120 2023-07-12T02:02:18.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.029+0000 7f68fffff700 1 --2- 172.21.15.60:0/2691972338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f690006b120 0x7f6900071350 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f68f0009840 tx=0x7f68f0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=437b4249948e1190 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:18.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.029+0000 7f68feffd700 1 -- 172.21.15.60:0/2691972338 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f0011830 con 0x7f690006b120 2023-07-12T02:02:18.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.029+0000 7f68feffd700 1 -- 172.21.15.60:0/2691972338 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f0011990 con 0x7f690006b120 2023-07-12T02:02:18.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.029+0000 7f68feffd700 1 -- 172.21.15.60:0/2691972338 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f0011d20 con 0x7f690006b120 2023-07-12T02:02:18.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.030+0000 7f690643f700 1 -- 172.21.15.60:0/2691972338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f690006b120 msgr2=0x7f6900071350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:18.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.030+0000 7f690643f700 1 --2- 172.21.15.60:0/2691972338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f690006b120 0x7f6900071350 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f68f0009840 tx=0x7f68f0009b50 comp rx=0 tx=0).stop 2023-07-12T02:02:18.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.030+0000 7f690643f700 1 -- 172.21.15.60:0/2691972338 shutdown_connections 2023-07-12T02:02:18.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.030+0000 7f690643f700 1 --2- 172.21.15.60:0/2691972338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f690006b120 0x7f6900071350 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:18.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.030+0000 7f690643f700 1 -- 172.21.15.60:0/2691972338 >> 172.21.15.60:0/2691972338 conn(0x7f69000bd980 msgr2=0x7f69000b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:18.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.030+0000 7f690643f700 1 -- 172.21.15.60:0/2691972338 shutdown_connections 2023-07-12T02:02:18.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.030+0000 7f690643f700 1 -- 172.21.15.60:0/2691972338 wait complete. 2023-07-12T02:02:18.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.031+0000 7f690643f700 1 Processor -- start 2023-07-12T02:02:18.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.031+0000 7f690643f700 1 -- start start 2023-07-12T02:02:18.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.032+0000 7f690643f700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f690006b120 0x7f69001d1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:18.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.032+0000 7f690643f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69000b5fc0 0x7f69001e2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:18.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.032+0000 7f690643f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69000ba160 0x7f69001e34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:18.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.032+0000 7f690643f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69001d2150 con 0x7f69000b5fc0 2023-07-12T02:02:18.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.032+0000 7f690643f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690006f5b0 con 0x7f69000ba160 2023-07-12T02:02:18.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.032+0000 7f690643f700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f690006f280 con 0x7f690006b120 2023-07-12T02:02:18.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.032+0000 7f68ff7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69000b5fc0 0x7f69001e2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:18.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.032+0000 7f68ff7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69000b5fc0 0x7f69001e2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50308/0 (socket says 172.21.15.60:50308) 2023-07-12T02:02:18.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.032+0000 7f68ff7fe700 1 -- 172.21.15.60:0/2756072451 learned_addr learned my addr 172.21.15.60:0/2756072451 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:18.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.032+0000 7f69049dc700 1 --2- 172.21.15.60:0/2756072451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69000ba160 0x7f69001e34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:18.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.032+0000 7f68fffff700 1 --2- 172.21.15.60:0/2756072451 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f690006b120 0x7f69001d1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:18.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.032+0000 7f68ff7fe700 1 -- 172.21.15.60:0/2756072451 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f690006b120 msgr2=0x7f69001d1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:18.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.032+0000 7f68ff7fe700 1 --2- 172.21.15.60:0/2756072451 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f690006b120 0x7f69001d1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:18.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.032+0000 7f68ff7fe700 1 -- 172.21.15.60:0/2756072451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69000ba160 msgr2=0x7f69001e34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:18.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.032+0000 7f68ff7fe700 1 --2- 172.21.15.60:0/2756072451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69000ba160 0x7f69001e34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:18.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.032+0000 7f68ff7fe700 1 -- 172.21.15.60:0/2756072451 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f00094a0 con 0x7f69000b5fc0 2023-07-12T02:02:18.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.032+0000 7f69049dc700 1 --2- 172.21.15.60:0/2756072451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69000ba160 0x7f69001e34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:02:18.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.032+0000 7f68fffff700 1 --2- 172.21.15.60:0/2756072451 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f690006b120 0x7f69001d1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:02:18.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.032+0000 7f68ff7fe700 1 --2- 172.21.15.60:0/2756072451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69000b5fc0 0x7f69001e2f80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f68f400c520 tx=0x7f68f400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:18.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.033+0000 7f68fcff9700 1 -- 172.21.15.60:0/2756072451 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f4004c80 con 0x7f69000b5fc0 2023-07-12T02:02:18.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.033+0000 7f68fcff9700 1 -- 172.21.15.60:0/2756072451 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f4004e20 con 0x7f69000b5fc0 2023-07-12T02:02:18.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.033+0000 7f690643f700 1 -- 172.21.15.60:0/2756072451 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f690013e650 con 0x7f69000b5fc0 2023-07-12T02:02:18.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.033+0000 7f68fcff9700 1 -- 172.21.15.60:0/2756072451 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f4007310 con 0x7f69000b5fc0 2023-07-12T02:02:18.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.033+0000 7f690643f700 1 -- 172.21.15.60:0/2756072451 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f690006fb10 con 0x7f69000b5fc0 2023-07-12T02:02:18.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.034+0000 7f690643f700 1 -- 172.21.15.60:0/2756072451 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6900074360 con 0x7f69000b5fc0 2023-07-12T02:02:18.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.034+0000 7f68fcff9700 1 -- 172.21.15.60:0/2756072451 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f68f4007470 con 0x7f69000b5fc0 2023-07-12T02:02:18.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.034+0000 7f68fcff9700 1 --2- 172.21.15.60:0/2756072451 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f68ec06ace0 0x7f68ec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:18.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.035+0000 7f68fcff9700 1 -- 172.21.15.60:0/2756072451 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f68f4089140 con 0x7f69000b5fc0 2023-07-12T02:02:18.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.035+0000 7f68fffff700 1 --2- 172.21.15.60:0/2756072451 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f68ec06ace0 0x7f68ec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:18.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.035+0000 7f68fffff700 1 --2- 172.21.15.60:0/2756072451 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f68ec06ace0 0x7f68ec06d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f68f0000c00 tx=0x7f68f001c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:18.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.039+0000 7f68fcff9700 1 -- 172.21.15.60:0/2756072451 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f68f4054280 con 0x7f69000b5fc0 2023-07-12T02:02:18.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.293+0000 7f690643f700 1 -- 172.21.15.60:0/2756072451 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f69000b85c0 con 0x7f69000b5fc0 2023-07-12T02:02:18.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.296+0000 7f68fcff9700 1 -- 172.21.15.60:0/2756072451 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170841 (secure 0 0 0) 0x7f68f40578a0 con 0x7f69000b5fc0 2023-07-12T02:02:18.301 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:02:18.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.299+0000 7f690643f700 1 -- 172.21.15.60:0/2756072451 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f68ec06ace0 msgr2=0x7f68ec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:18.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.299+0000 7f690643f700 1 --2- 172.21.15.60:0/2756072451 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f68ec06ace0 0x7f68ec06d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f68f0000c00 tx=0x7f68f001c040 comp rx=0 tx=0).stop 2023-07-12T02:02:18.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.299+0000 7f690643f700 1 -- 172.21.15.60:0/2756072451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69000b5fc0 msgr2=0x7f69001e2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:18.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.299+0000 7f690643f700 1 --2- 172.21.15.60:0/2756072451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69000b5fc0 0x7f69001e2f80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f68f400c520 tx=0x7f68f400c8e0 comp rx=0 tx=0).stop 2023-07-12T02:02:18.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.299+0000 7f690643f700 1 -- 172.21.15.60:0/2756072451 shutdown_connections 2023-07-12T02:02:18.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.299+0000 7f690643f700 1 --2- 172.21.15.60:0/2756072451 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f68ec06ace0 0x7f68ec06d190 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:18.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.299+0000 7f690643f700 1 --2- 172.21.15.60:0/2756072451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69000ba160 0x7f69001e34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:18.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.299+0000 7f690643f700 1 --2- 172.21.15.60:0/2756072451 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f690006b120 0x7f69001d1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:18.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.299+0000 7f690643f700 1 --2- 172.21.15.60:0/2756072451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69000b5fc0 0x7f69001e2f80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:18.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.299+0000 7f690643f700 1 -- 172.21.15.60:0/2756072451 >> 172.21.15.60:0/2756072451 conn(0x7f69000bd980 msgr2=0x7f69000b7570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:18.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.299+0000 7f690643f700 1 -- 172.21.15.60:0/2756072451 shutdown_connections 2023-07-12T02:02:18.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.299+0000 7f690643f700 1 -- 172.21.15.60:0/2756072451 wait complete. 2023-07-12T02:02:18.314 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":5,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1173177519},{"type":"v1","addr":"172.21.15.79:6833","nonce":1173177519}]},"active_addr":"172.21.15.79:6833/1173177519","active_change":"2023-07-12T02:01:59.792895+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4103,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":3242526842}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":191643868}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":1471592065}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":3046847440}]}]} 2023-07-12T02:02:18.318 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-07-12T02:02:18.318 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-07-12T02:02:18.319 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:02:18.407 INFO:tasks.ceph.mds.a.smithi060.stderr:2023-07-12T02:02:18.405+0000 7f142f728700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-12T02:02:18.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.441+0000 7f559f909700 1 Processor -- start 2023-07-12T02:02:18.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.442+0000 7f559f909700 1 -- start start 2023-07-12T02:02:18.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.442+0000 7f559f909700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f55981449d0 0x7f559814db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:18.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.442+0000 7f559f909700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f55980bc810 0x7f55980ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:18.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.442+0000 7f559f909700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55980b8620 con 0x7f55980b8d90 2023-07-12T02:02:18.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.442+0000 7f559f909700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55980b97a0 con 0x7f55981449d0 2023-07-12T02:02:18.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.442+0000 7f559f909700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5598144da0 con 0x7f55980bc810 2023-07-12T02:02:18.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.443+0000 7f559d6a5700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f55981449d0 0x7f559814db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:18.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.443+0000 7f559dea6700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f55980b8d90 0x7f559806ade0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46044/0 (socket says 172.21.15.60:46044) 2023-07-12T02:02:18.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.443+0000 7f559dea6700 1 -- 172.21.15.60:0/2810493184 learned_addr learned my addr 172.21.15.60:0/2810493184 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:18.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.443+0000 7f559cea4700 1 --2- 172.21.15.60:0/2810493184 >> v2:172.21.15.79:3300/0 conn(0x7f55980bc810 0x7f55980ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:18.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.443+0000 7f559d6a5700 1 -- 172.21.15.60:0/2810493184 >> v2:172.21.15.79:3300/0 conn(0x7f55980bc810 msgr2=0x7f55980ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:18.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.443+0000 7f559d6a5700 1 --2- 172.21.15.60:0/2810493184 >> v2:172.21.15.79:3300/0 conn(0x7f55980bc810 0x7f55980ba530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:18.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.443+0000 7f559d6a5700 1 -- 172.21.15.60:0/2810493184 >> v1:172.21.15.60:6789/0 conn(0x7f55980b8d90 legacy=0x7f559806ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:18.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.443+0000 7f559d6a5700 1 -- 172.21.15.60:0/2810493184 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55980b8900 con 0x7f55981449d0 2023-07-12T02:02:18.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.443+0000 7f558ffff700 1 -- 172.21.15.60:0/2810493184 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 546096501 0 0) 0x7f55980b8620 con 0x7f55980b8d90 2023-07-12T02:02:18.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.443+0000 7f559d6a5700 1 --2- 172.21.15.60:0/2810493184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55981449d0 0x7f559814db50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f559806ce40 tx=0x7f5594009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdece6bd20907b49 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:18.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.443+0000 7f558ffff700 1 -- 172.21.15.60:0/2810493184 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5594011830 con 0x7f55981449d0 2023-07-12T02:02:18.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.443+0000 7f558ffff700 1 -- 172.21.15.60:0/2810493184 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5594011990 con 0x7f55981449d0 2023-07-12T02:02:18.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.443+0000 7f558ffff700 1 -- 172.21.15.60:0/2810493184 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5594011d20 con 0x7f55981449d0 2023-07-12T02:02:18.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.444+0000 7f559f909700 1 -- 172.21.15.60:0/2810493184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55981449d0 msgr2=0x7f559814db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:18.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.444+0000 7f559f909700 1 --2- 172.21.15.60:0/2810493184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55981449d0 0x7f559814db50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f559806ce40 tx=0x7f5594009b20 comp rx=0 tx=0).stop 2023-07-12T02:02:18.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.444+0000 7f559f909700 1 -- 172.21.15.60:0/2810493184 shutdown_connections 2023-07-12T02:02:18.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.444+0000 7f559f909700 1 --2- 172.21.15.60:0/2810493184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55981449d0 0x7f559814db50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:18.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.444+0000 7f559f909700 1 --2- 172.21.15.60:0/2810493184 >> v2:172.21.15.79:3300/0 conn(0x7f55980bc810 0x7f55980ba530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:18.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.444+0000 7f559f909700 1 -- 172.21.15.60:0/2810493184 >> 172.21.15.60:0/2810493184 conn(0x7f55980c0860 msgr2=0x7f55980c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:18.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.444+0000 7f559f909700 1 -- 172.21.15.60:0/2810493184 shutdown_connections 2023-07-12T02:02:18.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.444+0000 7f559f909700 1 -- 172.21.15.60:0/2810493184 wait complete. 2023-07-12T02:02:18.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.445+0000 7f559f909700 1 Processor -- start 2023-07-12T02:02:18.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.445+0000 7f559f909700 1 -- start start 2023-07-12T02:02:18.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.446+0000 7f559f909700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55980b8d90 0x7f55981d56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:18.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.446+0000 7f559f909700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55980bc810 0x7f55981d46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:18.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.446+0000 7f559f909700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55981449d0 0x7f55981d4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:18.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.446+0000 7f559f909700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55981d6380 con 0x7f55980bc810 2023-07-12T02:02:18.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.446+0000 7f559f909700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55981d5150 con 0x7f55980b8d90 2023-07-12T02:02:18.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.446+0000 7f559f909700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5598142fb0 con 0x7f55981449d0 2023-07-12T02:02:18.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.446+0000 7f559cea4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55980bc810 0x7f55981d46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:18.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.446+0000 7f559cea4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55980bc810 0x7f55981d46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50326/0 (socket says 172.21.15.60:50326) 2023-07-12T02:02:18.453 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.446+0000 7f559cea4700 1 -- 172.21.15.60:0/670131215 learned_addr learned my addr 172.21.15.60:0/670131215 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:18.453 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.446+0000 7f559d6a5700 1 --2- 172.21.15.60:0/670131215 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55980b8d90 0x7f55981d56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:18.453 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.446+0000 7f559dea6700 1 --2- 172.21.15.60:0/670131215 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55981449d0 0x7f55981d4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:18.453 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.446+0000 7f559cea4700 1 -- 172.21.15.60:0/670131215 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55981449d0 msgr2=0x7f55981d4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:18.453 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.446+0000 7f559cea4700 1 --2- 172.21.15.60:0/670131215 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55981449d0 0x7f55981d4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:18.453 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.446+0000 7f559cea4700 1 -- 172.21.15.60:0/670131215 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55980b8d90 msgr2=0x7f55981d56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:18.453 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.446+0000 7f559cea4700 1 --2- 172.21.15.60:0/670131215 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55980b8d90 0x7f55981d56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:18.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.446+0000 7f559cea4700 1 -- 172.21.15.60:0/670131215 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55940094a0 con 0x7f55980bc810 2023-07-12T02:02:18.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.446+0000 7f559cea4700 1 --2- 172.21.15.60:0/670131215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55980bc810 0x7f55981d46d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f558800e9b0 tx=0x7f558800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:18.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.446+0000 7f558dffb700 1 -- 172.21.15.60:0/670131215 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5588009710 con 0x7f55980bc810 2023-07-12T02:02:18.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.446+0000 7f558dffb700 1 -- 172.21.15.60:0/670131215 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f558800ee50 con 0x7f55980bc810 2023-07-12T02:02:18.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.446+0000 7f559f909700 1 -- 172.21.15.60:0/670131215 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55981d60a0 con 0x7f55980bc810 2023-07-12T02:02:18.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.446+0000 7f558dffb700 1 -- 172.21.15.60:0/670131215 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558800ca50 con 0x7f55980bc810 2023-07-12T02:02:18.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.447+0000 7f559f909700 1 -- 172.21.15.60:0/670131215 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f559814b420 con 0x7f55980bc810 2023-07-12T02:02:18.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.448+0000 7f559f909700 1 -- 172.21.15.60:0/670131215 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5598074360 con 0x7f55980bc810 2023-07-12T02:02:18.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.448+0000 7f558dffb700 1 -- 172.21.15.60:0/670131215 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f558800cbb0 con 0x7f55980bc810 2023-07-12T02:02:18.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.448+0000 7f558dffb700 1 --2- 172.21.15.60:0/670131215 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f557c06ace0 0x7f557c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:18.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.449+0000 7f558dffb700 1 -- 172.21.15.60:0/670131215 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5588089510 con 0x7f55980bc810 2023-07-12T02:02:18.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.449+0000 7f559d6a5700 1 --2- 172.21.15.60:0/670131215 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f557c06ace0 0x7f557c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:18.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.449+0000 7f559d6a5700 1 --2- 172.21.15.60:0/670131215 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f557c06ace0 0x7f557c06d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f55940090b0 tx=0x7f559401c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:18.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.453+0000 7f558dffb700 1 -- 172.21.15.60:0/670131215 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f5588057fb0 con 0x7f55980bc810 2023-07-12T02:02:18.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.654+0000 7f559f909700 1 -- 172.21.15.60:0/670131215 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f55980bc330 con 0x7f55980bc810 2023-07-12T02:02:18.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.656+0000 7f558dffb700 1 -- 172.21.15.60:0/670131215 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18173 (secure 0 0 0) 0x7f558800ce60 con 0x7f55980bc810 2023-07-12T02:02:18.659 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:02:18.659 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":21,"fsid":"97e7c909-e567-472e-a5aa-72fde15171f2","created":"2023-07-12T02:01:53.987086+0000","modified":"2023-07-12T02:02:14.307912+0000","last_up_change":"2023-07-12T02:02:04.031780+0000","last_in_change":"2023-07-12T02:01:56.538621+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-12T02:02:05.375042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-12T02:02:05.857441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:02:10.574633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-12T02:02:11.699872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ed8b71c2-3895-4952-a118-16ede0b4a98c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6801","nonce":2818935979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6803","nonce":2818935979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6807","nonce":2818935979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6805","nonce":2818935979}]},"public_addr":"172.21.15.60:6801/2818935979","cluster_addr":"172.21.15.60:6803/2818935979","heartbeat_back_addr":"172.21.15.60:6807/2818935979","heartbeat_front_addr":"172.21.15.60:6805/2818935979","state":["exists","up"]},{"osd":1,"uuid":"7cf4d354-78e0-43ce-8c09-4a7d2a0b57a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6817","nonce":1678864191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6819","nonce":1678864191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6823","nonce":1678864191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6821","nonce":1678864191}]},"public_addr":"172.21.15.60:6817/1678864191","cluster_addr":"172.21.15.60:6819/1678864191","heartbeat_back_addr":"172.21.15.60:6823/1678864191","heartbeat_front_addr":"172.21.15.60:6821/1678864191","state":["exists","up"]},{"osd":2,"uuid":"02c958b8-9599-4470-92cb-8f7018ec0189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6809","nonce":1459480680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6811","nonce":1459480680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6815","nonce":1459480680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6813","nonce":1459480680}]},"public_addr":"172.21.15.60:6809/1459480680","cluster_addr":"172.21.15.60:6811/1459480680","heartbeat_back_addr":"172.21.15.60:6815/1459480680","heartbeat_front_addr":"172.21.15.60:6813/1459480680","state":["exists","up"]},{"osd":3,"uuid":"bc300432-a228-4257-be5c-e42dd5f2015f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6825","nonce":3295100060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6827","nonce":3295100060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6831","nonce":3295100060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6829","nonce":3295100060}]},"public_addr":"172.21.15.60:6825/3295100060","cluster_addr":"172.21.15.60:6827/3295100060","heartbeat_back_addr":"172.21.15.60:6831/3295100060","heartbeat_front_addr":"172.21.15.60:6829/3295100060","state":["exists","up"]},{"osd":4,"uuid":"ad9f7dc4-7126-466d-a656-2844880c6060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6809","nonce":4127109138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6811","nonce":4127109138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6815","nonce":4127109138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6813","nonce":4127109138}]},"public_addr":"172.21.15.79:6809/4127109138","cluster_addr":"172.21.15.79:6811/4127109138","heartbeat_back_addr":"172.21.15.79:6815/4127109138","heartbeat_front_addr":"172.21.15.79:6813/4127109138","state":["exists","up"]},{"osd":5,"uuid":"e88d16ca-0b01-4ab9-8aa8-c4aff7f210f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6801","nonce":421449406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6803","nonce":421449406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6807","nonce":421449406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6805","nonce":421449406}]},"public_addr":"172.21.15.79:6801/421449406","cluster_addr":"172.21.15.79:6803/421449406","heartbeat_back_addr":"172.21.15.79:6807/421449406","heartbeat_front_addr":"172.21.15.79:6805/421449406","state":["exists","up"]},{"osd":6,"uuid":"6898cb84-56d1-48a9-bd45-97e4668e2fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6825","nonce":4144355139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6827","nonce":4144355139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6831","nonce":4144355139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6829","nonce":4144355139}]},"public_addr":"172.21.15.79:6825/4144355139","cluster_addr":"172.21.15.79:6827/4144355139","heartbeat_back_addr":"172.21.15.79:6831/4144355139","heartbeat_front_addr":"172.21.15.79:6829/4144355139","state":["exists","up"]},{"osd":7,"uuid":"65c10882-371e-4762-b384-9c3a48f332ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6817","nonce":2845223299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6819","nonce":2845223299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6823","nonce":2845223299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6821","nonce":2845223299}]},"public_addr":"172.21.15.79:6817/2845223299","cluster_addr":"172.21.15.79:6819/2845223299","heartbeat_back_addr":"172.21.15.79:6823/2845223299","heartbeat_front_addr":"172.21.15.79:6821/2845223299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.634716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.758349+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.728366+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.777395+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707262+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.649705+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.693021+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:02:18.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.658+0000 7f559f909700 1 -- 172.21.15.60:0/670131215 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f557c06ace0 msgr2=0x7f557c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:18.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.658+0000 7f559f909700 1 --2- 172.21.15.60:0/670131215 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f557c06ace0 0x7f557c06d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f55940090b0 tx=0x7f559401c040 comp rx=0 tx=0).stop 2023-07-12T02:02:18.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.658+0000 7f559f909700 1 -- 172.21.15.60:0/670131215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55980bc810 msgr2=0x7f55981d46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:18.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.658+0000 7f559f909700 1 --2- 172.21.15.60:0/670131215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55980bc810 0x7f55981d46d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f558800e9b0 tx=0x7f558800ecc0 comp rx=0 tx=0).stop 2023-07-12T02:02:18.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.658+0000 7f559f909700 1 -- 172.21.15.60:0/670131215 shutdown_connections 2023-07-12T02:02:18.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.658+0000 7f559f909700 1 --2- 172.21.15.60:0/670131215 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f557c06ace0 0x7f557c06d190 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:18.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.658+0000 7f559f909700 1 --2- 172.21.15.60:0/670131215 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55981449d0 0x7f55981d4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:18.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.658+0000 7f559f909700 1 --2- 172.21.15.60:0/670131215 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55980b8d90 0x7f55981d56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:18.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.658+0000 7f559f909700 1 --2- 172.21.15.60:0/670131215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55980bc810 0x7f55981d46d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:18.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.658+0000 7f559f909700 1 -- 172.21.15.60:0/670131215 >> 172.21.15.60:0/670131215 conn(0x7f55980c0860 msgr2=0x7f55980baeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:18.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.658+0000 7f559f909700 1 -- 172.21.15.60:0/670131215 shutdown_connections 2023-07-12T02:02:18.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.658+0000 7f559f909700 1 -- 172.21.15.60:0/670131215 wait complete. 2023-07-12T02:02:18.673 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-07-12T02:02:18.673 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:02:18.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.795+0000 7fc6394e4700 1 Processor -- start 2023-07-12T02:02:18.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.796+0000 7fc6394e4700 1 -- start start 2023-07-12T02:02:18.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.796+0000 7fc6394e4700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc634071d20 0x7fc6341458b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:18.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.796+0000 7fc6394e4700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc6340709c0 0x7fc634145df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:18.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.796+0000 7fc6394e4700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc634070130 con 0x7fc63414bf30 2023-07-12T02:02:18.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.796+0000 7fc6394e4700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc634146330 con 0x7fc634071d20 2023-07-12T02:02:18.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.796+0000 7fc6394e4700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc634070f80 con 0x7fc6340709c0 2023-07-12T02:02:18.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.796+0000 7fc6327fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc634071d20 0x7fc6341458b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:18.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.796+0000 7fc6327fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc634071d20 0x7fc6341458b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50336/0 (socket says 172.21.15.60:50336) 2023-07-12T02:02:18.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.796+0000 7fc6327fc700 1 -- 172.21.15.60:0/1353995853 learned_addr learned my addr 172.21.15.60:0/1353995853 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:18.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.796+0000 7fc6337fe700 1 --2- 172.21.15.60:0/1353995853 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc6340709c0 0x7fc634145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:18.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.797+0000 7fc6327fc700 1 -- 172.21.15.60:0/1353995853 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc6340709c0 msgr2=0x7fc634145df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:18.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.797+0000 7fc6327fc700 1 --2- 172.21.15.60:0/1353995853 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc6340709c0 0x7fc634145df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:18.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.797+0000 7fc6327fc700 1 -- 172.21.15.60:0/1353995853 >> v1:172.21.15.79:6789/0 conn(0x7fc63414bf30 legacy=0x7fc6340b8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:18.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.797+0000 7fc6327fc700 1 -- 172.21.15.60:0/1353995853 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc634071260 con 0x7fc634071d20 2023-07-12T02:02:18.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.797+0000 7fc6327fc700 1 --2- 172.21.15.60:0/1353995853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc634071d20 0x7fc6341458b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc61c0098f0 tx=0x7fc61c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61481e4486577955 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:18.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.797+0000 7fc631ffb700 1 -- 172.21.15.60:0/1353995853 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c011830 con 0x7fc634071d20 2023-07-12T02:02:18.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.797+0000 7fc631ffb700 1 -- 172.21.15.60:0/1353995853 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61c011990 con 0x7fc634071d20 2023-07-12T02:02:18.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.797+0000 7fc631ffb700 1 -- 172.21.15.60:0/1353995853 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c011d20 con 0x7fc634071d20 2023-07-12T02:02:18.804 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.798+0000 7fc6394e4700 1 -- 172.21.15.60:0/1353995853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc634071d20 msgr2=0x7fc6341458b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:18.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.798+0000 7fc6394e4700 1 --2- 172.21.15.60:0/1353995853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc634071d20 0x7fc6341458b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc61c0098f0 tx=0x7fc61c009c00 comp rx=0 tx=0).stop 2023-07-12T02:02:18.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.798+0000 7fc6394e4700 1 -- 172.21.15.60:0/1353995853 shutdown_connections 2023-07-12T02:02:18.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.798+0000 7fc6394e4700 1 --2- 172.21.15.60:0/1353995853 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc6340709c0 0x7fc634145df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:18.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.798+0000 7fc6394e4700 1 --2- 172.21.15.60:0/1353995853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc634071d20 0x7fc6341458b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:18.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.798+0000 7fc6394e4700 1 -- 172.21.15.60:0/1353995853 >> 172.21.15.60:0/1353995853 conn(0x7fc6340be670 msgr2=0x7fc6340bea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:18.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.798+0000 7fc6394e4700 1 -- 172.21.15.60:0/1353995853 shutdown_connections 2023-07-12T02:02:18.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.798+0000 7fc6394e4700 1 -- 172.21.15.60:0/1353995853 wait complete. 2023-07-12T02:02:18.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.799+0000 7fc6394e4700 1 Processor -- start 2023-07-12T02:02:18.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.799+0000 7fc6394e4700 1 -- start start 2023-07-12T02:02:18.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.799+0000 7fc6394e4700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc6340709c0 0x7fc6341d3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:18.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.799+0000 7fc6394e4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc634071d20 0x7fc6341d3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:18.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.799+0000 7fc6394e4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc63414bf30 0x7fc634140910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:18.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.800+0000 7fc6394e4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6340b8470 con 0x7fc63414bf30 2023-07-12T02:02:18.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.800+0000 7fc6394e4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6340b86c0 con 0x7fc634071d20 2023-07-12T02:02:18.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.800+0000 7fc6394e4700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6340b89a0 con 0x7fc6340709c0 2023-07-12T02:02:18.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.800+0000 7fc6337fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc63414bf30 0x7fc634140910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:18.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.800+0000 7fc6337fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc63414bf30 0x7fc634140910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50348/0 (socket says 172.21.15.60:50348) 2023-07-12T02:02:18.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.800+0000 7fc6337fe700 1 -- 172.21.15.60:0/4201242412 learned_addr learned my addr 172.21.15.60:0/4201242412 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:18.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.800+0000 7fc632ffd700 1 --2- 172.21.15.60:0/4201242412 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc6340709c0 0x7fc6341d3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:18.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.800+0000 7fc6327fc700 1 --2- 172.21.15.60:0/4201242412 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc634071d20 0x7fc6341d3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:18.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.800+0000 7fc6337fe700 1 -- 172.21.15.60:0/4201242412 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc6340709c0 msgr2=0x7fc6341d3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:18.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.800+0000 7fc6337fe700 1 --2- 172.21.15.60:0/4201242412 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc6340709c0 0x7fc6341d3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:18.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.800+0000 7fc6337fe700 1 -- 172.21.15.60:0/4201242412 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc634071d20 msgr2=0x7fc6341d3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:18.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.800+0000 7fc6337fe700 1 --2- 172.21.15.60:0/4201242412 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc634071d20 0x7fc6341d3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:18.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.800+0000 7fc6337fe700 1 -- 172.21.15.60:0/4201242412 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc61c009550 con 0x7fc63414bf30 2023-07-12T02:02:18.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.800+0000 7fc632ffd700 1 --2- 172.21.15.60:0/4201242412 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc6340709c0 0x7fc6341d3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:02:18.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.800+0000 7fc6327fc700 1 --2- 172.21.15.60:0/4201242412 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc634071d20 0x7fc6341d3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:02:18.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.800+0000 7fc6337fe700 1 --2- 172.21.15.60:0/4201242412 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc63414bf30 0x7fc634140910 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc62c00efc0 tx=0x7fc62c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:18.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.800+0000 7fc62b7fe700 1 -- 172.21.15.60:0/4201242412 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c00cd40 con 0x7fc63414bf30 2023-07-12T02:02:18.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.800+0000 7fc62b7fe700 1 -- 172.21.15.60:0/4201242412 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62c00f040 con 0x7fc63414bf30 2023-07-12T02:02:18.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.800+0000 7fc6394e4700 1 -- 172.21.15.60:0/4201242412 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6341d2d30 con 0x7fc63414bf30 2023-07-12T02:02:18.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.800+0000 7fc62b7fe700 1 -- 172.21.15.60:0/4201242412 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c0146c0 con 0x7fc63414bf30 2023-07-12T02:02:18.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.800+0000 7fc6394e4700 1 -- 172.21.15.60:0/4201242412 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6341d4790 con 0x7fc63414bf30 2023-07-12T02:02:18.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.801+0000 7fc6394e4700 1 -- 172.21.15.60:0/4201242412 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6341d2f70 con 0x7fc63414bf30 2023-07-12T02:02:18.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.802+0000 7fc62b7fe700 1 -- 172.21.15.60:0/4201242412 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc62c014820 con 0x7fc63414bf30 2023-07-12T02:02:18.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.802+0000 7fc62b7fe700 1 --2- 172.21.15.60:0/4201242412 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc61406ad10 0x7fc61406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:18.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.802+0000 7fc62b7fe700 1 -- 172.21.15.60:0/4201242412 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc62c089d70 con 0x7fc63414bf30 2023-07-12T02:02:18.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.802+0000 7fc632ffd700 1 --2- 172.21.15.60:0/4201242412 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc61406ad10 0x7fc61406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:18.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.803+0000 7fc632ffd700 1 --2- 172.21.15.60:0/4201242412 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc61406ad10 0x7fc61406d1c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc624000f60 tx=0x7fc624009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:18.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:18.807+0000 7fc62b7fe700 1 -- 172.21.15.60:0/4201242412 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fc6341d2f70 con 0x7fc63414bf30 2023-07-12T02:02:19.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.004+0000 7fc6394e4700 1 -- 172.21.15.60:0/4201242412 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6341d2f70 con 0x7fc63414bf30 2023-07-12T02:02:19.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.006+0000 7fc62b7fe700 1 -- 172.21.15.60:0/4201242412 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18173 (secure 0 0 0) 0x7fc6341d2f70 con 0x7fc63414bf30 2023-07-12T02:02:19.009 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:02:19.009 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":21,"fsid":"97e7c909-e567-472e-a5aa-72fde15171f2","created":"2023-07-12T02:01:53.987086+0000","modified":"2023-07-12T02:02:14.307912+0000","last_up_change":"2023-07-12T02:02:04.031780+0000","last_in_change":"2023-07-12T02:01:56.538621+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-12T02:02:05.375042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-12T02:02:05.857441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:02:10.574633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-12T02:02:11.699872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ed8b71c2-3895-4952-a118-16ede0b4a98c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6801","nonce":2818935979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6803","nonce":2818935979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6807","nonce":2818935979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6805","nonce":2818935979}]},"public_addr":"172.21.15.60:6801/2818935979","cluster_addr":"172.21.15.60:6803/2818935979","heartbeat_back_addr":"172.21.15.60:6807/2818935979","heartbeat_front_addr":"172.21.15.60:6805/2818935979","state":["exists","up"]},{"osd":1,"uuid":"7cf4d354-78e0-43ce-8c09-4a7d2a0b57a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6817","nonce":1678864191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6819","nonce":1678864191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6823","nonce":1678864191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6821","nonce":1678864191}]},"public_addr":"172.21.15.60:6817/1678864191","cluster_addr":"172.21.15.60:6819/1678864191","heartbeat_back_addr":"172.21.15.60:6823/1678864191","heartbeat_front_addr":"172.21.15.60:6821/1678864191","state":["exists","up"]},{"osd":2,"uuid":"02c958b8-9599-4470-92cb-8f7018ec0189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6809","nonce":1459480680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6811","nonce":1459480680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6815","nonce":1459480680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6813","nonce":1459480680}]},"public_addr":"172.21.15.60:6809/1459480680","cluster_addr":"172.21.15.60:6811/1459480680","heartbeat_back_addr":"172.21.15.60:6815/1459480680","heartbeat_front_addr":"172.21.15.60:6813/1459480680","state":["exists","up"]},{"osd":3,"uuid":"bc300432-a228-4257-be5c-e42dd5f2015f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6825","nonce":3295100060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6827","nonce":3295100060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6831","nonce":3295100060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6829","nonce":3295100060}]},"public_addr":"172.21.15.60:6825/3295100060","cluster_addr":"172.21.15.60:6827/3295100060","heartbeat_back_addr":"172.21.15.60:6831/3295100060","heartbeat_front_addr":"172.21.15.60:6829/3295100060","state":["exists","up"]},{"osd":4,"uuid":"ad9f7dc4-7126-466d-a656-2844880c6060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6809","nonce":4127109138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6811","nonce":4127109138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6815","nonce":4127109138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6813","nonce":4127109138}]},"public_addr":"172.21.15.79:6809/4127109138","cluster_addr":"172.21.15.79:6811/4127109138","heartbeat_back_addr":"172.21.15.79:6815/4127109138","heartbeat_front_addr":"172.21.15.79:6813/4127109138","state":["exists","up"]},{"osd":5,"uuid":"e88d16ca-0b01-4ab9-8aa8-c4aff7f210f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6801","nonce":421449406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6803","nonce":421449406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6807","nonce":421449406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6805","nonce":421449406}]},"public_addr":"172.21.15.79:6801/421449406","cluster_addr":"172.21.15.79:6803/421449406","heartbeat_back_addr":"172.21.15.79:6807/421449406","heartbeat_front_addr":"172.21.15.79:6805/421449406","state":["exists","up"]},{"osd":6,"uuid":"6898cb84-56d1-48a9-bd45-97e4668e2fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6825","nonce":4144355139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6827","nonce":4144355139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6831","nonce":4144355139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6829","nonce":4144355139}]},"public_addr":"172.21.15.79:6825/4144355139","cluster_addr":"172.21.15.79:6827/4144355139","heartbeat_back_addr":"172.21.15.79:6831/4144355139","heartbeat_front_addr":"172.21.15.79:6829/4144355139","state":["exists","up"]},{"osd":7,"uuid":"65c10882-371e-4762-b384-9c3a48f332ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6817","nonce":2845223299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6819","nonce":2845223299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6823","nonce":2845223299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6821","nonce":2845223299}]},"public_addr":"172.21.15.79:6817/2845223299","cluster_addr":"172.21.15.79:6819/2845223299","heartbeat_back_addr":"172.21.15.79:6823/2845223299","heartbeat_front_addr":"172.21.15.79:6821/2845223299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.634716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.758349+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.728366+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.777395+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707262+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.649705+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.693021+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:02:19.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.008+0000 7fc6394e4700 1 -- 172.21.15.60:0/4201242412 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc61406ad10 msgr2=0x7fc61406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.008+0000 7fc6394e4700 1 --2- 172.21.15.60:0/4201242412 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc61406ad10 0x7fc61406d1c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc624000f60 tx=0x7fc624009040 comp rx=0 tx=0).stop 2023-07-12T02:02:19.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.008+0000 7fc6394e4700 1 -- 172.21.15.60:0/4201242412 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc63414bf30 msgr2=0x7fc634140910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.008+0000 7fc6394e4700 1 --2- 172.21.15.60:0/4201242412 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc63414bf30 0x7fc634140910 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc62c00efc0 tx=0x7fc62c00c3a0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.008+0000 7fc6394e4700 1 -- 172.21.15.60:0/4201242412 shutdown_connections 2023-07-12T02:02:19.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.008+0000 7fc6394e4700 1 --2- 172.21.15.60:0/4201242412 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc61406ad10 0x7fc61406d1c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.012 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.008+0000 7fc6394e4700 1 --2- 172.21.15.60:0/4201242412 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc63414bf30 0x7fc634140910 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.012 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.008+0000 7fc6394e4700 1 --2- 172.21.15.60:0/4201242412 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc6340709c0 0x7fc6341d3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.012 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.008+0000 7fc6394e4700 1 --2- 172.21.15.60:0/4201242412 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc634071d20 0x7fc6341d3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.012 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.008+0000 7fc6394e4700 1 -- 172.21.15.60:0/4201242412 >> 172.21.15.60:0/4201242412 conn(0x7fc6340be670 msgr2=0x7fc634143db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:19.012 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.008+0000 7fc6394e4700 1 -- 172.21.15.60:0/4201242412 shutdown_connections 2023-07-12T02:02:19.012 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.008+0000 7fc6394e4700 1 -- 172.21.15.60:0/4201242412 wait complete. 2023-07-12T02:02:19.023 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-07-12T02:02:19.024 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-07-12T02:02:19.024 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-07-12T02:02:19.025 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-07-12T02:02:19.025 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-07-12T02:02:19.026 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-07-12T02:02:19.026 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-07-12T02:02:19.027 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-07-12T02:02:19.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.241+0000 7fb881a04700 1 Processor -- start 2023-07-12T02:02:19.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.241+0000 7fb881a04700 1 -- start start 2023-07-12T02:02:19.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.242+0000 7fb881a04700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb87c152040 0x7fb87c148750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.242+0000 7fb881a04700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb87c148c90 0x7fb87c1593d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.242+0000 7fb881a04700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb87c0b3a20 con 0x7fb87c0b4810 2023-07-12T02:02:19.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.242+0000 7fb881a04700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb87c0b3fe0 con 0x7fb87c152040 2023-07-12T02:02:19.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.242+0000 7fb881a04700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c0b55d0 con 0x7fb87c148c90 2023-07-12T02:02:19.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.242+0000 7fb87b7fe700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb87c148c90 0x7fb87c1593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.243+0000 7fb87b7fe700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb87c148c90 0x7fb87c1593d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.60:44504/0 (socket says 172.21.15.60:44504) 2023-07-12T02:02:19.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.243+0000 7fb87b7fe700 1 -- 172.21.15.60:0/2294531112 learned_addr learned my addr 172.21.15.60:0/2294531112 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:19.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.243+0000 7fb87a7fc700 1 --2- 172.21.15.60:0/2294531112 >> v2:172.21.15.60:3300/0 conn(0x7fb87c152040 0x7fb87c148750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.244+0000 7fb87b7fe700 1 -- 172.21.15.60:0/2294531112 >> v2:172.21.15.60:3300/0 conn(0x7fb87c152040 msgr2=0x7fb87c148750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:19.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.244+0000 7fb87b7fe700 1 --2- 172.21.15.60:0/2294531112 >> v2:172.21.15.60:3300/0 conn(0x7fb87c152040 0x7fb87c148750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.244+0000 7fb87b7fe700 1 -- 172.21.15.60:0/2294531112 >> v1:172.21.15.79:6789/0 conn(0x7fb87c0b4810 legacy=0x7fb87c0b8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.244+0000 7fb87b7fe700 1 -- 172.21.15.60:0/2294531112 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb87c0b3d00 con 0x7fb87c148c90 2023-07-12T02:02:19.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.243+0000 7f06fe764700 1 Processor -- start 2023-07-12T02:02:19.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.244+0000 7f06fe764700 1 -- start start 2023-07-12T02:02:19.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.244+0000 7fb87b7fe700 1 --2- 172.21.15.60:0/2294531112 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb87c148c90 0x7fb87c1593d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb874009e50 tx=0x7fb87400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db5af3fc73282dfb server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.245+0000 7f3796f93700 1 Processor -- start 2023-07-12T02:02:19.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.245+0000 7fb0a5d19700 1 Processor -- start 2023-07-12T02:02:19.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.245+0000 7f3796f93700 1 -- start start 2023-07-12T02:02:19.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.246+0000 7f3796f93700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3790147dc0 0x7f37900721e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.246+0000 7f3796f93700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3790069f30 0x7f3790071130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.246+0000 7f3796f93700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f379006f680 con 0x7f379006a3b0 2023-07-12T02:02:19.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.246+0000 7f3796f93700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3790070950 con 0x7f3790147dc0 2023-07-12T02:02:19.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.246+0000 7f3796f93700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f379006f920 con 0x7f3790069f30 2023-07-12T02:02:19.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.245+0000 7fb0a5d19700 1 -- start start 2023-07-12T02:02:19.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.246+0000 7fb0a5d19700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0a006b120 0x7fb0a00b9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.246+0000 7fb0a5d19700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb0a014f320 0x7fb0a0070e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.246+0000 7fb0a5d19700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0a006ef40 con 0x7fb0a0071380 2023-07-12T02:02:19.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.246+0000 7fb0a5d19700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0a006f220 con 0x7fb0a014f320 2023-07-12T02:02:19.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.246+0000 7fb0a5d19700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a0070300 con 0x7fb0a006b120 2023-07-12T02:02:19.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.245+0000 7fb879ffb700 1 -- 172.21.15.60:0/2294531112 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87400e070 con 0x7fb87c148c90 2023-07-12T02:02:19.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.245+0000 7fb879ffb700 1 -- 172.21.15.60:0/2294531112 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb87400b910 con 0x7fb87c148c90 2023-07-12T02:02:19.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.245+0000 7fb879ffb700 1 -- 172.21.15.60:0/2294531112 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87400bcc0 con 0x7fb87c148c90 2023-07-12T02:02:19.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.246+0000 7fb881a04700 1 -- 172.21.15.60:0/2294531112 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb87c148c90 msgr2=0x7fb87c1593d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.246+0000 7fb881a04700 1 --2- 172.21.15.60:0/2294531112 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb87c148c90 0x7fb87c1593d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb874009e50 tx=0x7fb87400b330 comp rx=0 tx=0).stop 2023-07-12T02:02:19.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.246+0000 7f3795530700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f379006a3b0 0x7f379014dc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.60:57910/0 (socket says 172.21.15.60:57910) 2023-07-12T02:02:19.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.246+0000 7f3795530700 1 -- 172.21.15.60:0/3660393026 learned_addr learned my addr 172.21.15.60:0/3660393026 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:19.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.246+0000 7f378ffff700 1 --2- 172.21.15.60:0/3660393026 >> v2:172.21.15.79:3300/0 conn(0x7f3790069f30 0x7f3790071130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.246+0000 7fb09f7fe700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0a006b120 0x7fb0a00b9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.246+0000 7fb09ffff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb0a0071380 0x7fb0a01520a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.60:57924/0 (socket says 172.21.15.60:57924) 2023-07-12T02:02:19.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.246+0000 7fb09ffff700 1 -- 172.21.15.60:0/207528623 learned_addr learned my addr 172.21.15.60:0/207528623 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:19.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.247+0000 7fb881a04700 1 -- 172.21.15.60:0/2294531112 shutdown_connections 2023-07-12T02:02:19.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.247+0000 7fb881a04700 1 --2- 172.21.15.60:0/2294531112 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb87c148c90 0x7fb87c1593d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.247+0000 7fb881a04700 1 --2- 172.21.15.60:0/2294531112 >> v2:172.21.15.60:3300/0 conn(0x7fb87c152040 0x7fb87c148750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.247+0000 7fb881a04700 1 -- 172.21.15.60:0/2294531112 >> 172.21.15.60:0/2294531112 conn(0x7fb87c069f30 msgr2=0x7fb87c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:19.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.247+0000 7f06fe764700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f06f80b6370 0x7f06f80b8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.247+0000 7f06fe764700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f06f80b9270 0x7f06f80b4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.247+0000 7fb881a04700 1 -- 172.21.15.60:0/2294531112 shutdown_connections 2023-07-12T02:02:19.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.247+0000 7f06fe764700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06f80b96f0 con 0x7f06f81573e0 2023-07-12T02:02:19.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.247+0000 7f06fe764700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06f81577b0 con 0x7f06f80b6370 2023-07-12T02:02:19.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.247+0000 7f06fe764700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06f80b5ce0 con 0x7f06f80b9270 2023-07-12T02:02:19.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.247+0000 7f378ffff700 1 -- 172.21.15.60:0/3660393026 >> v2:172.21.15.60:3300/0 conn(0x7f3790147dc0 msgr2=0x7f37900721e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:19.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.247+0000 7f378ffff700 1 --2- 172.21.15.60:0/3660393026 >> v2:172.21.15.60:3300/0 conn(0x7f3790147dc0 0x7f37900721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.247+0000 7f378ffff700 1 -- 172.21.15.60:0/3660393026 >> v1:172.21.15.79:6789/0 conn(0x7f379006a3b0 legacy=0x7f379014dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.247+0000 7f378ffff700 1 -- 172.21.15.60:0/3660393026 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37900b9660 con 0x7f3790069f30 2023-07-12T02:02:19.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.247+0000 7fb09effd700 1 --2- 172.21.15.60:0/207528623 >> v2:172.21.15.60:3300/0 conn(0x7fb0a014f320 0x7fb0a0070e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.247+0000 7f378ffff700 1 --2- 172.21.15.60:0/3660393026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3790069f30 0x7f3790071130 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f379006f090 tx=0x7f3778009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4baa7c1c1d0913f server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.247+0000 7fb881a04700 1 -- 172.21.15.60:0/2294531112 wait complete. 2023-07-12T02:02:19.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.247+0000 7f06fcd01700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f06f80b9270 0x7f06f80b4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.247+0000 7f06fcd01700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f06f80b9270 0x7f06f80b4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.60:43226/0 (socket says 172.21.15.60:43226) 2023-07-12T02:02:19.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.247+0000 7f06fcd01700 1 -- 172.21.15.60:0/2752233875 learned_addr learned my addr 172.21.15.60:0/2752233875 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:19.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.247+0000 7fb09f7fe700 1 -- 172.21.15.60:0/207528623 >> v2:172.21.15.60:3300/0 conn(0x7fb0a014f320 msgr2=0x7fb0a0070e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:19.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.247+0000 7fb09f7fe700 1 --2- 172.21.15.60:0/207528623 >> v2:172.21.15.60:3300/0 conn(0x7fb0a014f320 0x7fb0a0070e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.247+0000 7fb09f7fe700 1 -- 172.21.15.60:0/207528623 >> v1:172.21.15.79:6789/0 conn(0x7fb0a0071380 legacy=0x7fb0a01520a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.248+0000 7fb09f7fe700 1 -- 172.21.15.60:0/207528623 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a014eb50 con 0x7fb0a006b120 2023-07-12T02:02:19.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.248+0000 7f378f7fe700 1 -- 172.21.15.60:0/3660393026 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3778011830 con 0x7f3790069f30 2023-07-12T02:02:19.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.248+0000 7f378f7fe700 1 -- 172.21.15.60:0/3660393026 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3778011990 con 0x7f3790069f30 2023-07-12T02:02:19.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.248+0000 7f378f7fe700 1 -- 172.21.15.60:0/3660393026 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3778011d20 con 0x7f3790069f30 2023-07-12T02:02:19.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.248+0000 7fb09f7fe700 1 --2- 172.21.15.60:0/207528623 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0a006b120 0x7fb0a00b9f50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb098009d90 tx=0x7fb09800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a95f8edadbc7e31 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.248+0000 7fb881a04700 1 Processor -- start 2023-07-12T02:02:19.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.249+0000 7f3796f93700 1 -- 172.21.15.60:0/3660393026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3790069f30 msgr2=0x7f3790071130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.249+0000 7f3796f93700 1 --2- 172.21.15.60:0/3660393026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3790069f30 0x7f3790071130 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f379006f090 tx=0x7f3778009b20 comp rx=0 tx=0).stop 2023-07-12T02:02:19.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.249+0000 7f3796f93700 1 -- 172.21.15.60:0/3660393026 shutdown_connections 2023-07-12T02:02:19.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.249+0000 7f3796f93700 1 --2- 172.21.15.60:0/3660393026 >> v2:172.21.15.60:3300/0 conn(0x7f3790147dc0 0x7f37900721e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.249+0000 7f3796f93700 1 --2- 172.21.15.60:0/3660393026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3790069f30 0x7f3790071130 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.249+0000 7f3796f93700 1 -- 172.21.15.60:0/3660393026 >> 172.21.15.60:0/3660393026 conn(0x7f379006d0e0 msgr2=0x7f379006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:19.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.249+0000 7f06f77fe700 1 --2- 172.21.15.60:0/2752233875 >> v2:172.21.15.60:3300/0 conn(0x7f06f80b6370 0x7f06f80b8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.249+0000 7f06fcd01700 1 -- 172.21.15.60:0/2752233875 >> v2:172.21.15.60:3300/0 conn(0x7f06f80b6370 msgr2=0x7f06f80b8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:19.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.249+0000 7f06fcd01700 1 --2- 172.21.15.60:0/2752233875 >> v2:172.21.15.60:3300/0 conn(0x7f06f80b6370 0x7f06f80b8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.249+0000 7f06fcd01700 1 -- 172.21.15.60:0/2752233875 >> v1:172.21.15.79:6789/0 conn(0x7f06f81573e0 legacy=0x7f06f8089b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.249+0000 7f06fcd01700 1 -- 172.21.15.60:0/2752233875 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f80b3990 con 0x7f06f80b9270 2023-07-12T02:02:19.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.249+0000 7f06f6ffd700 1 -- 172.21.15.60:0/2752233875 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3089523334 0 0) 0x7f06e8001110 con 0x7f06f81573e0 2023-07-12T02:02:19.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.248+0000 7fb09e7fc700 1 -- 172.21.15.60:0/207528623 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09800e070 con 0x7fb0a006b120 2023-07-12T02:02:19.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.248+0000 7fb09e7fc700 1 -- 172.21.15.60:0/207528623 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09800bb20 con 0x7fb0a006b120 2023-07-12T02:02:19.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.248+0000 7fb09e7fc700 1 -- 172.21.15.60:0/207528623 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb098012430 con 0x7fb0a006b120 2023-07-12T02:02:19.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.249+0000 7fb0a5d19700 1 -- 172.21.15.60:0/207528623 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0a006b120 msgr2=0x7fb0a00b9f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.249+0000 7fb0a5d19700 1 --2- 172.21.15.60:0/207528623 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0a006b120 0x7fb0a00b9f50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb098009d90 tx=0x7fb09800b330 comp rx=0 tx=0).stop 2023-07-12T02:02:19.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.249+0000 7fb0a5d19700 1 -- 172.21.15.60:0/207528623 shutdown_connections 2023-07-12T02:02:19.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.249+0000 7fb0a5d19700 1 --2- 172.21.15.60:0/207528623 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0a006b120 0x7fb0a00b9f50 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.249+0000 7fb0a5d19700 1 --2- 172.21.15.60:0/207528623 >> v2:172.21.15.60:3300/0 conn(0x7fb0a014f320 0x7fb0a0070e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.249+0000 7fb0a5d19700 1 -- 172.21.15.60:0/207528623 >> 172.21.15.60:0/207528623 conn(0x7fb0a00bd980 msgr2=0x7fb0a00b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:19.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.249+0000 7fb0a5d19700 1 -- 172.21.15.60:0/207528623 shutdown_connections 2023-07-12T02:02:19.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.249+0000 7fb0a5d19700 1 -- 172.21.15.60:0/207528623 wait complete. 2023-07-12T02:02:19.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.250+0000 7f3796f93700 1 -- 172.21.15.60:0/3660393026 shutdown_connections 2023-07-12T02:02:19.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.250+0000 7f3796f93700 1 -- 172.21.15.60:0/3660393026 wait complete. 2023-07-12T02:02:19.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.251+0000 7fb5755a6700 1 Processor -- start 2023-07-12T02:02:19.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.251+0000 7fb5755a6700 1 -- start start 2023-07-12T02:02:19.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.251+0000 7f22be03c700 1 Processor -- start 2023-07-12T02:02:19.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.251+0000 7f22be03c700 1 -- start start 2023-07-12T02:02:19.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.251+0000 7f3796f93700 1 Processor -- start 2023-07-12T02:02:19.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.249+0000 7fb881a04700 1 -- start start 2023-07-12T02:02:19.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.250+0000 7fb881a04700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb87c0b4810 0x7fb87c12e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.250+0000 7fb881a04700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb87c148c90 0x7fb87c149d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.250+0000 7fb881a04700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb87c152040 0x7fb87c132820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.250+0000 7fb881a04700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c131db0 con 0x7fb87c148c90 2023-07-12T02:02:19.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.250+0000 7fb881a04700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c149420 con 0x7fb87c0b4810 2023-07-12T02:02:19.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.250+0000 7fb881a04700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c14a850 con 0x7fb87c152040 2023-07-12T02:02:19.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.250+0000 7fb87a7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb87c148c90 0x7fb87c149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.250+0000 7fb87a7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb87c148c90 0x7fb87c149d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50394/0 (socket says 172.21.15.60:50394) 2023-07-12T02:02:19.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.250+0000 7fb87a7fc700 1 -- 172.21.15.60:0/3464395041 learned_addr learned my addr 172.21.15.60:0/3464395041 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:19.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.250+0000 7fb87affd700 1 --2- 172.21.15.60:0/3464395041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb87c0b4810 0x7fb87c12e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.251+0000 7fb87b7fe700 1 --2- 172.21.15.60:0/3464395041 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb87c152040 0x7fb87c132820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.251+0000 7fb87affd700 1 -- 172.21.15.60:0/3464395041 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb87c152040 msgr2=0x7fb87c132820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.251+0000 7fb87affd700 1 --2- 172.21.15.60:0/3464395041 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb87c152040 0x7fb87c132820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.251+0000 7fb87affd700 1 -- 172.21.15.60:0/3464395041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb87c148c90 msgr2=0x7fb87c149d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.251+0000 7fb87affd700 1 --2- 172.21.15.60:0/3464395041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb87c148c90 0x7fb87c149d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.251+0000 7fb87affd700 1 -- 172.21.15.60:0/3464395041 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb874009b30 con 0x7fb87c0b4810 2023-07-12T02:02:19.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.251+0000 7fb87affd700 1 --2- 172.21.15.60:0/3464395041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb87c0b4810 0x7fb87c12e500 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb870000f60 tx=0x7fb87000c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.251+0000 7fb863fff700 1 -- 172.21.15.60:0/3464395041 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87000ce30 con 0x7fb87c0b4810 2023-07-12T02:02:19.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.252+0000 7fb863fff700 1 -- 172.21.15.60:0/3464395041 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8700050d0 con 0x7fb87c0b4810 2023-07-12T02:02:19.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.252+0000 7fb863fff700 1 -- 172.21.15.60:0/3464395041 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb870005480 con 0x7fb87c0b4810 2023-07-12T02:02:19.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.252+0000 7fb881a04700 1 -- 172.21.15.60:0/3464395041 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb87c1479e0 con 0x7fb87c0b4810 2023-07-12T02:02:19.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.252+0000 7fb881a04700 1 -- 172.21.15.60:0/3464395041 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb87c12ea40 con 0x7fb87c0b4810 2023-07-12T02:02:19.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.252+0000 7fb5755a6700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb570071910 0x7fb57014f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.252+0000 7fb5755a6700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb57014c880 0x7fb5701596d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.252+0000 7fb5755a6700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb57014f320 con 0x7fb570070d80 2023-07-12T02:02:19.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.252+0000 7fb5755a6700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb570071540 con 0x7fb570071910 2023-07-12T02:02:19.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.252+0000 7fb5755a6700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5700700c0 con 0x7fb57014c880 2023-07-12T02:02:19.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.252+0000 7fb56f7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb57014c880 0x7fb5701596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.252+0000 7fb56f7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb57014c880 0x7fb5701596d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.60:43242/0 (socket says 172.21.15.60:43242) 2023-07-12T02:02:19.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.252+0000 7fb56f7fe700 1 -- 172.21.15.60:0/1319849194 learned_addr learned my addr 172.21.15.60:0/1319849194 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:19.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.252+0000 7f22be03c700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f22b80bdcc0 0x7f22b80bc280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.252+0000 7f22be03c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f22b80ba620 0x7f22b8148420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.252+0000 7f22be03c700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22b80bab40 con 0x7f22b80bc7c0 2023-07-12T02:02:19.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.252+0000 7f22be03c700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22b80ba260 con 0x7f22b80ba620 2023-07-12T02:02:19.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.252+0000 7f22be03c700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b80b9a60 con 0x7f22b80bdcc0 2023-07-12T02:02:19.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.251+0000 7f3796f93700 1 -- start start 2023-07-12T02:02:19.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.253+0000 7f3796f93700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3790069f30 0x7f37900b73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.253+0000 7f3796f93700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f379006a3b0 0x7f37901e7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.253+0000 7f3796f93700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3790147dc0 0x7f37900bbf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.253+0000 7f3796f93700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37900bc450 con 0x7f379006a3b0 2023-07-12T02:02:19.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.253+0000 7f3796f93700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37900b6f10 con 0x7f3790069f30 2023-07-12T02:02:19.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.253+0000 7f3796f93700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f379014ba10 con 0x7f3790147dc0 2023-07-12T02:02:19.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.253+0000 7fb56f7fe700 1 -- 172.21.15.60:0/1319849194 >> v2:172.21.15.60:3300/0 conn(0x7fb570071910 msgr2=0x7fb57014f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:19.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.253+0000 7fb56f7fe700 1 --2- 172.21.15.60:0/1319849194 >> v2:172.21.15.60:3300/0 conn(0x7fb570071910 0x7fb57014f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.253+0000 7fb56f7fe700 1 -- 172.21.15.60:0/1319849194 >> v1:172.21.15.60:6789/0 conn(0x7fb570070d80 legacy=0x7fb57014c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:19.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.253+0000 7fb56f7fe700 1 -- 172.21.15.60:0/1319849194 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb570071260 con 0x7fb57014c880 2023-07-12T02:02:19.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.253+0000 7f3795530700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3790147dc0 0x7f37900bbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.253+0000 7f3795530700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3790147dc0 0x7f37900bbf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.60:44528/0 (socket says 172.21.15.60:44528) 2023-07-12T02:02:19.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.253+0000 7f3795530700 1 -- 172.21.15.60:0/3182453487 learned_addr learned my addr 172.21.15.60:0/3182453487 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:19.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.253+0000 7fb56f7fe700 1 --2- 172.21.15.60:0/1319849194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb57014c880 0x7fb5701596d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb570072310 tx=0x7fb56800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad693d247ab8191e server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.253+0000 7f378ffff700 1 --2- 172.21.15.60:0/3182453487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f379006a3b0 0x7f37901e7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.253+0000 7f3794d2f700 1 --2- 172.21.15.60:0/3182453487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3790069f30 0x7f37900b73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.253+0000 7f22b6ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f22b80ba620 0x7f22b8148420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.253+0000 7f22b6ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f22b80ba620 0x7f22b8148420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.60:43256/0 (socket says 172.21.15.60:43256) 2023-07-12T02:02:19.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.253+0000 7f22b6ffd700 1 -- 172.21.15.60:0/2769704636 learned_addr learned my addr 172.21.15.60:0/2769704636 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:19.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.253+0000 7f22b7fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f22b80bc7c0 0x7f22b8151f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.60:57940/0 (socket says 172.21.15.60:57940) 2023-07-12T02:02:19.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.253+0000 7f3795530700 1 -- 172.21.15.60:0/3182453487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3790069f30 msgr2=0x7f37900b73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.253+0000 7f3795530700 1 --2- 172.21.15.60:0/3182453487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3790069f30 0x7f37900b73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.253+0000 7f3795530700 1 -- 172.21.15.60:0/3182453487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f379006a3b0 msgr2=0x7f37901e7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.253+0000 7f3795530700 1 --2- 172.21.15.60:0/3182453487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f379006a3b0 0x7f37901e7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.253+0000 7f3795530700 1 -- 172.21.15.60:0/3182453487 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37780094a0 con 0x7f3790147dc0 2023-07-12T02:02:19.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.253+0000 7fb881a04700 1 -- 172.21.15.60:0/3464395041 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb85c000fc0 con 0x7fb87c0b4810 2023-07-12T02:02:19.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.254+0000 7f22b67fc700 1 -- 172.21.15.60:0/2769704636 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3062344415 0 0) 0x7f22b80bab40 con 0x7f22b80bc7c0 2023-07-12T02:02:19.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.254+0000 7f22b67fc700 1 -- 172.21.15.60:0/2769704636 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22a00035b0 con 0x7f22b80bc7c0 2023-07-12T02:02:19.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.254+0000 7f3795530700 1 --2- 172.21.15.60:0/3182453487 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3790147dc0 0x7f37900bbf10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f378000cad0 tx=0x7f378000cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.255+0000 7fb56dffb700 1 -- 172.21.15.60:0/1319849194 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56800e070 con 0x7fb57014c880 2023-07-12T02:02:19.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.255+0000 7fb863fff700 1 -- 172.21.15.60:0/3464395041 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb870003680 con 0x7fb87c0b4810 2023-07-12T02:02:19.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.254+0000 7f378d7fa700 1 -- 172.21.15.60:0/3182453487 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378000aa60 con 0x7f3790147dc0 2023-07-12T02:02:19.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.254+0000 7f378d7fa700 1 -- 172.21.15.60:0/3182453487 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378000abc0 con 0x7f3790147dc0 2023-07-12T02:02:19.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.254+0000 7f3796f93700 1 -- 172.21.15.60:0/3182453487 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f379014bcf0 con 0x7f3790147dc0 2023-07-12T02:02:19.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.254+0000 7f3796f93700 1 -- 172.21.15.60:0/3182453487 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f379014bfd0 con 0x7f3790147dc0 2023-07-12T02:02:19.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.255+0000 7f378d7fa700 1 -- 172.21.15.60:0/3182453487 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3780012400 con 0x7f3790147dc0 2023-07-12T02:02:19.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.251+0000 7fb0a5d19700 1 Processor -- start 2023-07-12T02:02:19.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.254+0000 7f22b67fc700 1 -- 172.21.15.60:0/2769704636 <== mon.1 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1953456764 0 0) 0x7f22a00035b0 con 0x7f22b80bc7c0 2023-07-12T02:02:19.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.254+0000 7f22b67fc700 1 -- 172.21.15.60:0/2769704636 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f22b80bdcc0 msgr2=0x7f22b80bc280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-12T02:02:19.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.254+0000 7f22b67fc700 1 --2- 172.21.15.60:0/2769704636 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f22b80bdcc0 0x7f22b80bc280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.254+0000 7f22b67fc700 1 -- 172.21.15.60:0/2769704636 >> v2:172.21.15.79:3300/0 conn(0x7f22b80ba620 msgr2=0x7f22b8148420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:19.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.254+0000 7f22b67fc700 1 --2- 172.21.15.60:0/2769704636 >> v2:172.21.15.79:3300/0 conn(0x7f22b80ba620 0x7f22b8148420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.254+0000 7f22b67fc700 1 -- 172.21.15.60:0/2769704636 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b80b9d40 con 0x7f22b80bc7c0 2023-07-12T02:02:19.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.254+0000 7f22b67fc700 1 -- 172.21.15.60:0/2769704636 <== mon.1 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1141905739 0 0) 0x7f22b00019f0 con 0x7f22b80bc7c0 2023-07-12T02:02:19.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.254+0000 7f22b67fc700 1 -- 172.21.15.60:0/2769704636 >> v1:172.21.15.79:6789/0 conn(0x7f22b80bc7c0 legacy=0x7f22b8151f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.254+0000 7f22b67fc700 1 --2- 172.21.15.60:0/2769704636 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f22a0003a00 0x7f22a0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.254+0000 7f22b67fc700 1 --2- 172.21.15.60:0/2769704636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22a0004850 0x7f22a0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.254+0000 7f22b67fc700 1 --2- 172.21.15.60:0/2769704636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22a0005200 0x7f22a000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.254+0000 7f22b67fc700 1 -- 172.21.15.60:0/2769704636 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b80ba260 con 0x7f22a0005200 2023-07-12T02:02:19.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.254+0000 7f22b67fc700 1 -- 172.21.15.60:0/2769704636 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b80b9a60 con 0x7f22a0004850 2023-07-12T02:02:19.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.254+0000 7f22b67fc700 1 -- 172.21.15.60:0/2769704636 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22a000c0e0 con 0x7f22a0003a00 2023-07-12T02:02:19.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.255+0000 7f22b6ffd700 1 --2- 172.21.15.60:0/2769704636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22a0004850 0x7f22a0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.255+0000 7f22b7fff700 1 --2- 172.21.15.60:0/2769704636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22a0005200 0x7f22a000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.255+0000 7f22b6ffd700 1 -- 172.21.15.60:0/2769704636 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f22a0003a00 msgr2=0x7f22a0003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:19.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.255+0000 7f22b6ffd700 1 --2- 172.21.15.60:0/2769704636 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f22a0003a00 0x7f22a0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.255+0000 7f22b6ffd700 1 -- 172.21.15.60:0/2769704636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22a0005200 msgr2=0x7f22a000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:19.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.255+0000 7f22b6ffd700 1 --2- 172.21.15.60:0/2769704636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22a0005200 0x7f22a000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.255+0000 7f22b6ffd700 1 -- 172.21.15.60:0/2769704636 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b80b9d40 con 0x7f22a0004850 2023-07-12T02:02:19.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.251+0000 7f06fcd01700 1 --2- 172.21.15.60:0/2752233875 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06f80b9270 0x7f06f80b4650 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f06f80b9b50 tx=0x7f06ec009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ac893d4a1a17a2b server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.253+0000 7f06f6ffd700 1 -- 172.21.15.60:0/2752233875 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec00b870 con 0x7f06f80b9270 2023-07-12T02:02:19.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.253+0000 7f06f6ffd700 1 -- 172.21.15.60:0/2752233875 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ec00b9d0 con 0x7f06f80b9270 2023-07-12T02:02:19.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.253+0000 7f06f6ffd700 1 -- 172.21.15.60:0/2752233875 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec00bd60 con 0x7f06f80b9270 2023-07-12T02:02:19.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.253+0000 7f06fe764700 1 -- 172.21.15.60:0/2752233875 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06f80b9270 msgr2=0x7f06f80b4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.253+0000 7f06fe764700 1 --2- 172.21.15.60:0/2752233875 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06f80b9270 0x7f06f80b4650 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f06f80b9b50 tx=0x7f06ec009bd0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.254+0000 7f06fe764700 1 -- 172.21.15.60:0/2752233875 shutdown_connections 2023-07-12T02:02:19.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.254+0000 7f06fe764700 1 --2- 172.21.15.60:0/2752233875 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06f80b9270 0x7f06f80b4650 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.254+0000 7f06fe764700 1 --2- 172.21.15.60:0/2752233875 >> v2:172.21.15.60:3300/0 conn(0x7f06f80b6370 0x7f06f80b8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.254+0000 7f06fe764700 1 -- 172.21.15.60:0/2752233875 >> 172.21.15.60:0/2752233875 conn(0x7f06f8069f30 msgr2=0x7f06f806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:19.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.255+0000 7f06fe764700 1 -- 172.21.15.60:0/2752233875 shutdown_connections 2023-07-12T02:02:19.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.255+0000 7fb56dffb700 1 -- 172.21.15.60:0/1319849194 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb568003a20 con 0x7fb57014c880 2023-07-12T02:02:19.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.255+0000 7fb56dffb700 1 -- 172.21.15.60:0/1319849194 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb568003dd0 con 0x7fb57014c880 2023-07-12T02:02:19.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.256+0000 7fb5755a6700 1 -- 172.21.15.60:0/1319849194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb57014c880 msgr2=0x7fb5701596d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.256+0000 7fb5755a6700 1 --2- 172.21.15.60:0/1319849194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb57014c880 0x7fb5701596d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb570072310 tx=0x7fb56800b330 comp rx=0 tx=0).stop 2023-07-12T02:02:19.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.256+0000 7f22b6ffd700 1 --2- 172.21.15.60:0/2769704636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22a0004850 0x7f22a0004cc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f22a8009920 tx=0x7f22a0005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe8d1e814b6aed2d server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.255+0000 7fb863fff700 1 --2- 172.21.15.60:0/3464395041 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fb86806ad30 0x7fb86806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.255+0000 7fb863fff700 1 -- 172.21.15.60:0/3464395041 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb8700aa430 con 0x7fb87c0b4810 2023-07-12T02:02:19.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.255+0000 7fb863fff700 1 --2- 172.21.15.60:0/3464395041 >> [v2:172.21.15.60:6816/1678864191,v1:172.21.15.60:6817/1678864191] conn(0x7fb868073560 0x7fb868075970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.255+0000 7fb863fff700 1 -- 172.21.15.60:0/3464395041 --> [v2:172.21.15.60:6816/1678864191,v1:172.21.15.60:6817/1678864191] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb868076020 con 0x7fb868073560 2023-07-12T02:02:19.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.256+0000 7fb863fff700 1 -- 172.21.15.60:0/3464395041 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb870075650 con 0x7fb87c0b4810 2023-07-12T02:02:19.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.256+0000 7f3796f93700 1 -- 172.21.15.60:0/3182453487 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3774000fc0 con 0x7f3790147dc0 2023-07-12T02:02:19.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.256+0000 7f22b67fc700 1 -- 172.21.15.60:0/2769704636 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a800c070 con 0x7f22a0004850 2023-07-12T02:02:19.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.256+0000 7fb5755a6700 1 -- 172.21.15.60:0/1319849194 shutdown_connections 2023-07-12T02:02:19.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.256+0000 7fb5755a6700 1 --2- 172.21.15.60:0/1319849194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb57014c880 0x7fb5701596d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.256+0000 7fb5755a6700 1 --2- 172.21.15.60:0/1319849194 >> v2:172.21.15.60:3300/0 conn(0x7fb570071910 0x7fb57014f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.256+0000 7fb5755a6700 1 -- 172.21.15.60:0/1319849194 >> 172.21.15.60:0/1319849194 conn(0x7fb5700be670 msgr2=0x7fb5700bea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:19.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.256+0000 7f22b67fc700 1 -- 172.21.15.60:0/2769704636 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a8013610 con 0x7f22a0004850 2023-07-12T02:02:19.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.256+0000 7f22b67fc700 1 -- 172.21.15.60:0/2769704636 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a80139a0 con 0x7f22a0004850 2023-07-12T02:02:19.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.256+0000 7fb0a5d19700 1 -- start start 2023-07-12T02:02:19.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.257+0000 7fb0a5d19700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0a006b120 0x7fb0a00b56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.257+0000 7fb0a5d19700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0a0071380 0x7fb0a0129430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.257+0000 7fb0a5d19700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0a014f320 0x7fb0a0147f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.257+0000 7fb0a5d19700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a00b52c0 con 0x7fb0a014f320 2023-07-12T02:02:19.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.257+0000 7fb0a5d19700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a00b42f0 con 0x7fb0a006b120 2023-07-12T02:02:19.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.257+0000 7fb0a5d19700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a00b4050 con 0x7fb0a0071380 2023-07-12T02:02:19.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.256+0000 7fb87a7fc700 1 --2- 172.21.15.60:0/3464395041 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fb86806ad30 0x7fb86806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.256+0000 7fb87b7fe700 1 --2- 172.21.15.60:0/3464395041 >> [v2:172.21.15.60:6816/1678864191,v1:172.21.15.60:6817/1678864191] conn(0x7fb868073560 0x7fb868075970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.257+0000 7fb87b7fe700 1 --2- 172.21.15.60:0/3464395041 >> [v2:172.21.15.60:6816/1678864191,v1:172.21.15.60:6817/1678864191] conn(0x7fb868073560 0x7fb868075970 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.257+0000 7fb87a7fc700 1 --2- 172.21.15.60:0/3464395041 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fb86806ad30 0x7fb86806d1e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb87c0b8f50 tx=0x7fb86c0091c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.257+0000 7f06fe764700 1 -- 172.21.15.60:0/2752233875 wait complete. 2023-07-12T02:02:19.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.257+0000 7f22be03c700 1 -- 172.21.15.60:0/2769704636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22a0004850 msgr2=0x7f22a0004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.257+0000 7f22be03c700 1 --2- 172.21.15.60:0/2769704636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22a0004850 0x7f22a0004cc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f22a8009920 tx=0x7f22a0005880 comp rx=0 tx=0).stop 2023-07-12T02:02:19.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.257+0000 7f22b7fff700 1 -- 172.21.15.60:0/2769704636 reap_dead start 2023-07-12T02:02:19.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.257+0000 7fb09effd700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0a0071380 0x7fb0a0129430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.257+0000 7fb09f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0a006b120 0x7fb0a00b56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.257+0000 7fb09effd700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0a0071380 0x7fb0a0129430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.60:44558/0 (socket says 172.21.15.60:44558) 2023-07-12T02:02:19.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.257+0000 7fb09effd700 1 -- 172.21.15.60:0/2068151607 learned_addr learned my addr 172.21.15.60:0/2068151607 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:19.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.257+0000 7fb09ffff700 1 --2- 172.21.15.60:0/2068151607 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0a014f320 0x7fb0a0147f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.257+0000 7f22be03c700 1 -- 172.21.15.60:0/2769704636 shutdown_connections 2023-07-12T02:02:19.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.257+0000 7f22be03c700 1 -- 172.21.15.60:0/2769704636 >> 172.21.15.60:0/2769704636 conn(0x7f22b80c1580 msgr2=0x7f22b80bd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:19.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.257+0000 7fb5755a6700 1 -- 172.21.15.60:0/1319849194 shutdown_connections 2023-07-12T02:02:19.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.257+0000 7fb5755a6700 1 -- 172.21.15.60:0/1319849194 wait complete. 2023-07-12T02:02:19.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.257+0000 7fb09f7fe700 1 -- 172.21.15.60:0/2068151607 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0a0071380 msgr2=0x7fb0a0129430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.257+0000 7fb09f7fe700 1 --2- 172.21.15.60:0/2068151607 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0a0071380 0x7fb0a0129430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.257+0000 7fb09f7fe700 1 -- 172.21.15.60:0/2068151607 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0a014f320 msgr2=0x7fb0a0147f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.257+0000 7fb09f7fe700 1 --2- 172.21.15.60:0/2068151607 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0a014f320 0x7fb0a0147f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.257+0000 7fb09f7fe700 1 -- 172.21.15.60:0/2068151607 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb098009a70 con 0x7fb0a006b120 2023-07-12T02:02:19.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.258+0000 7f378d7fa700 1 -- 172.21.15.60:0/3182453487 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f378001b3b0 con 0x7f3790147dc0 2023-07-12T02:02:19.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.258+0000 7fb09f7fe700 1 --2- 172.21.15.60:0/2068151607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0a006b120 0x7fb0a00b56e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0071f10 tx=0x7fb098004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.258+0000 7fb087fff700 1 -- 172.21.15.60:0/2068151607 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0980048b0 con 0x7fb0a006b120 2023-07-12T02:02:19.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.258+0000 7fb087fff700 1 -- 172.21.15.60:0/2068151607 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb098020070 con 0x7fb0a006b120 2023-07-12T02:02:19.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.258+0000 7fb087fff700 1 -- 172.21.15.60:0/2068151607 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0980276a0 con 0x7fb0a006b120 2023-07-12T02:02:19.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.258+0000 7f06fe764700 1 Processor -- start 2023-07-12T02:02:19.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.259+0000 7fb5755a6700 1 Processor -- start 2023-07-12T02:02:19.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.259+0000 7fb5755a6700 1 -- start start 2023-07-12T02:02:19.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.259+0000 7fb5755a6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb570070d80 0x7fb5700b3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.259+0000 7fb5755a6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb570071910 0x7fb5700bdb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.259+0000 7fb5755a6700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb57014c880 0x7fb5700b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.259+0000 7fb5755a6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5700b4af0 con 0x7fb570070d80 2023-07-12T02:02:19.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.259+0000 7fb5755a6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5700b1e10 con 0x7fb570071910 2023-07-12T02:02:19.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.259+0000 7fb5755a6700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5700be0d0 con 0x7fb57014c880 2023-07-12T02:02:19.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.259+0000 7fb56effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb570070d80 0x7fb5700b3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.260+0000 7fb56effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb570070d80 0x7fb5700b3f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50444/0 (socket says 172.21.15.60:50444) 2023-07-12T02:02:19.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.260+0000 7fb56effd700 1 -- 172.21.15.60:0/3705739865 learned_addr learned my addr 172.21.15.60:0/3705739865 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:19.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.258+0000 7f378d7fa700 1 --2- 172.21.15.60:0/3182453487 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f377006ad30 0x7f377006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.258+0000 7f378d7fa700 1 -- 172.21.15.60:0/3182453487 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3780088fc0 con 0x7f3790147dc0 2023-07-12T02:02:19.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.259+0000 7f378d7fa700 1 --2- 172.21.15.60:0/3182453487 >> [v2:172.21.15.60:6824/3295100060,v1:172.21.15.60:6825/3295100060] conn(0x7f3770073560 0x7f3770075970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.259+0000 7f378d7fa700 1 -- 172.21.15.60:0/3182453487 --> [v2:172.21.15.60:6824/3295100060,v1:172.21.15.60:6825/3295100060] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3770076020 con 0x7f3770073560 2023-07-12T02:02:19.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.260+0000 7f378d7fa700 1 -- 172.21.15.60:0/3182453487 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f37800541e0 con 0x7f3790147dc0 2023-07-12T02:02:19.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.259+0000 7f06fe764700 1 -- start start 2023-07-12T02:02:19.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.260+0000 7f06fe764700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06f80b6370 0x7f06f80bb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.260+0000 7f06fe764700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f06f80b9270 0x7f06f8159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.260+0000 7f06fe764700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06f81573e0 0x7f06f8158850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.260+0000 7f06fe764700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f80bb920 con 0x7f06f80b6370 2023-07-12T02:02:19.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.260+0000 7f06fe764700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f807c880 con 0x7f06f81573e0 2023-07-12T02:02:19.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.260+0000 7f06fe764700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06f80b2550 con 0x7f06f80b9270 2023-07-12T02:02:19.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.260+0000 7fb863fff700 1 -- 172.21.15.60:0/3464395041 <== osd.1 v2:172.21.15.60:6816/1678864191 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb868076020 con 0x7fb868073560 2023-07-12T02:02:19.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.260+0000 7f06f77fe700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f06f80b9270 0x7f06f8159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.260+0000 7f06fcd01700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06f81573e0 0x7f06f8158850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.260+0000 7f3794d2f700 1 --2- 172.21.15.60:0/3182453487 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f377006ad30 0x7f377006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.260+0000 7fb56f7fe700 1 --2- 172.21.15.60:0/3705739865 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb57014c880 0x7fb5700b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.260+0000 7fb56e7fc700 1 --2- 172.21.15.60:0/3705739865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb570071910 0x7fb5700bdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.260+0000 7f06f77fe700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f06f80b9270 0x7f06f8159ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.60:44584/0 (socket says 172.21.15.60:44584) 2023-07-12T02:02:19.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.260+0000 7f06f77fe700 1 -- 172.21.15.60:0/3700669140 learned_addr learned my addr 172.21.15.60:0/3700669140 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:19.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.260+0000 7f06f7fff700 1 --2- 172.21.15.60:0/3700669140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06f80b6370 0x7f06f80bb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.260+0000 7f22be03c700 1 -- 172.21.15.60:0/2769704636 shutdown_connections 2023-07-12T02:02:19.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.260+0000 7f06fcd01700 1 -- 172.21.15.60:0/3700669140 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f06f80b9270 msgr2=0x7f06f8159ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.260+0000 7f06fcd01700 1 --2- 172.21.15.60:0/3700669140 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f06f80b9270 0x7f06f8159ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.260+0000 7f06fcd01700 1 -- 172.21.15.60:0/3700669140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06f80b6370 msgr2=0x7f06f80bb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.260+0000 7f06fcd01700 1 --2- 172.21.15.60:0/3700669140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06f80b6370 0x7f06f80bb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.260+0000 7f06fcd01700 1 -- 172.21.15.60:0/3700669140 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ec009550 con 0x7f06f81573e0 2023-07-12T02:02:19.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.260+0000 7fb0a5d19700 1 -- 172.21.15.60:0/2068151607 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0a0139540 con 0x7fb0a006b120 2023-07-12T02:02:19.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.260+0000 7fb0a5d19700 1 -- 172.21.15.60:0/2068151607 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0a00b4640 con 0x7fb0a006b120 2023-07-12T02:02:19.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.261+0000 7f06fcd01700 1 --2- 172.21.15.60:0/3700669140 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06f81573e0 0x7f06f8158850 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f06ec016000 tx=0x7f06ec004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.261+0000 7f06f4ff9700 1 -- 172.21.15.60:0/3700669140 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec004500 con 0x7f06f81573e0 2023-07-12T02:02:19.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.261+0000 7f06f4ff9700 1 -- 172.21.15.60:0/3700669140 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ec0036a0 con 0x7f06f81573e0 2023-07-12T02:02:19.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.261+0000 7f06f4ff9700 1 -- 172.21.15.60:0/3700669140 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec003a30 con 0x7f06f81573e0 2023-07-12T02:02:19.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.261+0000 7f06fe764700 1 -- 172.21.15.60:0/3700669140 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06f80bc2c0 con 0x7f06f81573e0 2023-07-12T02:02:19.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.261+0000 7f06fe764700 1 -- 172.21.15.60:0/3700669140 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06f807ca90 con 0x7f06f81573e0 2023-07-12T02:02:19.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.262+0000 7f378ffff700 1 --2- 172.21.15.60:0/3182453487 >> [v2:172.21.15.60:6824/3295100060,v1:172.21.15.60:6825/3295100060] conn(0x7f3770073560 0x7f3770075970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.262+0000 7f378ffff700 1 --2- 172.21.15.60:0/3182453487 >> [v2:172.21.15.60:6824/3295100060,v1:172.21.15.60:6825/3295100060] conn(0x7f3770073560 0x7f3770075970 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.262+0000 7fb0a5d19700 1 -- 172.21.15.60:0/2068151607 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb080000fc0 con 0x7fb0a006b120 2023-07-12T02:02:19.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.263+0000 7f3794d2f700 1 --2- 172.21.15.60:0/3182453487 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f377006ad30 0x7f377006d1e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3788006fd0 tx=0x7f3788008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.263+0000 7fb087fff700 1 -- 172.21.15.60:0/2068151607 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb098012430 con 0x7fb0a006b120 2023-07-12T02:02:19.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.263+0000 7fb087fff700 1 --2- 172.21.15.60:0/2068151607 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fb08c06ade0 0x7fb08c06d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.263+0000 7fb087fff700 1 -- 172.21.15.60:0/2068151607 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb098022070 con 0x7fb0a006b120 2023-07-12T02:02:19.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.263+0000 7fb087fff700 1 --2- 172.21.15.60:0/2068151607 >> [v2:172.21.15.79:6808/4127109138,v1:172.21.15.79:6809/4127109138] conn(0x7fb08c073610 0x7fb08c075a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.263+0000 7fb087fff700 1 -- 172.21.15.60:0/2068151607 --> [v2:172.21.15.79:6808/4127109138,v1:172.21.15.79:6809/4127109138] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb08c0760d0 con 0x7fb08c073610 2023-07-12T02:02:19.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.260+0000 7f22be03c700 1 -- 172.21.15.60:0/2769704636 wait complete. 2023-07-12T02:02:19.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.262+0000 7f22be03c700 1 Processor -- start 2023-07-12T02:02:19.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.263+0000 7f22be03c700 1 -- start start 2023-07-12T02:02:19.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.263+0000 7fb087fff700 1 -- 172.21.15.60:0/2068151607 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb0980098f0 con 0x7fb0a006b120 2023-07-12T02:02:19.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.263+0000 7fb09effd700 1 --2- 172.21.15.60:0/2068151607 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fb08c06ade0 0x7fb08c06d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.264+0000 7f378d7fa700 1 -- 172.21.15.60:0/3182453487 <== osd.3 v2:172.21.15.60:6824/3295100060 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f3770076020 con 0x7f3770073560 2023-07-12T02:02:19.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.263+0000 7fb56f7fe700 1 -- 172.21.15.60:0/3705739865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb570071910 msgr2=0x7fb5700bdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.263+0000 7fb56f7fe700 1 --2- 172.21.15.60:0/3705739865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb570071910 0x7fb5700bdb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.263+0000 7fb56f7fe700 1 -- 172.21.15.60:0/3705739865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb570070d80 msgr2=0x7fb5700b3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.263+0000 7fb56f7fe700 1 --2- 172.21.15.60:0/3705739865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb570070d80 0x7fb5700b3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.263+0000 7fb56f7fe700 1 -- 172.21.15.60:0/3705739865 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb568009b30 con 0x7fb57014c880 2023-07-12T02:02:19.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.264+0000 7fb09ffff700 1 --2- 172.21.15.60:0/2068151607 >> [v2:172.21.15.79:6808/4127109138,v1:172.21.15.79:6809/4127109138] conn(0x7fb08c073610 0x7fb08c075a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.264+0000 7f22be03c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22a0004850 0x7f22b806d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.264+0000 7f22be03c700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f22b8071750 0x7f22b814d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.264+0000 7f22be03c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22b814d7a0 0x7f22b81ecaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.265+0000 7fb09effd700 1 --2- 172.21.15.60:0/2068151607 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fb08c06ade0 0x7fb08c06d290 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb0a00b9330 tx=0x7fb090008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.264+0000 7f22be03c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b81e7140 con 0x7f22b814d7a0 2023-07-12T02:02:19.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.264+0000 7f22be03c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b81f0b90 con 0x7f22a0004850 2023-07-12T02:02:19.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.264+0000 7f22be03c700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b806de40 con 0x7f22b8071750 2023-07-12T02:02:19.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.265+0000 7fb09ffff700 1 --2- 172.21.15.60:0/2068151607 >> [v2:172.21.15.79:6808/4127109138,v1:172.21.15.79:6809/4127109138] conn(0x7fb08c073610 0x7fb08c075a20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.265+0000 7f22b7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22b814d7a0 0x7f22b81ecaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.265+0000 7f22b7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22b814d7a0 0x7f22b81ecaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50464/0 (socket says 172.21.15.60:50464) 2023-07-12T02:02:19.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.265+0000 7f22b7fff700 1 -- 172.21.15.60:0/625739625 learned_addr learned my addr 172.21.15.60:0/625739625 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:19.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.265+0000 7fb56f7fe700 1 --2- 172.21.15.60:0/3705739865 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb57014c880 0x7fb5700b32c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb568014000 tx=0x7fb568004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.265+0000 7f22b77fe700 1 --2- 172.21.15.60:0/625739625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22a0004850 0x7f22b806d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.265+0000 7f22b7fff700 1 -- 172.21.15.60:0/625739625 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f22b8071750 msgr2=0x7f22b814d260 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-12T02:02:19.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.265+0000 7f22b7fff700 1 --2- 172.21.15.60:0/625739625 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f22b8071750 0x7f22b814d260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.265+0000 7f22b7fff700 1 -- 172.21.15.60:0/625739625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22a0004850 msgr2=0x7f22b806d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.265+0000 7f22b7fff700 1 --2- 172.21.15.60:0/625739625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22a0004850 0x7f22b806d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.265+0000 7f22b7fff700 1 -- 172.21.15.60:0/625739625 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b81f0260 con 0x7f22b814d7a0 2023-07-12T02:02:19.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.265+0000 7fb5577fe700 1 -- 172.21.15.60:0/3705739865 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb568004440 con 0x7fb57014c880 2023-07-12T02:02:19.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.264+0000 7f06fe764700 1 -- 172.21.15.60:0/3700669140 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f06f80b5f50 con 0x7f06f81573e0 2023-07-12T02:02:19.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.266+0000 7fb5577fe700 1 -- 172.21.15.60:0/3705739865 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5680045c0 con 0x7fb57014c880 2023-07-12T02:02:19.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.266+0000 7fb5577fe700 1 -- 172.21.15.60:0/3705739865 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb568004970 con 0x7fb57014c880 2023-07-12T02:02:19.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.266+0000 7fb5755a6700 1 -- 172.21.15.60:0/3705739865 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5700b3b50 con 0x7fb57014c880 2023-07-12T02:02:19.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.266+0000 7fb5755a6700 1 -- 172.21.15.60:0/3705739865 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5700b5920 con 0x7fb57014c880 2023-07-12T02:02:19.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.266+0000 7fb5755a6700 1 -- 172.21.15.60:0/3705739865 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb550000fc0 con 0x7fb57014c880 2023-07-12T02:02:19.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.267+0000 7f22b7fff700 1 --2- 172.21.15.60:0/625739625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22b814d7a0 0x7f22b81ecaf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f22b814fb10 tx=0x7f22b000a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.267+0000 7fb087fff700 1 -- 172.21.15.60:0/2068151607 <== osd.4 v2:172.21.15.79:6808/4127109138 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb08c0760d0 con 0x7fb08c073610 2023-07-12T02:02:19.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.267+0000 7f229ffff700 1 -- 172.21.15.60:0/625739625 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b00133f0 con 0x7f22b814d7a0 2023-07-12T02:02:19.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.267+0000 7f229ffff700 1 -- 172.21.15.60:0/625739625 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b0013550 con 0x7f22b814d7a0 2023-07-12T02:02:19.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.267+0000 7f229ffff700 1 -- 172.21.15.60:0/625739625 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b0013900 con 0x7f22b814d7a0 2023-07-12T02:02:19.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.267+0000 7f22be03c700 1 -- 172.21.15.60:0/625739625 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22b81f0540 con 0x7f22b814d7a0 2023-07-12T02:02:19.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.267+0000 7f22be03c700 1 -- 172.21.15.60:0/625739625 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b814c4e0 con 0x7f22b814d7a0 2023-07-12T02:02:19.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.267+0000 7fb5577fe700 1 -- 172.21.15.60:0/3705739865 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb568012430 con 0x7fb57014c880 2023-07-12T02:02:19.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.268+0000 7fb5577fe700 1 --2- 172.21.15.60:0/3705739865 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fb55c06ad10 0x7fb55c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.268+0000 7fb5577fe700 1 -- 172.21.15.60:0/3705739865 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb56808b430 con 0x7fb57014c880 2023-07-12T02:02:19.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.268+0000 7fb5577fe700 1 --2- 172.21.15.60:0/3705739865 >> [v2:172.21.15.60:6800/2818935979,v1:172.21.15.60:6801/2818935979] conn(0x7fb55c0735c0 0x7fb55c0759d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.268+0000 7fb5577fe700 1 -- 172.21.15.60:0/3705739865 --> [v2:172.21.15.60:6800/2818935979,v1:172.21.15.60:6801/2818935979] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb55c076080 con 0x7fb55c0735c0 2023-07-12T02:02:19.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.268+0000 7fb5577fe700 1 -- 172.21.15.60:0/3705739865 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb56808b7e0 con 0x7fb57014c880 2023-07-12T02:02:19.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.269+0000 7f22be03c700 1 -- 172.21.15.60:0/625739625 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f22b806bc10 con 0x7f22b814d7a0 2023-07-12T02:02:19.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.270+0000 7f229ffff700 1 -- 172.21.15.60:0/625739625 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f22b0013a60 con 0x7f22b814d7a0 2023-07-12T02:02:19.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.271+0000 7fb56effd700 1 --2- 172.21.15.60:0/3705739865 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fb55c06ad10 0x7fb55c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.270+0000 7f229ffff700 1 --2- 172.21.15.60:0/625739625 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f22a406ace0 0x7f22a406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.270+0000 7f229ffff700 1 -- 172.21.15.60:0/625739625 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f22b008a220 con 0x7f22b814d7a0 2023-07-12T02:02:19.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.271+0000 7f229ffff700 1 --2- 172.21.15.60:0/625739625 >> [v2:172.21.15.79:6800/421449406,v1:172.21.15.79:6801/421449406] conn(0x7f22a4073510 0x7f22a4075920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.271+0000 7f229ffff700 1 -- 172.21.15.60:0/625739625 --> [v2:172.21.15.79:6800/421449406,v1:172.21.15.79:6801/421449406] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f22a4075fd0 con 0x7f22a4073510 2023-07-12T02:02:19.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.271+0000 7f229ffff700 1 -- 172.21.15.60:0/625739625 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22b008a670 con 0x7f22b814d7a0 2023-07-12T02:02:19.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.268+0000 7f06f4ff9700 1 -- 172.21.15.60:0/3700669140 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f06ec003b90 con 0x7f06f81573e0 2023-07-12T02:02:19.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.269+0000 7f06f4ff9700 1 --2- 172.21.15.60:0/3700669140 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f06e406adb0 0x7f06e406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.269+0000 7f06f4ff9700 1 -- 172.21.15.60:0/3700669140 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f06ec08aa20 con 0x7f06f81573e0 2023-07-12T02:02:19.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.269+0000 7f06f4ff9700 1 --2- 172.21.15.60:0/3700669140 >> [v2:172.21.15.79:6824/4144355139,v1:172.21.15.79:6825/4144355139] conn(0x7f06e4073660 0x7f06e4075a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.269+0000 7f06f4ff9700 1 -- 172.21.15.60:0/3700669140 --> [v2:172.21.15.79:6824/4144355139,v1:172.21.15.79:6825/4144355139] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f06e4076120 con 0x7f06e4073660 2023-07-12T02:02:19.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.269+0000 7f06f4ff9700 1 -- 172.21.15.60:0/3700669140 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06ec08f2a0 con 0x7f06f81573e0 2023-07-12T02:02:19.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.270+0000 7f06f77fe700 1 --2- 172.21.15.60:0/3700669140 >> [v2:172.21.15.79:6824/4144355139,v1:172.21.15.79:6825/4144355139] conn(0x7f06e4073660 0x7f06e4075a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.270+0000 7f06f7fff700 1 --2- 172.21.15.60:0/3700669140 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f06e406adb0 0x7f06e406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.271+0000 7f06f7fff700 1 --2- 172.21.15.60:0/3700669140 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f06e406adb0 0x7f06e406d260 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f06e8007fd0 tx=0x7f06e8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.271+0000 7f06f77fe700 1 --2- 172.21.15.60:0/3700669140 >> [v2:172.21.15.79:6824/4144355139,v1:172.21.15.79:6825/4144355139] conn(0x7f06e4073660 0x7f06e4075a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.272+0000 7f06f4ff9700 1 -- 172.21.15.60:0/3700669140 <== osd.6 v2:172.21.15.79:6824/4144355139 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f06e4076120 con 0x7f06e4073660 2023-07-12T02:02:19.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.272+0000 7fb56e7fc700 1 --2- 172.21.15.60:0/3705739865 >> [v2:172.21.15.60:6800/2818935979,v1:172.21.15.60:6801/2818935979] conn(0x7fb55c0735c0 0x7fb55c0759d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.272+0000 7fb56e7fc700 1 --2- 172.21.15.60:0/3705739865 >> [v2:172.21.15.60:6800/2818935979,v1:172.21.15.60:6801/2818935979] conn(0x7fb55c0735c0 0x7fb55c0759d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.273+0000 7fb5577fe700 1 -- 172.21.15.60:0/3705739865 <== osd.0 v2:172.21.15.60:6800/2818935979 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb55c076080 con 0x7fb55c0735c0 2023-07-12T02:02:19.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.274+0000 7f22b6ffd700 1 --2- 172.21.15.60:0/625739625 >> [v2:172.21.15.79:6800/421449406,v1:172.21.15.79:6801/421449406] conn(0x7f22a4073510 0x7f22a4075920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.274+0000 7f22b77fe700 1 --2- 172.21.15.60:0/625739625 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f22a406ace0 0x7f22a406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.274+0000 7fb56effd700 1 --2- 172.21.15.60:0/3705739865 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fb55c06ad10 0x7fb55c06d1c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb560009ad0 tx=0x7fb560009290 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.278+0000 7f9b559e9700 1 Processor -- start 2023-07-12T02:02:19.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.274+0000 7f22b77fe700 1 --2- 172.21.15.60:0/625739625 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f22a406ace0 0x7f22a406d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f22b806bef0 tx=0x7f22ac0090e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.287+0000 7f3796f93700 1 -- 172.21.15.60:0/3182453487 --> [v2:172.21.15.60:6824/3295100060,v1:172.21.15.60:6825/3295100060] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3774002d40 con 0x7f3770073560 2023-07-12T02:02:19.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.278+0000 7f9b559e9700 1 -- start start 2023-07-12T02:02:19.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.279+0000 7f9b559e9700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9b50071ab0 0x7f9b5006edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.279+0000 7f9b559e9700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b500b93e0 con 0x7f9b5006f340 2023-07-12T02:02:19.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.279+0000 7f9b559e9700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b50141200 con 0x7f9b5006b120 2023-07-12T02:02:19.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.279+0000 7f9b559e9700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b50071690 con 0x7f9b50071ab0 2023-07-12T02:02:19.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.279+0000 7f9b4e7fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9b50071ab0 0x7f9b5006edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.279+0000 7f9b4e7fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9b50071ab0 0x7f9b5006edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50466/0 (socket says 172.21.15.60:50466) 2023-07-12T02:02:19.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.279+0000 7f9b4e7fc700 1 -- 172.21.15.60:0/3505261420 learned_addr learned my addr 172.21.15.60:0/3505261420 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:19.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.280+0000 7f9b4e7fc700 1 -- 172.21.15.60:0/3505261420 >> v1:172.21.15.79:6789/0 conn(0x7f9b5006b120 legacy=0x7f9b50140af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:19.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.280+0000 7f9b4e7fc700 1 -- 172.21.15.60:0/3505261420 >> v1:172.21.15.60:6789/0 conn(0x7f9b5006f340 legacy=0x7f9b50151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.280+0000 7f9b4e7fc700 1 -- 172.21.15.60:0/3505261420 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b5006f8d0 con 0x7f9b50071ab0 2023-07-12T02:02:19.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.280+0000 7f9b4e7fc700 1 --2- 172.21.15.60:0/3505261420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b50071ab0 0x7f9b5006edc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9b4400bb90 tx=0x7f9b4400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=153bb92533020cc6 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.280+0000 7f9b4dffb700 1 -- 172.21.15.60:0/3505261420 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4400dc00 con 0x7f9b50071ab0 2023-07-12T02:02:19.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.280+0000 7f9b4dffb700 1 -- 172.21.15.60:0/3505261420 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4400dd60 con 0x7f9b50071ab0 2023-07-12T02:02:19.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.280+0000 7f9b4dffb700 1 -- 172.21.15.60:0/3505261420 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b44004250 con 0x7f9b50071ab0 2023-07-12T02:02:19.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.281+0000 7f9b559e9700 1 -- 172.21.15.60:0/3505261420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b50071ab0 msgr2=0x7f9b5006edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.281+0000 7f9b559e9700 1 --2- 172.21.15.60:0/3505261420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b50071ab0 0x7f9b5006edc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9b4400bb90 tx=0x7f9b4400bea0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.281+0000 7f9b559e9700 1 -- 172.21.15.60:0/3505261420 shutdown_connections 2023-07-12T02:02:19.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.281+0000 7f9b559e9700 1 --2- 172.21.15.60:0/3505261420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b50071ab0 0x7f9b5006edc0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.281+0000 7f9b559e9700 1 -- 172.21.15.60:0/3505261420 >> 172.21.15.60:0/3505261420 conn(0x7f9b500bd980 msgr2=0x7f9b500b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:19.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.282+0000 7f9b559e9700 1 -- 172.21.15.60:0/3505261420 shutdown_connections 2023-07-12T02:02:19.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.282+0000 7f9b559e9700 1 -- 172.21.15.60:0/3505261420 wait complete. 2023-07-12T02:02:19.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.283+0000 7f9b559e9700 1 Processor -- start 2023-07-12T02:02:19.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.284+0000 7f9b559e9700 1 -- start start 2023-07-12T02:02:19.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.285+0000 7f9b559e9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b5006f340 0x7f9b501de580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.285+0000 7f9b559e9700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9b50071ab0 0x7f9b501ecee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.285+0000 7f9b559e9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b501ed420 0x7f9b501f0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.285+0000 7f9b559e9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b501deac0 con 0x7f9b5006f340 2023-07-12T02:02:19.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.285+0000 7f9b559e9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b500b7e20 con 0x7f9b501ed420 2023-07-12T02:02:19.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.285+0000 7f9b559e9700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b501ed8a0 con 0x7f9b50071ab0 2023-07-12T02:02:19.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.285+0000 7f9b4e7fc700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9b50071ab0 0x7f9b501ecee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.285+0000 7f9b4e7fc700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9b50071ab0 0x7f9b501ecee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.60:44592/0 (socket says 172.21.15.60:44592) 2023-07-12T02:02:19.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.285+0000 7f9b4e7fc700 1 -- 172.21.15.60:0/21020558 learned_addr learned my addr 172.21.15.60:0/21020558 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:19.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.285+0000 7f9b4effd700 1 --2- 172.21.15.60:0/21020558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b5006f340 0x7f9b501de580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.285+0000 7f9b4e7fc700 1 -- 172.21.15.60:0/21020558 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b501ed420 msgr2=0x7f9b501f0100 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-12T02:02:19.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.285+0000 7f9b4e7fc700 1 --2- 172.21.15.60:0/21020558 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b501ed420 0x7f9b501f0100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.285+0000 7f9b4e7fc700 1 -- 172.21.15.60:0/21020558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b5006f340 msgr2=0x7f9b501de580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.285+0000 7f9b4e7fc700 1 --2- 172.21.15.60:0/21020558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b5006f340 0x7f9b501de580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.285+0000 7f9b4e7fc700 1 -- 172.21.15.60:0/21020558 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b4400b7f0 con 0x7f9b50071ab0 2023-07-12T02:02:19.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.286+0000 7f9b4e7fc700 1 --2- 172.21.15.60:0/21020558 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9b50071ab0 0x7f9b501ecee0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9b44006e80 tx=0x7f9b44004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.286+0000 7f9b37fff700 1 -- 172.21.15.60:0/21020558 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b44009050 con 0x7f9b50071ab0 2023-07-12T02:02:19.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.286+0000 7f9b37fff700 1 -- 172.21.15.60:0/21020558 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4400a040 con 0x7f9b50071ab0 2023-07-12T02:02:19.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.286+0000 7f9b37fff700 1 -- 172.21.15.60:0/21020558 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b44021410 con 0x7f9b50071ab0 2023-07-12T02:02:19.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.286+0000 7f9b559e9700 1 -- 172.21.15.60:0/21020558 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b501e0030 con 0x7f9b50071ab0 2023-07-12T02:02:19.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.286+0000 7f9b559e9700 1 -- 172.21.15.60:0/21020558 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b50141830 con 0x7f9b50071ab0 2023-07-12T02:02:19.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.288+0000 7f22b6ffd700 1 --2- 172.21.15.60:0/625739625 >> [v2:172.21.15.79:6800/421449406,v1:172.21.15.79:6801/421449406] conn(0x7f22a4073510 0x7f22a4075920 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.288+0000 7f9b37fff700 1 -- 172.21.15.60:0/21020558 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9b44015070 con 0x7f9b50071ab0 2023-07-12T02:02:19.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.288+0000 7f378d7fa700 1 -- 172.21.15.60:0/3182453487 <== osd.3 v2:172.21.15.60:6824/3295100060 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3774002d40 con 0x7f3770073560 2023-07-12T02:02:19.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.288+0000 7f9b559e9700 1 -- 172.21.15.60:0/21020558 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9b50070e60 con 0x7f9b50071ab0 2023-07-12T02:02:19.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.288+0000 7f9b37fff700 1 --2- 172.21.15.60:0/21020558 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f9b3c06ace0 0x7f9b3c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.288+0000 7f229ffff700 1 -- 172.21.15.60:0/625739625 <== osd.5 v2:172.21.15.79:6800/421449406 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f22a4075fd0 con 0x7f22a4073510 2023-07-12T02:02:19.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.289+0000 7f3796f93700 1 -- 172.21.15.60:0/3182453487 >> [v2:172.21.15.60:6824/3295100060,v1:172.21.15.60:6825/3295100060] conn(0x7f3770073560 msgr2=0x7f3770075970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.289+0000 7f3796f93700 1 --2- 172.21.15.60:0/3182453487 >> [v2:172.21.15.60:6824/3295100060,v1:172.21.15.60:6825/3295100060] conn(0x7f3770073560 0x7f3770075970 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.289+0000 7f9b37fff700 1 -- 172.21.15.60:0/21020558 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9b4408a990 con 0x7f9b50071ab0 2023-07-12T02:02:19.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.289+0000 7f9b4effd700 1 --2- 172.21.15.60:0/21020558 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f9b3c06ace0 0x7f9b3c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.289+0000 7f3796f93700 1 -- 172.21.15.60:0/3182453487 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f377006ad30 msgr2=0x7f377006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.289+0000 7f3796f93700 1 --2- 172.21.15.60:0/3182453487 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f377006ad30 0x7f377006d1e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3788006fd0 tx=0x7f3788008040 comp rx=0 tx=0).stop 2023-07-12T02:02:19.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.289+0000 7f3796f93700 1 -- 172.21.15.60:0/3182453487 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3790147dc0 msgr2=0x7f37900bbf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.289+0000 7f3796f93700 1 --2- 172.21.15.60:0/3182453487 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3790147dc0 0x7f37900bbf10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f378000cad0 tx=0x7f378000cde0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.289+0000 7f9b37fff700 1 --2- 172.21.15.60:0/21020558 >> [v2:172.21.15.79:6816/2845223299,v1:172.21.15.79:6817/2845223299] conn(0x7f9b3c073490 0x7f9b3c0758a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.289+0000 7f9b37fff700 1 -- 172.21.15.60:0/21020558 --> [v2:172.21.15.79:6816/2845223299,v1:172.21.15.79:6817/2845223299] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9b3c075f50 con 0x7f9b3c073490 2023-07-12T02:02:19.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.289+0000 7f9b37fff700 1 -- 172.21.15.60:0/21020558 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b440557d0 con 0x7f9b50071ab0 2023-07-12T02:02:19.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.289+0000 7f9b4f7fe700 1 --2- 172.21.15.60:0/21020558 >> [v2:172.21.15.79:6816/2845223299,v1:172.21.15.79:6817/2845223299] conn(0x7f9b3c073490 0x7f9b3c0758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.289+0000 7f9b4effd700 1 --2- 172.21.15.60:0/21020558 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f9b3c06ace0 0x7f9b3c06d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9b40007fd0 tx=0x7f9b40007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.289+0000 7f9b4f7fe700 1 --2- 172.21.15.60:0/21020558 >> [v2:172.21.15.79:6816/2845223299,v1:172.21.15.79:6817/2845223299] conn(0x7f9b3c073490 0x7f9b3c0758a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.290+0000 7f3795530700 1 -- 172.21.15.60:0/3182453487 reap_dead start 2023-07-12T02:02:19.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.290+0000 7f3796f93700 1 -- 172.21.15.60:0/3182453487 shutdown_connections 2023-07-12T02:02:19.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.290+0000 7f3796f93700 1 -- 172.21.15.60:0/3182453487 >> 172.21.15.60:0/3182453487 conn(0x7f379006d0e0 msgr2=0x7f37900b83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:19.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.290+0000 7f9b37fff700 1 -- 172.21.15.60:0/21020558 <== osd.7 v2:172.21.15.79:6816/2845223299 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f9b3c075f50 con 0x7f9b3c073490 2023-07-12T02:02:19.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.290+0000 7fb0a5d19700 1 -- 172.21.15.60:0/2068151607 --> [v2:172.21.15.79:6808/4127109138,v1:172.21.15.79:6809/4127109138] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb080002d40 con 0x7fb08c073610 2023-07-12T02:02:19.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.294+0000 7fb087fff700 1 -- 172.21.15.60:0/2068151607 <== osd.4 v2:172.21.15.79:6808/4127109138 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb080002d40 con 0x7fb08c073610 2023-07-12T02:02:19.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.294+0000 7f0b8218c700 1 Processor -- start 2023-07-12T02:02:19.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.294+0000 7f3796f93700 1 -- 172.21.15.60:0/3182453487 shutdown_connections 2023-07-12T02:02:19.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.294+0000 7f3796f93700 1 -- 172.21.15.60:0/3182453487 wait complete. 2023-07-12T02:02:19.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.295+0000 7fb881a04700 1 -- 172.21.15.60:0/3464395041 --> [v2:172.21.15.60:6816/1678864191,v1:172.21.15.60:6817/1678864191] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb85c002d40 con 0x7fb868073560 2023-07-12T02:02:19.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.294+0000 7f0b8218c700 1 -- start start 2023-07-12T02:02:19.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.295+0000 7f0b8218c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0b740c69e0 0x7f0b740cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.295+0000 7f0b8218c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0b7403ad60 0x7f0b7403c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.295+0000 7f0b8218c700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b7403a8d0 con 0x7f0b740073b0 2023-07-12T02:02:19.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.295+0000 7f0b8218c700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b7403b910 con 0x7f0b7403ad60 2023-07-12T02:02:19.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.295+0000 7f0b8218c700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b7403e920 con 0x7f0b740c69e0 2023-07-12T02:02:19.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.295+0000 7fb863fff700 1 -- 172.21.15.60:0/3464395041 <== osd.1 v2:172.21.15.60:6816/1678864191 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb85c002d40 con 0x7fb868073560 2023-07-12T02:02:19.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.295+0000 7f0b8198b700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f0b740073b0 0x7f0b7403d2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.60:57954/0 (socket says 172.21.15.60:57954) 2023-07-12T02:02:19.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.295+0000 7f0b8198b700 1 -- 172.21.15.60:0/3337604769 learned_addr learned my addr 172.21.15.60:0/3337604769 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:19.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.296+0000 7f0b80989700 1 --2- 172.21.15.60:0/3337604769 >> v2:172.21.15.60:3300/0 conn(0x7f0b7403ad60 0x7f0b7403c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.296+0000 7f0b80989700 1 -- 172.21.15.60:0/3337604769 >> v2:172.21.15.79:3300/0 conn(0x7f0b740c69e0 msgr2=0x7f0b740cfc80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-12T02:02:19.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.296+0000 7f0b80989700 1 --2- 172.21.15.60:0/3337604769 >> v2:172.21.15.79:3300/0 conn(0x7f0b740c69e0 0x7f0b740cfc80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.296+0000 7f0b80989700 1 -- 172.21.15.60:0/3337604769 >> v1:172.21.15.79:6789/0 conn(0x7f0b740073b0 legacy=0x7f0b7403d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:19.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.296+0000 7f0b80989700 1 -- 172.21.15.60:0/3337604769 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b7403eb90 con 0x7f0b7403ad60 2023-07-12T02:02:19.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.296+0000 7f0b80989700 1 --2- 172.21.15.60:0/3337604769 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b7403ad60 0x7f0b7403c6b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0b74040360 tx=0x7f0b6c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e551a1308f1826e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.297+0000 7f0b73fff700 1 -- 172.21.15.60:0/3337604769 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c004230 con 0x7f0b7403ad60 2023-07-12T02:02:19.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.297+0000 7f0b73fff700 1 -- 172.21.15.60:0/3337604769 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6c004390 con 0x7f0b7403ad60 2023-07-12T02:02:19.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.297+0000 7f0b73fff700 1 -- 172.21.15.60:0/3337604769 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c0036c0 con 0x7f0b7403ad60 2023-07-12T02:02:19.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.298+0000 7f0b8218c700 1 -- 172.21.15.60:0/3337604769 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b7403ad60 msgr2=0x7f0b7403c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.298+0000 7f0b8218c700 1 --2- 172.21.15.60:0/3337604769 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b7403ad60 0x7f0b7403c6b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0b74040360 tx=0x7f0b6c009b20 comp rx=0 tx=0).stop 2023-07-12T02:02:19.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.298+0000 7fb5755a6700 1 -- 172.21.15.60:0/3705739865 --> [v2:172.21.15.60:6800/2818935979,v1:172.21.15.60:6801/2818935979] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb550002d40 con 0x7fb55c0735c0 2023-07-12T02:02:19.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.298+0000 7fb5577fe700 1 -- 172.21.15.60:0/3705739865 <== osd.0 v2:172.21.15.60:6800/2818935979 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb550002d40 con 0x7fb55c0735c0 2023-07-12T02:02:19.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.298+0000 7fb881a04700 1 -- 172.21.15.60:0/3464395041 >> [v2:172.21.15.60:6816/1678864191,v1:172.21.15.60:6817/1678864191] conn(0x7fb868073560 msgr2=0x7fb868075970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.298+0000 7fb881a04700 1 --2- 172.21.15.60:0/3464395041 >> [v2:172.21.15.60:6816/1678864191,v1:172.21.15.60:6817/1678864191] conn(0x7fb868073560 0x7fb868075970 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.299+0000 7fb881a04700 1 -- 172.21.15.60:0/3464395041 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fb86806ad30 msgr2=0x7fb86806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.299+0000 7fb881a04700 1 --2- 172.21.15.60:0/3464395041 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fb86806ad30 0x7fb86806d1e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb87c0b8f50 tx=0x7fb86c0091c0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.299+0000 7fb881a04700 1 -- 172.21.15.60:0/3464395041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb87c0b4810 msgr2=0x7fb87c12e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.299+0000 7fb881a04700 1 --2- 172.21.15.60:0/3464395041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb87c0b4810 0x7fb87c12e500 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb870000f60 tx=0x7fb87000c7b0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.299+0000 7fb87b7fe700 1 -- 172.21.15.60:0/3464395041 reap_dead start 2023-07-12T02:02:19.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.299+0000 7fb881a04700 1 -- 172.21.15.60:0/3464395041 shutdown_connections 2023-07-12T02:02:19.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.299+0000 7fb881a04700 1 -- 172.21.15.60:0/3464395041 >> 172.21.15.60:0/3464395041 conn(0x7fb87c069f30 msgr2=0x7fb87c0b6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:19.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.299+0000 7fb5755a6700 1 -- 172.21.15.60:0/3705739865 >> [v2:172.21.15.60:6800/2818935979,v1:172.21.15.60:6801/2818935979] conn(0x7fb55c0735c0 msgr2=0x7fb55c0759d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.299+0000 7fb5755a6700 1 --2- 172.21.15.60:0/3705739865 >> [v2:172.21.15.60:6800/2818935979,v1:172.21.15.60:6801/2818935979] conn(0x7fb55c0735c0 0x7fb55c0759d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.299+0000 7fb5755a6700 1 -- 172.21.15.60:0/3705739865 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fb55c06ad10 msgr2=0x7fb55c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.299+0000 7fb5755a6700 1 --2- 172.21.15.60:0/3705739865 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fb55c06ad10 0x7fb55c06d1c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb560009ad0 tx=0x7fb560009290 comp rx=0 tx=0).stop 2023-07-12T02:02:19.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.299+0000 7fb5755a6700 1 -- 172.21.15.60:0/3705739865 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb57014c880 msgr2=0x7fb5700b32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.299+0000 7fb5755a6700 1 --2- 172.21.15.60:0/3705739865 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb57014c880 0x7fb5700b32c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb568014000 tx=0x7fb568004ad0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.299+0000 7fb56f7fe700 1 -- 172.21.15.60:0/3705739865 reap_dead start 2023-07-12T02:02:19.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.299+0000 7fb5755a6700 1 -- 172.21.15.60:0/3705739865 shutdown_connections 2023-07-12T02:02:19.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.299+0000 7fb5755a6700 1 -- 172.21.15.60:0/3705739865 >> 172.21.15.60:0/3705739865 conn(0x7fb5700be670 msgr2=0x7fb57006c900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:19.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.300+0000 7f0b8218c700 1 -- 172.21.15.60:0/3337604769 shutdown_connections 2023-07-12T02:02:19.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.300+0000 7f0b8218c700 1 --2- 172.21.15.60:0/3337604769 >> v2:172.21.15.79:3300/0 conn(0x7f0b740c69e0 0x7f0b740cfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.300+0000 7f0b8218c700 1 --2- 172.21.15.60:0/3337604769 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b7403ad60 0x7f0b7403c6b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.300+0000 7f0b8218c700 1 -- 172.21.15.60:0/3337604769 >> 172.21.15.60:0/3337604769 conn(0x7f0b740435b0 msgr2=0x7f0b7403f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:19.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.300+0000 7fb881a04700 1 -- 172.21.15.60:0/3464395041 shutdown_connections 2023-07-12T02:02:19.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.300+0000 7fb881a04700 1 -- 172.21.15.60:0/3464395041 wait complete. 2023-07-12T02:02:19.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.300+0000 7fb0a5d19700 1 -- 172.21.15.60:0/2068151607 >> [v2:172.21.15.79:6808/4127109138,v1:172.21.15.79:6809/4127109138] conn(0x7fb08c073610 msgr2=0x7fb08c075a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.300+0000 7fb0a5d19700 1 --2- 172.21.15.60:0/2068151607 >> [v2:172.21.15.79:6808/4127109138,v1:172.21.15.79:6809/4127109138] conn(0x7fb08c073610 0x7fb08c075a20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.300+0000 7fb0a5d19700 1 -- 172.21.15.60:0/2068151607 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fb08c06ade0 msgr2=0x7fb08c06d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.300+0000 7fb0a5d19700 1 --2- 172.21.15.60:0/2068151607 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fb08c06ade0 0x7fb08c06d290 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb0a00b9330 tx=0x7fb090008040 comp rx=0 tx=0).stop 2023-07-12T02:02:19.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.300+0000 7fb0a5d19700 1 -- 172.21.15.60:0/2068151607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0a006b120 msgr2=0x7fb0a00b56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.300+0000 7fb0a5d19700 1 --2- 172.21.15.60:0/2068151607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0a006b120 0x7fb0a00b56e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0071f10 tx=0x7fb098004ad0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.300+0000 7fb09ffff700 1 -- 172.21.15.60:0/2068151607 reap_dead start 2023-07-12T02:02:19.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.300+0000 7f0b8218c700 1 -- 172.21.15.60:0/3337604769 shutdown_connections 2023-07-12T02:02:19.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.300+0000 7f0b8218c700 1 -- 172.21.15.60:0/3337604769 wait complete. 2023-07-12T02:02:19.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.302+0000 7f0b8218c700 1 Processor -- start 2023-07-12T02:02:19.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.302+0000 7f0b8218c700 1 -- start start 2023-07-12T02:02:19.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.302+0000 7f06fe764700 1 -- 172.21.15.60:0/3700669140 --> [v2:172.21.15.79:6824/4144355139,v1:172.21.15.79:6825/4144355139] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f06f80b3c70 con 0x7f06e4073660 2023-07-12T02:02:19.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.303+0000 7fb0a5d19700 1 -- 172.21.15.60:0/2068151607 shutdown_connections 2023-07-12T02:02:19.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.303+0000 7fb0a5d19700 1 -- 172.21.15.60:0/2068151607 >> 172.21.15.60:0/2068151607 conn(0x7fb0a00bd980 msgr2=0x7fb0a0139e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:19.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.303+0000 7fb5755a6700 1 -- 172.21.15.60:0/3705739865 shutdown_connections 2023-07-12T02:02:19.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.303+0000 7fb5755a6700 1 -- 172.21.15.60:0/3705739865 wait complete. 2023-07-12T02:02:19.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.303+0000 7f06f4ff9700 1 -- 172.21.15.60:0/3700669140 <== osd.6 v2:172.21.15.79:6824/4144355139 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f06f0007ce0 con 0x7f06e4073660 2023-07-12T02:02:19.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.303+0000 7f0b8218c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b740073b0 0x7f0b740c9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.303+0000 7f0b8218c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b7403ad60 0x7f0b74036c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.303+0000 7f0b8218c700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0b740c69e0 0x7f0b74038110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.303+0000 7f0b8218c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b740c9980 con 0x7f0b7403ad60 2023-07-12T02:02:19.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.303+0000 7f0b8218c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b74037930 con 0x7f0b740073b0 2023-07-12T02:02:19.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.303+0000 7f0b8218c700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b740cd460 con 0x7f0b740c69e0 2023-07-12T02:02:19.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.303+0000 7f0b80989700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b7403ad60 0x7f0b74036c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.303+0000 7f0b80989700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b7403ad60 0x7f0b74036c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50492/0 (socket says 172.21.15.60:50492) 2023-07-12T02:02:19.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.303+0000 7f0b80989700 1 -- 172.21.15.60:0/3806759613 learned_addr learned my addr 172.21.15.60:0/3806759613 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:19.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.303+0000 7f0b8118a700 1 --2- 172.21.15.60:0/3806759613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b740073b0 0x7f0b740c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.303+0000 7f0b8198b700 1 --2- 172.21.15.60:0/3806759613 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0b740c69e0 0x7f0b74038110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.304+0000 7f0b80989700 1 -- 172.21.15.60:0/3806759613 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0b740c69e0 msgr2=0x7f0b74038110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.304+0000 7f0b80989700 1 --2- 172.21.15.60:0/3806759613 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0b740c69e0 0x7f0b74038110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.304+0000 7f0b80989700 1 -- 172.21.15.60:0/3806759613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b740073b0 msgr2=0x7f0b740c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.304+0000 7f0b80989700 1 --2- 172.21.15.60:0/3806759613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b740073b0 0x7f0b740c9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.304+0000 7f0b80989700 1 -- 172.21.15.60:0/3806759613 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6c0094a0 con 0x7f0b7403ad60 2023-07-12T02:02:19.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.304+0000 7f0b8198b700 1 --2- 172.21.15.60:0/3806759613 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0b740c69e0 0x7f0b74038110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:02:19.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.304+0000 7fb0a5d19700 1 -- 172.21.15.60:0/2068151607 shutdown_connections 2023-07-12T02:02:19.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.304+0000 7fb0a5d19700 1 -- 172.21.15.60:0/2068151607 wait complete. 2023-07-12T02:02:19.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.304+0000 7f0b80989700 1 --2- 172.21.15.60:0/3806759613 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b7403ad60 0x7f0b74036c00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c0090b0 tx=0x7f0b6c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.304+0000 7f0b71ffb700 1 -- 172.21.15.60:0/3806759613 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c01d070 con 0x7f0b7403ad60 2023-07-12T02:02:19.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.304+0000 7f0b71ffb700 1 -- 172.21.15.60:0/3806759613 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6c003e60 con 0x7f0b7403ad60 2023-07-12T02:02:19.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.304+0000 7f0b71ffb700 1 -- 172.21.15.60:0/3806759613 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c00c8c0 con 0x7f0b7403ad60 2023-07-12T02:02:19.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.304+0000 7f06fe764700 1 -- 172.21.15.60:0/3700669140 >> [v2:172.21.15.79:6824/4144355139,v1:172.21.15.79:6825/4144355139] conn(0x7f06e4073660 msgr2=0x7f06e4075a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.304+0000 7f06fe764700 1 --2- 172.21.15.60:0/3700669140 >> [v2:172.21.15.79:6824/4144355139,v1:172.21.15.79:6825/4144355139] conn(0x7f06e4073660 0x7f06e4075a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.305+0000 7f06fe764700 1 -- 172.21.15.60:0/3700669140 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f06e406adb0 msgr2=0x7f06e406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.305+0000 7f06fe764700 1 --2- 172.21.15.60:0/3700669140 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f06e406adb0 0x7f06e406d260 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f06e8007fd0 tx=0x7f06e8009040 comp rx=0 tx=0).stop 2023-07-12T02:02:19.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.305+0000 7f06fe764700 1 -- 172.21.15.60:0/3700669140 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06f81573e0 msgr2=0x7f06f8158850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.305+0000 7f06fe764700 1 --2- 172.21.15.60:0/3700669140 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06f81573e0 0x7f06f8158850 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f06ec016000 tx=0x7f06ec004750 comp rx=0 tx=0).stop 2023-07-12T02:02:19.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.305+0000 7f06fcd01700 1 -- 172.21.15.60:0/3700669140 reap_dead start 2023-07-12T02:02:19.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.305+0000 7f06fe764700 1 -- 172.21.15.60:0/3700669140 shutdown_connections 2023-07-12T02:02:19.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.305+0000 7f06fe764700 1 -- 172.21.15.60:0/3700669140 >> 172.21.15.60:0/3700669140 conn(0x7f06f8069f30 msgr2=0x7f06f80b6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:19.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.305+0000 7f0b8218c700 1 -- 172.21.15.60:0/3806759613 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b740cd740 con 0x7f0b7403ad60 2023-07-12T02:02:19.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.305+0000 7f06fe764700 1 -- 172.21.15.60:0/3700669140 shutdown_connections 2023-07-12T02:02:19.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.305+0000 7f0b8218c700 1 -- 172.21.15.60:0/3806759613 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b74037140 con 0x7f0b7403ad60 2023-07-12T02:02:19.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.306+0000 7f0b8218c700 1 -- 172.21.15.60:0/3806759613 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0b7403f150 con 0x7f0b7403ad60 2023-07-12T02:02:19.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.306+0000 7f06fe764700 1 -- 172.21.15.60:0/3700669140 wait complete. 2023-07-12T02:02:19.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.307+0000 7f0b71ffb700 1 -- 172.21.15.60:0/3806759613 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0b6c021070 con 0x7f0b7403ad60 2023-07-12T02:02:19.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.308+0000 7f0b71ffb700 1 --2- 172.21.15.60:0/3806759613 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f0b6006ad10 0x7f0b6006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.308+0000 7f0b71ffb700 1 -- 172.21.15.60:0/3806759613 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0b6c08a530 con 0x7f0b7403ad60 2023-07-12T02:02:19.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.308+0000 7f0b71ffb700 1 --2- 172.21.15.60:0/3806759613 >> [v2:172.21.15.60:6808/1459480680,v1:172.21.15.60:6809/1459480680] conn(0x7f0b600735c0 0x7f0b600759d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.308+0000 7f0b71ffb700 1 -- 172.21.15.60:0/3806759613 --> [v2:172.21.15.60:6808/1459480680,v1:172.21.15.60:6809/1459480680] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0b60076080 con 0x7f0b600735c0 2023-07-12T02:02:19.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.308+0000 7f0b71ffb700 1 -- 172.21.15.60:0/3806759613 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b6c08cb50 con 0x7f0b7403ad60 2023-07-12T02:02:19.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.309+0000 7f0b8118a700 1 --2- 172.21.15.60:0/3806759613 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f0b6006ad10 0x7f0b6006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.310+0000 7f0b8118a700 1 --2- 172.21.15.60:0/3806759613 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f0b6006ad10 0x7f0b6006d1c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c04f060 tx=0x7f0b7c06c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.314+0000 7f0b8198b700 1 --2- 172.21.15.60:0/3806759613 >> [v2:172.21.15.60:6808/1459480680,v1:172.21.15.60:6809/1459480680] conn(0x7f0b600735c0 0x7f0b600759d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.368 INFO:teuthology.orchestra.run.smithi060.stdout:55834574854 2023-07-12T02:02:19.369 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-12T02:02:19.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.320+0000 7f9b559e9700 1 -- 172.21.15.60:0/21020558 --> [v2:172.21.15.79:6816/2845223299,v1:172.21.15.79:6817/2845223299] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9b5006fbb0 con 0x7f9b3c073490 2023-07-12T02:02:19.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.321+0000 7f9b37fff700 1 -- 172.21.15.60:0/21020558 <== osd.7 v2:172.21.15.79:6816/2845223299 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9b48001c40 con 0x7f9b3c073490 2023-07-12T02:02:19.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.323+0000 7f0b8198b700 1 --2- 172.21.15.60:0/3806759613 >> [v2:172.21.15.60:6808/1459480680,v1:172.21.15.60:6809/1459480680] conn(0x7f0b600735c0 0x7f0b600759d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.324+0000 7f9b559e9700 1 -- 172.21.15.60:0/21020558 >> [v2:172.21.15.79:6816/2845223299,v1:172.21.15.79:6817/2845223299] conn(0x7f9b3c073490 msgr2=0x7f9b3c0758a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.324+0000 7f9b559e9700 1 --2- 172.21.15.60:0/21020558 >> [v2:172.21.15.79:6816/2845223299,v1:172.21.15.79:6817/2845223299] conn(0x7f9b3c073490 0x7f9b3c0758a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.324+0000 7f9b559e9700 1 -- 172.21.15.60:0/21020558 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f9b3c06ace0 msgr2=0x7f9b3c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.324+0000 7f9b559e9700 1 --2- 172.21.15.60:0/21020558 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f9b3c06ace0 0x7f9b3c06d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9b40007fd0 tx=0x7f9b40007ec0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.324+0000 7f9b559e9700 1 -- 172.21.15.60:0/21020558 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9b50071ab0 msgr2=0x7f9b501ecee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.324+0000 7f9b559e9700 1 --2- 172.21.15.60:0/21020558 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9b50071ab0 0x7f9b501ecee0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9b44006e80 tx=0x7f9b44004750 comp rx=0 tx=0).stop 2023-07-12T02:02:19.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.324+0000 7f9b4f7fe700 1 -- 172.21.15.60:0/21020558 reap_dead start 2023-07-12T02:02:19.372 INFO:teuthology.orchestra.run.smithi060.stdout:55834574854 2023-07-12T02:02:19.373 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-12T02:02:19.373 INFO:teuthology.orchestra.run.smithi060.stdout:55834574854 2023-07-12T02:02:19.374 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-12T02:02:19.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.325+0000 7f9b559e9700 1 -- 172.21.15.60:0/21020558 shutdown_connections 2023-07-12T02:02:19.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.325+0000 7f9b559e9700 1 -- 172.21.15.60:0/21020558 >> 172.21.15.60:0/21020558 conn(0x7f9b500bd980 msgr2=0x7f9b500b7570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:19.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.325+0000 7f22be03c700 1 -- 172.21.15.60:0/625739625 --> [v2:172.21.15.79:6800/421449406,v1:172.21.15.79:6801/421449406] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f22b80b9770 con 0x7f22a4073510 2023-07-12T02:02:19.375 INFO:teuthology.orchestra.run.smithi060.stdout:55834574854 2023-07-12T02:02:19.376 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-12T02:02:19.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.326+0000 7f9b559e9700 1 -- 172.21.15.60:0/21020558 shutdown_connections 2023-07-12T02:02:19.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.326+0000 7f9b559e9700 1 -- 172.21.15.60:0/21020558 wait complete. 2023-07-12T02:02:19.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.326+0000 7f0b71ffb700 1 -- 172.21.15.60:0/3806759613 <== osd.2 v2:172.21.15.60:6808/1459480680 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0b60076080 con 0x7f0b600735c0 2023-07-12T02:02:19.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.327+0000 7f229ffff700 1 -- 172.21.15.60:0/625739625 <== osd.5 v2:172.21.15.79:6800/421449406 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f22a8013410 con 0x7f22a4073510 2023-07-12T02:02:19.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.327+0000 7f22be03c700 1 -- 172.21.15.60:0/625739625 >> [v2:172.21.15.79:6800/421449406,v1:172.21.15.79:6801/421449406] conn(0x7f22a4073510 msgr2=0x7f22a4075920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.327+0000 7f22be03c700 1 --2- 172.21.15.60:0/625739625 >> [v2:172.21.15.79:6800/421449406,v1:172.21.15.79:6801/421449406] conn(0x7f22a4073510 0x7f22a4075920 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.327+0000 7f22be03c700 1 -- 172.21.15.60:0/625739625 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f22a406ace0 msgr2=0x7f22a406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.327+0000 7f22be03c700 1 --2- 172.21.15.60:0/625739625 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f22a406ace0 0x7f22a406d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f22b806bef0 tx=0x7f22ac0090e0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.327+0000 7f22be03c700 1 -- 172.21.15.60:0/625739625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22b814d7a0 msgr2=0x7f22b81ecaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.327+0000 7f22be03c700 1 --2- 172.21.15.60:0/625739625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22b814d7a0 0x7f22b81ecaf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f22b814fb10 tx=0x7f22b000a640 comp rx=0 tx=0).stop 2023-07-12T02:02:19.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.327+0000 7f22b7fff700 1 -- 172.21.15.60:0/625739625 reap_dead start 2023-07-12T02:02:19.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.327+0000 7f22be03c700 1 -- 172.21.15.60:0/625739625 shutdown_connections 2023-07-12T02:02:19.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.327+0000 7f22be03c700 1 -- 172.21.15.60:0/625739625 >> 172.21.15.60:0/625739625 conn(0x7f22b80c1580 msgr2=0x7f22b80b74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:19.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.328+0000 7f22be03c700 1 -- 172.21.15.60:0/625739625 shutdown_connections 2023-07-12T02:02:19.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.328+0000 7f22be03c700 1 -- 172.21.15.60:0/625739625 wait complete. 2023-07-12T02:02:19.380 INFO:teuthology.orchestra.run.smithi060.stdout:55834574855 2023-07-12T02:02:19.380 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-12T02:02:19.381 INFO:teuthology.orchestra.run.smithi060.stdout:55834574853 2023-07-12T02:02:19.381 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-12T02:02:19.382 INFO:teuthology.orchestra.run.smithi060.stdout:55834574853 2023-07-12T02:02:19.383 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-12T02:02:19.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.351+0000 7f0b8218c700 1 -- 172.21.15.60:0/3806759613 --> [v2:172.21.15.60:6808/1459480680,v1:172.21.15.60:6809/1459480680] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0b7403ee70 con 0x7f0b600735c0 2023-07-12T02:02:19.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.351+0000 7f0b71ffb700 1 -- 172.21.15.60:0/3806759613 <== osd.2 v2:172.21.15.60:6808/1459480680 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0b7800a760 con 0x7f0b600735c0 2023-07-12T02:02:19.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.352+0000 7f0b8218c700 1 -- 172.21.15.60:0/3806759613 >> [v2:172.21.15.60:6808/1459480680,v1:172.21.15.60:6809/1459480680] conn(0x7f0b600735c0 msgr2=0x7f0b600759d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.352+0000 7f0b8218c700 1 --2- 172.21.15.60:0/3806759613 >> [v2:172.21.15.60:6808/1459480680,v1:172.21.15.60:6809/1459480680] conn(0x7f0b600735c0 0x7f0b600759d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.352+0000 7f0b8218c700 1 -- 172.21.15.60:0/3806759613 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f0b6006ad10 msgr2=0x7f0b6006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.352+0000 7f0b8218c700 1 --2- 172.21.15.60:0/3806759613 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f0b6006ad10 0x7f0b6006d1c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c04f060 tx=0x7f0b7c06c040 comp rx=0 tx=0).stop 2023-07-12T02:02:19.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.352+0000 7f0b8218c700 1 -- 172.21.15.60:0/3806759613 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b7403ad60 msgr2=0x7f0b74036c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.352+0000 7f0b8218c700 1 --2- 172.21.15.60:0/3806759613 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b7403ad60 0x7f0b74036c00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c0090b0 tx=0x7f0b6c004750 comp rx=0 tx=0).stop 2023-07-12T02:02:19.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.352+0000 7f0b8198b700 1 -- 172.21.15.60:0/3806759613 reap_dead start 2023-07-12T02:02:19.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.352+0000 7f0b8218c700 1 -- 172.21.15.60:0/3806759613 shutdown_connections 2023-07-12T02:02:19.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.352+0000 7f0b8218c700 1 -- 172.21.15.60:0/3806759613 >> 172.21.15.60:0/3806759613 conn(0x7f0b740435b0 msgr2=0x7f0b7403c600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:19.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.352+0000 7f0b8218c700 1 -- 172.21.15.60:0/3806759613 shutdown_connections 2023-07-12T02:02:19.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.352+0000 7f0b8218c700 1 -- 172.21.15.60:0/3806759613 wait complete. 2023-07-12T02:02:19.386 INFO:teuthology.orchestra.run.smithi060.stdout:55834574852 2023-07-12T02:02:19.387 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-12T02:02:19.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.624+0000 7f1c4c99f700 1 Processor -- start 2023-07-12T02:02:19.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.624+0000 7f1c4c99f700 1 -- start start 2023-07-12T02:02:19.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.626+0000 7f1c4c99f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1c48141780 0x7f1c480ba010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.626+0000 7f1c4c99f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1c48071a30 0x7f1c4814ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.626+0000 7f1c4c99f700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c48070e70 con 0x7f1c480b96b0 2023-07-12T02:02:19.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.626+0000 7f1c4c99f700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c48071ea0 con 0x7f1c48141780 2023-07-12T02:02:19.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.626+0000 7f1c4c99f700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c480b9b40 con 0x7f1c48071a30 2023-07-12T02:02:19.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.626+0000 7f1c4659c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1c48141780 0x7f1c480ba010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.626+0000 7f1c4659c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1c48141780 0x7f1c480ba010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50496/0 (socket says 172.21.15.60:50496) 2023-07-12T02:02:19.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.626+0000 7f1c4659c700 1 -- 172.21.15.60:0/679621118 learned_addr learned my addr 172.21.15.60:0/679621118 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:19.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.626+0000 7f1c4659c700 1 -- 172.21.15.60:0/679621118 >> v2:172.21.15.79:3300/0 conn(0x7f1c48071a30 msgr2=0x7f1c4814ab20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-12T02:02:19.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.626+0000 7f1c4659c700 1 --2- 172.21.15.60:0/679621118 >> v2:172.21.15.79:3300/0 conn(0x7f1c48071a30 0x7f1c4814ab20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.626+0000 7f1c4659c700 1 -- 172.21.15.60:0/679621118 >> v1:172.21.15.79:6789/0 conn(0x7f1c480b96b0 legacy=0x7f1c480b7f80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-12T02:02:19.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.626+0000 7f1c4659c700 1 -- 172.21.15.60:0/679621118 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c48070670 con 0x7f1c48141780 2023-07-12T02:02:19.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.627+0000 7f1c4659c700 1 --2- 172.21.15.60:0/679621118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c48141780 0x7f1c480ba010 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1c4806f200 tx=0x7f1c3c00be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9e57c570af9319c server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.627+0000 7f1c4559a700 1 -- 172.21.15.60:0/679621118 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c00dcf0 con 0x7f1c48141780 2023-07-12T02:02:19.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.628+0000 7f1c4559a700 1 -- 172.21.15.60:0/679621118 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3c00de50 con 0x7f1c48141780 2023-07-12T02:02:19.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.628+0000 7f1c4559a700 1 -- 172.21.15.60:0/679621118 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c004250 con 0x7f1c48141780 2023-07-12T02:02:19.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.628+0000 7f1c4c99f700 1 -- 172.21.15.60:0/679621118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c48141780 msgr2=0x7f1c480ba010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.628+0000 7f1c4c99f700 1 --2- 172.21.15.60:0/679621118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c48141780 0x7f1c480ba010 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1c4806f200 tx=0x7f1c3c00be70 comp rx=0 tx=0).stop 2023-07-12T02:02:19.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.630+0000 7f0d41ccb700 1 Processor -- start 2023-07-12T02:02:19.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.630+0000 7f0d41ccb700 1 -- start start 2023-07-12T02:02:19.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.631+0000 7f0d41ccb700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0d3c148e60 0x7f0d3c15a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.631+0000 7f0d41ccb700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d3c0b3a20 con 0x7f0d3c152040 2023-07-12T02:02:19.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.631+0000 7f0d41ccb700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d3c0b3d00 con 0x7f0d3c0b4810 2023-07-12T02:02:19.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.631+0000 7f0d41ccb700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d3c0b3fe0 con 0x7f0d3c148e60 2023-07-12T02:02:19.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.631+0000 7f0d3bfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0d3c148e60 0x7f0d3c15a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.631+0000 7f0d3b7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f0d3c0b4810 0x7f0d3c0b8690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.60:57970/0 (socket says 172.21.15.60:57970) 2023-07-12T02:02:19.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.631+0000 7f0d3b7fe700 1 -- 172.21.15.60:0/1523859962 learned_addr learned my addr 172.21.15.60:0/1523859962 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:19.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.632+0000 7f0d3bfff700 1 -- 172.21.15.60:0/1523859962 >> v1:172.21.15.79:6789/0 conn(0x7f0d3c0b4810 legacy=0x7f0d3c0b8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.632+0000 7f0d3bfff700 1 -- 172.21.15.60:0/1523859962 >> v1:172.21.15.60:6789/0 conn(0x7f0d3c152040 legacy=0x7f0d3c148750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:19.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.632+0000 7f0d3bfff700 1 -- 172.21.15.60:0/1523859962 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d3c0b90a0 con 0x7f0d3c148e60 2023-07-12T02:02:19.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.629+0000 7f6eb872d700 1 Processor -- start 2023-07-12T02:02:19.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.629+0000 7f6eb872d700 1 -- start start 2023-07-12T02:02:19.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.630+0000 7f6eb872d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6eb00b4830 0x7f6eb00b6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.630+0000 7f6eb872d700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6eb00b8f00 0x7f6eb00b9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.630+0000 7f6eb872d700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eb00b8690 con 0x7f6eb0089730 2023-07-12T02:02:19.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.630+0000 7f6eb872d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eb00b52f0 con 0x7f6eb00b4830 2023-07-12T02:02:19.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.630+0000 7f6eb872d700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb00b5fc0 con 0x7f6eb00b8f00 2023-07-12T02:02:19.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.631+0000 7f6eb64c9700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6eb00b4830 0x7f6eb00b6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.631+0000 7f6eb64c9700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6eb00b4830 0x7f6eb00b6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50508/0 (socket says 172.21.15.60:50508) 2023-07-12T02:02:19.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.631+0000 7f6eb64c9700 1 -- 172.21.15.60:0/851466937 learned_addr learned my addr 172.21.15.60:0/851466937 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:19.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.630+0000 7f1c4c99f700 1 -- 172.21.15.60:0/679621118 shutdown_connections 2023-07-12T02:02:19.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.630+0000 7f1c4c99f700 1 --2- 172.21.15.60:0/679621118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c48141780 0x7f1c480ba010 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.630+0000 7f1c4c99f700 1 --2- 172.21.15.60:0/679621118 >> v2:172.21.15.79:3300/0 conn(0x7f1c48071a30 0x7f1c4814ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.630+0000 7f1c4c99f700 1 -- 172.21.15.60:0/679621118 >> 172.21.15.60:0/679621118 conn(0x7f1c4806d0e0 msgr2=0x7f1c4806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:19.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.633+0000 7f1c4c99f700 1 -- 172.21.15.60:0/679621118 shutdown_connections 2023-07-12T02:02:19.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.633+0000 7f0d3bfff700 1 --2- 172.21.15.60:0/1523859962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d3c148e60 0x7f0d3c15a3e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0d34009d90 tx=0x7f0d3400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd63e980ff61e575 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.631+0000 7f6eb5cc8700 1 --2- 172.21.15.60:0/851466937 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6eb00b8f00 0x7f6eb00b9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.632+0000 7f6eb54c7700 1 -- 172.21.15.60:0/851466937 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 884465362 0 0) 0x7f6eb00b8690 con 0x7f6eb0089730 2023-07-12T02:02:19.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.632+0000 7f6eb54c7700 1 -- 172.21.15.60:0/851466937 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e9c0079c0 con 0x7f6eb0089730 2023-07-12T02:02:19.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.632+0000 7f6eb54c7700 1 -- 172.21.15.60:0/851466937 <== mon.1 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3729431533 0 0) 0x7f6e9c0079c0 con 0x7f6eb0089730 2023-07-12T02:02:19.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.632+0000 7f6eb54c7700 1 -- 172.21.15.60:0/851466937 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6eb00b8f00 msgr2=0x7f6eb00b9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:19.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.632+0000 7f6eb54c7700 1 --2- 172.21.15.60:0/851466937 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6eb00b8f00 0x7f6eb00b9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.632+0000 7f6eb54c7700 1 -- 172.21.15.60:0/851466937 >> v2:172.21.15.60:3300/0 conn(0x7f6eb00b4830 msgr2=0x7f6eb00b6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:19.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.632+0000 7f6eb54c7700 1 --2- 172.21.15.60:0/851466937 >> v2:172.21.15.60:3300/0 conn(0x7f6eb00b4830 0x7f6eb00b6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.632+0000 7f6eb54c7700 1 -- 172.21.15.60:0/851466937 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb01573e0 con 0x7f6eb0089730 2023-07-12T02:02:19.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.632+0000 7f6eb54c7700 1 -- 172.21.15.60:0/851466937 <== mon.1 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1141905739 0 0) 0x7f6ea0001670 con 0x7f6eb0089730 2023-07-12T02:02:19.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.632+0000 7f6eb54c7700 1 -- 172.21.15.60:0/851466937 >> v1:172.21.15.79:6789/0 conn(0x7f6eb0089730 legacy=0x7f6eb015a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.632+0000 7f6eb54c7700 1 --2- 172.21.15.60:0/851466937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e9c007e10 0x7f6e9c008220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.632+0000 7f6eb54c7700 1 --2- 172.21.15.60:0/851466937 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6e9c008840 0x7f6e9c008d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.632+0000 7f6eb54c7700 1 --2- 172.21.15.60:0/851466937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e9c009240 0x7f6e9c0096b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.632+0000 7f6eb54c7700 1 -- 172.21.15.60:0/851466937 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb00b5fc0 con 0x7f6e9c009240 2023-07-12T02:02:19.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.632+0000 7f6eb54c7700 1 -- 172.21.15.60:0/851466937 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9c01cfa0 con 0x7f6e9c007e10 2023-07-12T02:02:19.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.632+0000 7f6eb54c7700 1 -- 172.21.15.60:0/851466937 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9c01d160 con 0x7f6e9c008840 2023-07-12T02:02:19.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.633+0000 7f6eb64c9700 1 --2- 172.21.15.60:0/851466937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e9c007e10 0x7f6e9c008220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.633+0000 7f6eb5cc8700 1 --2- 172.21.15.60:0/851466937 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6e9c008840 0x7f6e9c008d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.633+0000 7f6eb6cca700 1 --2- 172.21.15.60:0/851466937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e9c009240 0x7f6e9c0096b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.633+0000 7f6eb64c9700 1 -- 172.21.15.60:0/851466937 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6e9c008840 msgr2=0x7f6e9c008d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:19.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.633+0000 7f6eb64c9700 1 --2- 172.21.15.60:0/851466937 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6e9c008840 0x7f6e9c008d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.633+0000 7f6eb64c9700 1 -- 172.21.15.60:0/851466937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e9c009240 msgr2=0x7f6e9c0096b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:19.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.633+0000 7f6eb64c9700 1 --2- 172.21.15.60:0/851466937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e9c009240 0x7f6e9c0096b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.633+0000 7f6eb64c9700 1 -- 172.21.15.60:0/851466937 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb01573e0 con 0x7f6e9c007e10 2023-07-12T02:02:19.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.634+0000 7f6eb64c9700 1 --2- 172.21.15.60:0/851466937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e9c007e10 0x7f6e9c008220 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6eac0084b0 tx=0x7f6e9c009c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3df08758fcca6d8f server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.633+0000 7f1c4c99f700 1 -- 172.21.15.60:0/679621118 wait complete. 2023-07-12T02:02:19.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.634+0000 7fdc11824700 1 Processor -- start 2023-07-12T02:02:19.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.634+0000 7f0d3a7fc700 1 -- 172.21.15.60:0/1523859962 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3400e070 con 0x7f0d3c148e60 2023-07-12T02:02:19.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.634+0000 7f0d3a7fc700 1 -- 172.21.15.60:0/1523859962 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3400bb90 con 0x7f0d3c148e60 2023-07-12T02:02:19.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.634+0000 7f0d3a7fc700 1 -- 172.21.15.60:0/1523859962 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d34003a20 con 0x7f0d3c148e60 2023-07-12T02:02:19.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.634+0000 7fdc11824700 1 -- start start 2023-07-12T02:02:19.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.635+0000 7f1c4c99f700 1 Processor -- start 2023-07-12T02:02:19.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.635+0000 7fdc11824700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc0c0b8700 0x7fdc0c0b3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.635+0000 7fdc11824700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdc0c0b93d0 0x7fdc0c1467d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.635+0000 7fdc11824700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc0c0b46f0 con 0x7fdc0c06aa40 2023-07-12T02:02:19.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.635+0000 7fdc11824700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc0c0b4940 con 0x7fdc0c0b93d0 2023-07-12T02:02:19.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.635+0000 7fdc11824700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c0b4c20 con 0x7fdc0c0b8700 2023-07-12T02:02:19.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.635+0000 7f1c4c99f700 1 -- start start 2023-07-12T02:02:19.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.635+0000 7fdc0b7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fdc0c06aa40 0x7fdc0c149d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46080/0 (socket says 172.21.15.60:46080) 2023-07-12T02:02:19.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.635+0000 7fdc0b7fe700 1 -- 172.21.15.60:0/3427960126 learned_addr learned my addr 172.21.15.60:0/3427960126 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:19.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.635+0000 7fdc0affd700 1 --2- 172.21.15.60:0/3427960126 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc0c0b8700 0x7fdc0c0b3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.635+0000 7fdc0a7fc700 1 --2- 172.21.15.60:0/3427960126 >> v2:172.21.15.79:3300/0 conn(0x7fdc0c0b93d0 0x7fdc0c1467d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.636+0000 7f0d41ccb700 1 -- 172.21.15.60:0/1523859962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d3c148e60 msgr2=0x7f0d3c15a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.636+0000 7f0d41ccb700 1 --2- 172.21.15.60:0/1523859962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d3c148e60 0x7f0d3c15a3e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0d34009d90 tx=0x7f0d3400b330 comp rx=0 tx=0).stop 2023-07-12T02:02:19.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.636+0000 7fdc09ffb700 1 -- 172.21.15.60:0/3427960126 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 99245462 0 0) 0x7fdc0c0b46f0 con 0x7fdc0c06aa40 2023-07-12T02:02:19.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.636+0000 7fdc09ffb700 1 -- 172.21.15.60:0/3427960126 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbf40035b0 con 0x7fdc0c06aa40 2023-07-12T02:02:19.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.636+0000 7fdc0affd700 1 -- 172.21.15.60:0/3427960126 >> v2:172.21.15.79:3300/0 conn(0x7fdc0c0b93d0 msgr2=0x7fdc0c1467d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:19.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.636+0000 7fdc0affd700 1 --2- 172.21.15.60:0/3427960126 >> v2:172.21.15.79:3300/0 conn(0x7fdc0c0b93d0 0x7fdc0c1467d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.636+0000 7fdc0affd700 1 -- 172.21.15.60:0/3427960126 >> v1:172.21.15.60:6789/0 conn(0x7fdc0c06aa40 legacy=0x7fdc0c149d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.636+0000 7fdc0affd700 1 -- 172.21.15.60:0/3427960126 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc0c0b4f00 con 0x7fdc0c0b8700 2023-07-12T02:02:19.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.636+0000 7f1c4c99f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c48071a30 0x7f1c48148df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.636+0000 7f1c4c99f700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c480b96b0 0x7f1c4813bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.636+0000 7f1c4c99f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c48141780 0x7f1c4813c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.636+0000 7f1c4c99f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c48149330 con 0x7f1c48141780 2023-07-12T02:02:19.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.636+0000 7f1c4c99f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4814b5d0 con 0x7f1c48071a30 2023-07-12T02:02:19.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.636+0000 7f1c4c99f700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4813b8f0 con 0x7f1c480b96b0 2023-07-12T02:02:19.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.636+0000 7fdc0affd700 1 --2- 172.21.15.60:0/3427960126 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc0c0b8700 0x7fdc0c0b3b00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc009840 tx=0x7fdbfc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f67ceb272c8e207 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.636+0000 7f1c4659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c48071a30 0x7f1c48148df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.636+0000 7f1c45d9b700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c480b96b0 0x7f1c4813bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.636+0000 7f1c45d9b700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c480b96b0 0x7f1c4813bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.60:44638/0 (socket says 172.21.15.60:44638) 2023-07-12T02:02:19.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.636+0000 7f1c45d9b700 1 -- 172.21.15.60:0/2273996397 learned_addr learned my addr 172.21.15.60:0/2273996397 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:19.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.636+0000 7fdc09ffb700 1 -- 172.21.15.60:0/3427960126 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc011830 con 0x7fdc0c0b8700 2023-07-12T02:02:19.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.636+0000 7fdc09ffb700 1 -- 172.21.15.60:0/3427960126 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbfc011990 con 0x7fdc0c0b8700 2023-07-12T02:02:19.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.636+0000 7fdc09ffb700 1 -- 172.21.15.60:0/3427960126 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc011d00 con 0x7fdc0c0b8700 2023-07-12T02:02:19.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.636+0000 7f1c46d9d700 1 --2- 172.21.15.60:0/2273996397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c48141780 0x7f1c4813c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.637+0000 7f1c46d9d700 1 -- 172.21.15.60:0/2273996397 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c480b96b0 msgr2=0x7f1c4813bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.637+0000 7f1c46d9d700 1 --2- 172.21.15.60:0/2273996397 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c480b96b0 0x7f1c4813bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.637+0000 7f1c46d9d700 1 -- 172.21.15.60:0/2273996397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c48071a30 msgr2=0x7f1c48148df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.637+0000 7f1c46d9d700 1 --2- 172.21.15.60:0/2273996397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c48071a30 0x7f1c48148df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.637+0000 7f1c46d9d700 1 -- 172.21.15.60:0/2273996397 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c3c00b7f0 con 0x7f1c48141780 2023-07-12T02:02:19.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.637+0000 7f1c46d9d700 1 --2- 172.21.15.60:0/2273996397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c48141780 0x7f1c4813c2c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1c4000bb00 tx=0x7f1c4000be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.637+0000 7fdc11824700 1 -- 172.21.15.60:0/3427960126 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc0c0b8700 msgr2=0x7fdc0c0b3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.637+0000 7fdc11824700 1 --2- 172.21.15.60:0/3427960126 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc0c0b8700 0x7fdc0c0b3b00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc009840 tx=0x7fdbfc009b50 comp rx=0 tx=0).stop 2023-07-12T02:02:19.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.637+0000 7f6eb54c7700 1 -- 172.21.15.60:0/851466937 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac00f040 con 0x7f6e9c007e10 2023-07-12T02:02:19.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.637+0000 7f6eb54c7700 1 -- 172.21.15.60:0/851466937 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eac0132d0 con 0x7f6e9c007e10 2023-07-12T02:02:19.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.637+0000 7f6eb54c7700 1 -- 172.21.15.60:0/851466937 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac013640 con 0x7f6e9c007e10 2023-07-12T02:02:19.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.637+0000 7f0d41ccb700 1 -- 172.21.15.60:0/1523859962 shutdown_connections 2023-07-12T02:02:19.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.637+0000 7f0d41ccb700 1 --2- 172.21.15.60:0/1523859962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d3c148e60 0x7f0d3c15a3e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.637+0000 7f0d41ccb700 1 -- 172.21.15.60:0/1523859962 >> 172.21.15.60:0/1523859962 conn(0x7f0d3c069f30 msgr2=0x7f0d3c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:19.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.637+0000 7f1c36ffd700 1 -- 172.21.15.60:0/2273996397 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4000c9b0 con 0x7f1c48141780 2023-07-12T02:02:19.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.638+0000 7f1c36ffd700 1 -- 172.21.15.60:0/2273996397 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c4000cb10 con 0x7f1c48141780 2023-07-12T02:02:19.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.638+0000 7f1c36ffd700 1 -- 172.21.15.60:0/2273996397 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c40014440 con 0x7f1c48141780 2023-07-12T02:02:19.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.638+0000 7fdc11824700 1 -- 172.21.15.60:0/3427960126 shutdown_connections 2023-07-12T02:02:19.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.638+0000 7fdc11824700 1 --2- 172.21.15.60:0/3427960126 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc0c0b8700 0x7fdc0c0b3b00 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.638+0000 7fdc11824700 1 --2- 172.21.15.60:0/3427960126 >> v2:172.21.15.79:3300/0 conn(0x7fdc0c0b93d0 0x7fdc0c1467d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.638+0000 7fdc11824700 1 -- 172.21.15.60:0/3427960126 >> 172.21.15.60:0/3427960126 conn(0x7fdc0c069f30 msgr2=0x7fdc0c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:19.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.638+0000 7f1c4c99f700 1 -- 172.21.15.60:0/2273996397 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c4814a4a0 con 0x7f1c48141780 2023-07-12T02:02:19.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.638+0000 7f1c4c99f700 1 -- 172.21.15.60:0/2273996397 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c4814aa60 con 0x7f1c48141780 2023-07-12T02:02:19.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.639+0000 7f1c4c99f700 1 -- 172.21.15.60:0/2273996397 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c4813ba80 con 0x7f1c48141780 2023-07-12T02:02:19.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.639+0000 7fdc11824700 1 -- 172.21.15.60:0/3427960126 shutdown_connections 2023-07-12T02:02:19.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.639+0000 7fdc11824700 1 -- 172.21.15.60:0/3427960126 wait complete. 2023-07-12T02:02:19.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.640+0000 7fdc11824700 1 Processor -- start 2023-07-12T02:02:19.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.640+0000 7f1c36ffd700 1 -- 172.21.15.60:0/2273996397 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1c4001d3b0 con 0x7f1c48141780 2023-07-12T02:02:19.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.641+0000 7fdc11824700 1 -- start start 2023-07-12T02:02:19.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.641+0000 7f1c36ffd700 1 --2- 172.21.15.60:0/2273996397 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f1c2806ace0 0x7f1c2806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.641+0000 7f1c36ffd700 1 -- 172.21.15.60:0/2273996397 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1c400891a0 con 0x7f1c48141780 2023-07-12T02:02:19.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.640+0000 7f6eb872d700 1 -- 172.21.15.60:0/851466937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e9c007e10 msgr2=0x7f6e9c008220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.640+0000 7f6eb872d700 1 --2- 172.21.15.60:0/851466937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e9c007e10 0x7f6e9c008220 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6eac0084b0 tx=0x7f6e9c009c90 comp rx=0 tx=0).stop 2023-07-12T02:02:19.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.640+0000 7f6eb6cca700 1 -- 172.21.15.60:0/851466937 reap_dead start 2023-07-12T02:02:19.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.641+0000 7f6eb872d700 1 -- 172.21.15.60:0/851466937 shutdown_connections 2023-07-12T02:02:19.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.641+0000 7f6eb872d700 1 -- 172.21.15.60:0/851466937 >> 172.21.15.60:0/851466937 conn(0x7f6eb0069f30 msgr2=0x7f6eb006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:19.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.641+0000 7f6eb872d700 1 -- 172.21.15.60:0/851466937 shutdown_connections 2023-07-12T02:02:19.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.641+0000 7f6eb872d700 1 -- 172.21.15.60:0/851466937 wait complete. 2023-07-12T02:02:19.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.641+0000 7f3f72623700 1 Processor -- start 2023-07-12T02:02:19.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.642+0000 7fdc11824700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc0c06aa40 0x7fdc0c0bcc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.642+0000 7fdc11824700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc0c0b8700 0x7fdc0c06ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.642+0000 7fdc11824700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc0c0b93d0 0x7fdc0c070df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.642+0000 7fdc11824700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c0bd1d0 con 0x7fdc0c0b8700 2023-07-12T02:02:19.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.642+0000 7fdc11824700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c06f4e0 con 0x7fdc0c0b93d0 2023-07-12T02:02:19.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.642+0000 7fdc11824700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c0704a0 con 0x7fdc0c06aa40 2023-07-12T02:02:19.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.642+0000 7f0d41ccb700 1 -- 172.21.15.60:0/1523859962 shutdown_connections 2023-07-12T02:02:19.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.642+0000 7fdc0affd700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc0c06aa40 0x7fdc0c0bcc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.642+0000 7fdc0affd700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc0c06aa40 0x7fdc0c0bcc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.60:44654/0 (socket says 172.21.15.60:44654) 2023-07-12T02:02:19.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.642+0000 7fdc0affd700 1 -- 172.21.15.60:0/1931623299 learned_addr learned my addr 172.21.15.60:0/1931623299 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:19.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.642+0000 7fdc0affd700 1 -- 172.21.15.60:0/1931623299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc0c0b93d0 msgr2=0x7fdc0c070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.642+0000 7fdc0affd700 1 --2- 172.21.15.60:0/1931623299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc0c0b93d0 0x7fdc0c070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.642+0000 7fdc0affd700 1 -- 172.21.15.60:0/1931623299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc0c0b8700 msgr2=0x7fdc0c06ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.642+0000 7fdc0affd700 1 --2- 172.21.15.60:0/1931623299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc0c0b8700 0x7fdc0c06ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.642+0000 7fdc0affd700 1 -- 172.21.15.60:0/1931623299 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbfc0094a0 con 0x7fdc0c06aa40 2023-07-12T02:02:19.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.642+0000 7f3f72623700 1 -- start start 2023-07-12T02:02:19.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.643+0000 7f3f72623700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3f6c0b4670 0x7f3f6c0b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.643+0000 7f3f72623700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f6c14f260 con 0x7f3f6c148950 2023-07-12T02:02:19.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.643+0000 7f3f72623700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f6c1521a0 con 0x7f3f6c0b3ad0 2023-07-12T02:02:19.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.643+0000 7f3f72623700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f6c152480 con 0x7f3f6c0b4670 2023-07-12T02:02:19.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.643+0000 7f6eb872d700 1 Processor -- start 2023-07-12T02:02:19.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.643+0000 7f3f70bc0700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f3f6c148950 0x7f3f6c159490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46086/0 (socket says 172.21.15.60:46086) 2023-07-12T02:02:19.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.643+0000 7f3f70bc0700 1 -- 172.21.15.60:0/2419000275 learned_addr learned my addr 172.21.15.60:0/2419000275 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:19.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.643+0000 7f1c4659c700 1 --2- 172.21.15.60:0/2273996397 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f1c2806ace0 0x7f1c2806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.643+0000 7f3f6b7fe700 1 --2- 172.21.15.60:0/2419000275 >> v2:172.21.15.60:3300/0 conn(0x7f3f6c0b4670 0x7f3f6c0b4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.642+0000 7f0d41ccb700 1 -- 172.21.15.60:0/1523859962 wait complete. 2023-07-12T02:02:19.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.644+0000 7f0d41ccb700 1 Processor -- start 2023-07-12T02:02:19.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.644+0000 7f3f6b7fe700 1 -- 172.21.15.60:0/2419000275 >> v1:172.21.15.79:6789/0 conn(0x7f3f6c0b3ad0 legacy=0x7f3f6c14eb50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-12T02:02:19.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.644+0000 7f3f6b7fe700 1 -- 172.21.15.60:0/2419000275 >> v1:172.21.15.60:6789/0 conn(0x7f3f6c148950 legacy=0x7f3f6c159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.644+0000 7f3f6b7fe700 1 -- 172.21.15.60:0/2419000275 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f6c152760 con 0x7f3f6c0b4670 2023-07-12T02:02:19.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.644+0000 7fdc0affd700 1 --2- 172.21.15.60:0/1931623299 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc0c06aa40 0x7fdc0c0bcc90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc0090b0 tx=0x7fdbfc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.644+0000 7f3f6b7fe700 1 --2- 172.21.15.60:0/2419000275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f6c0b4670 0x7f3f6c0b4ac0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3f60009840 tx=0x7f3f60009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbf340f4ce91fa65 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.644+0000 7fdbf3fff700 1 -- 172.21.15.60:0/1931623299 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc0036a0 con 0x7fdc0c06aa40 2023-07-12T02:02:19.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.644+0000 7fdbf3fff700 1 -- 172.21.15.60:0/1931623299 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbfc01f070 con 0x7fdc0c06aa40 2023-07-12T02:02:19.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.644+0000 7fdbf3fff700 1 -- 172.21.15.60:0/1931623299 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc003a40 con 0x7fdc0c06aa40 2023-07-12T02:02:19.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.644+0000 7fdc11824700 1 -- 172.21.15.60:0/1931623299 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc0c06ebb0 con 0x7fdc0c06aa40 2023-07-12T02:02:19.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.644+0000 7fdc11824700 1 -- 172.21.15.60:0/1931623299 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc0c06f170 con 0x7fdc0c06aa40 2023-07-12T02:02:19.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.643+0000 7f6eb872d700 1 -- start start 2023-07-12T02:02:19.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.644+0000 7f6eb872d700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6e9c007e10 0x7f6eb00bbc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.645+0000 7f6eb872d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6eb0153850 0x7f6eb01ef890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.645+0000 7f6eb872d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6eb01efdd0 0x7f6eb0159530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.645+0000 7f6eb872d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb00bc1a0 con 0x7f6eb01efdd0 2023-07-12T02:02:19.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.645+0000 7f6eb872d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb01f0250 con 0x7f6eb0153850 2023-07-12T02:02:19.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.645+0000 7f6eb872d700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb015b0d0 con 0x7f6e9c007e10 2023-07-12T02:02:19.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.645+0000 7f6eb5cc8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6eb0153850 0x7f6eb01ef890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.645+0000 7f6eb5cc8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6eb0153850 0x7f6eb01ef890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.60:43378/0 (socket says 172.21.15.60:43378) 2023-07-12T02:02:19.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.645+0000 7f6eb5cc8700 1 -- 172.21.15.60:0/3729472854 learned_addr learned my addr 172.21.15.60:0/3729472854 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:19.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.645+0000 7f1c4659c700 1 --2- 172.21.15.60:0/2273996397 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f1c2806ace0 0x7f1c2806d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c00beb0 tx=0x7f1c3c01b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.645+0000 7f6eb64c9700 1 --2- 172.21.15.60:0/3729472854 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6e9c007e10 0x7f6eb00bbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.645+0000 7f6eb5cc8700 1 -- 172.21.15.60:0/3729472854 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6e9c007e10 msgr2=0x7f6eb00bbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.645+0000 7f6eb5cc8700 1 --2- 172.21.15.60:0/3729472854 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6e9c007e10 0x7f6eb00bbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.645+0000 7f6eb5cc8700 1 -- 172.21.15.60:0/3729472854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6eb01efdd0 msgr2=0x7f6eb0159530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.645+0000 7f6eb5cc8700 1 --2- 172.21.15.60:0/3729472854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6eb01efdd0 0x7f6eb0159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.645+0000 7f6eb5cc8700 1 -- 172.21.15.60:0/3729472854 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb01ec6c0 con 0x7f6eb0153850 2023-07-12T02:02:19.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.645+0000 7f6eb5cc8700 1 --2- 172.21.15.60:0/3729472854 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6eb0153850 0x7f6eb01ef890 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6ea8009ba0 tx=0x7f6ea8009f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.646+0000 7f6ea6ffd700 1 -- 172.21.15.60:0/3729472854 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea8019070 con 0x7f6eb0153850 2023-07-12T02:02:19.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.646+0000 7f6ea6ffd700 1 -- 172.21.15.60:0/3729472854 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea8011040 con 0x7f6eb0153850 2023-07-12T02:02:19.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.646+0000 7f6ea6ffd700 1 -- 172.21.15.60:0/3729472854 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea8008ce0 con 0x7f6eb0153850 2023-07-12T02:02:19.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.646+0000 7f6eb872d700 1 -- 172.21.15.60:0/3729472854 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eb01ec9a0 con 0x7f6eb0153850 2023-07-12T02:02:19.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.646+0000 7f6eb872d700 1 -- 172.21.15.60:0/3729472854 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb01ecf60 con 0x7f6eb0153850 2023-07-12T02:02:19.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.646+0000 7fdc11824700 1 -- 172.21.15.60:0/1931623299 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbec0052f0 con 0x7fdc0c06aa40 2023-07-12T02:02:19.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.647+0000 7f43f45ca700 1 Processor -- start 2023-07-12T02:02:19.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.644+0000 7f0d41ccb700 1 -- start start 2023-07-12T02:02:19.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.645+0000 7f0d41ccb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d3c0b4810 0x7f0d3c1d91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.645+0000 7f0d41ccb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d3c148e60 0x7f0d3c0bb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.645+0000 7f0d41ccb700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d3c152040 0x7f0d3c144fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.645+0000 7f0d41ccb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3c146830 con 0x7f0d3c0b4810 2023-07-12T02:02:19.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.645+0000 7f0d41ccb700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3c146ad0 con 0x7f0d3c148e60 2023-07-12T02:02:19.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.645+0000 7f0d41ccb700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3c146db0 con 0x7f0d3c152040 2023-07-12T02:02:19.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.645+0000 7f0d3b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d3c0b4810 0x7f0d3c1d91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.645+0000 7f0d3b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d3c0b4810 0x7f0d3c1d91e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50560/0 (socket says 172.21.15.60:50560) 2023-07-12T02:02:19.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.645+0000 7f0d3b7fe700 1 -- 172.21.15.60:0/2696085302 learned_addr learned my addr 172.21.15.60:0/2696085302 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:19.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.646+0000 7f0d3affd700 1 --2- 172.21.15.60:0/2696085302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d3c148e60 0x7f0d3c0bb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.646+0000 7f0d3b7fe700 1 -- 172.21.15.60:0/2696085302 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d3c152040 msgr2=0x7f0d3c144fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.646+0000 7f0d3bfff700 1 --2- 172.21.15.60:0/2696085302 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d3c152040 0x7f0d3c144fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.646+0000 7f0d3b7fe700 1 --2- 172.21.15.60:0/2696085302 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d3c152040 0x7f0d3c144fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.646+0000 7f0d3b7fe700 1 -- 172.21.15.60:0/2696085302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d3c148e60 msgr2=0x7f0d3c0bb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.646+0000 7f0d3b7fe700 1 --2- 172.21.15.60:0/2696085302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d3c148e60 0x7f0d3c0bb960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.646+0000 7f0d3b7fe700 1 -- 172.21.15.60:0/2696085302 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d34009a70 con 0x7f0d3c0b4810 2023-07-12T02:02:19.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.647+0000 7f0d3bfff700 1 --2- 172.21.15.60:0/2696085302 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d3c152040 0x7f0d3c144fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:02:19.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.647+0000 7f0d3b7fe700 1 --2- 172.21.15.60:0/2696085302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d3c0b4810 0x7f0d3c1d91e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c00c520 tx=0x7f0d2c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.647+0000 7fdbf3fff700 1 -- 172.21.15.60:0/1931623299 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdbfc003ba0 con 0x7fdc0c06aa40 2023-07-12T02:02:19.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.647+0000 7fdbf3fff700 1 --2- 172.21.15.60:0/1931623299 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fdbf806ad60 0x7fdbf806d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.648+0000 7fdbf3fff700 1 -- 172.21.15.60:0/1931623299 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdbfc021070 con 0x7fdc0c06aa40 2023-07-12T02:02:19.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.647+0000 7f43f45ca700 1 -- start start 2023-07-12T02:02:19.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.648+0000 7f6eb872d700 1 -- 172.21.15.60:0/3729472854 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eb0074360 con 0x7f6eb0153850 2023-07-12T02:02:19.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.648+0000 7fdc0a7fc700 1 --2- 172.21.15.60:0/1931623299 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fdbf806ad60 0x7fdbf806d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.648+0000 7f0d23fff700 1 -- 172.21.15.60:0/2696085302 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c005d70 con 0x7f0d3c0b4810 2023-07-12T02:02:19.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.648+0000 7f0d23fff700 1 -- 172.21.15.60:0/2696085302 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2c0070d0 con 0x7f0d3c0b4810 2023-07-12T02:02:19.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.648+0000 7f0d23fff700 1 -- 172.21.15.60:0/2696085302 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c007440 con 0x7f0d3c0b4810 2023-07-12T02:02:19.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.648+0000 7f1c36ffd700 1 -- 172.21.15.60:0/2273996397 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f1c40054260 con 0x7f1c48141780 2023-07-12T02:02:19.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.648+0000 7f43f45ca700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f43ec0bb270 0x7f43ec0b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.648+0000 7f43f45ca700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43ec0b5a10 con 0x7f43ec152210 2023-07-12T02:02:19.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.648+0000 7f43f45ca700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43ec0b7250 con 0x7f43ec1573b0 2023-07-12T02:02:19.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.648+0000 7f43f45ca700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec0b6230 con 0x7f43ec0bb270 2023-07-12T02:02:19.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.649+0000 7f43f2b67700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f43ec1573b0 0x7f43ec159790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.60:57976/0 (socket says 172.21.15.60:57976) 2023-07-12T02:02:19.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.649+0000 7f43f2b67700 1 -- 172.21.15.60:0/2458710065 learned_addr learned my addr 172.21.15.60:0/2458710065 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:19.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.649+0000 7f43f1b65700 1 --2- 172.21.15.60:0/2458710065 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f43ec0bb270 0x7f43ec0b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.649+0000 7f43f1b65700 1 -- 172.21.15.60:0/2458710065 >> v1:172.21.15.79:6789/0 conn(0x7f43ec1573b0 legacy=0x7f43ec159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.649+0000 7f43f1b65700 1 -- 172.21.15.60:0/2458710065 >> v1:172.21.15.60:6789/0 conn(0x7f43ec152210 legacy=0x7f43ec14bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:19.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.649+0000 7f43f1b65700 1 -- 172.21.15.60:0/2458710065 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ec0b6510 con 0x7f43ec0bb270 2023-07-12T02:02:19.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.649+0000 7f43f1b65700 1 --2- 172.21.15.60:0/2458710065 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f43ec0bb270 0x7f43ec0b6d10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f43e8009870 tx=0x7f43e8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca2d040ffa1abc7f server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.648+0000 7f0d41ccb700 1 -- 172.21.15.60:0/2696085302 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d3c147090 con 0x7f0d3c0b4810 2023-07-12T02:02:19.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.648+0000 7f0d41ccb700 1 -- 172.21.15.60:0/2696085302 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d3c0b7e10 con 0x7f0d3c0b4810 2023-07-12T02:02:19.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.650+0000 7f0d41ccb700 1 -- 172.21.15.60:0/2696085302 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d3c074360 con 0x7f0d3c0b4810 2023-07-12T02:02:19.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.648+0000 7f6ea6ffd700 1 -- 172.21.15.60:0/3729472854 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6ea8003a20 con 0x7f6eb0153850 2023-07-12T02:02:19.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.649+0000 7f6ea6ffd700 1 --2- 172.21.15.60:0/3729472854 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f6e9c06c7f0 0x7f6e9c06eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.649+0000 7f6ea6ffd700 1 -- 172.21.15.60:0/3729472854 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6ea80892f0 con 0x7f6eb0153850 2023-07-12T02:02:19.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.649+0000 7fdc0a7fc700 1 --2- 172.21.15.60:0/1931623299 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fdbf806ad60 0x7fdbf806d210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdc00006ac0 tx=0x7fdc00006a50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.650+0000 7f3f6affd700 1 -- 172.21.15.60:0/2419000275 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f60004230 con 0x7f3f6c0b4670 2023-07-12T02:02:19.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.650+0000 7f3f6affd700 1 -- 172.21.15.60:0/2419000275 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f60004390 con 0x7f3f6c0b4670 2023-07-12T02:02:19.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.650+0000 7f3f6affd700 1 -- 172.21.15.60:0/2419000275 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f600036a0 con 0x7f3f6c0b4670 2023-07-12T02:02:19.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.649+0000 7f6eb64c9700 1 --2- 172.21.15.60:0/3729472854 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f6e9c06c7f0 0x7f6e9c06eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.650+0000 7fe7e862b700 1 Processor -- start 2023-07-12T02:02:19.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.650+0000 7f6eb64c9700 1 --2- 172.21.15.60:0/3729472854 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f6e9c06c7f0 0x7f6e9c06eca0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6eac00c010 tx=0x7f6eac010000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.651+0000 7f3f72623700 1 -- 172.21.15.60:0/2419000275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f6c0b4670 msgr2=0x7f3f6c0b4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.651+0000 7f3f72623700 1 --2- 172.21.15.60:0/2419000275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f6c0b4670 0x7f3f6c0b4ac0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3f60009840 tx=0x7f3f60009b50 comp rx=0 tx=0).stop 2023-07-12T02:02:19.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.650+0000 7fe7e862b700 1 -- start start 2023-07-12T02:02:19.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.651+0000 7fe7e862b700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe7e00b8d90 0x7fe7e006ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.651+0000 7fe7e862b700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7e00b8620 con 0x7fe7e01449d0 2023-07-12T02:02:19.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.651+0000 7fe7e862b700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7e00b8900 con 0x7fe7e00bc810 2023-07-12T02:02:19.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.651+0000 7fe7e862b700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e00b97a0 con 0x7fe7e00b8d90 2023-07-12T02:02:19.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.651+0000 7fe7e63c7700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe7e01449d0 0x7fe7e014db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46104/0 (socket says 172.21.15.60:46104) 2023-07-12T02:02:19.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.651+0000 7fe7e63c7700 1 -- 172.21.15.60:0/1124576047 learned_addr learned my addr 172.21.15.60:0/1124576047 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:19.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.652+0000 7fe7e6bc8700 1 --2- 172.21.15.60:0/1124576047 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe7e00b8d90 0x7fe7e006ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.652+0000 7f0d23fff700 1 -- 172.21.15.60:0/2696085302 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0d2c0075a0 con 0x7f0d3c0b4810 2023-07-12T02:02:19.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.652+0000 7fe7e6bc8700 1 -- 172.21.15.60:0/1124576047 >> v1:172.21.15.79:6789/0 conn(0x7fe7e00bc810 legacy=0x7fe7e00ba530 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-12T02:02:19.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.652+0000 7fe7e6bc8700 1 -- 172.21.15.60:0/1124576047 >> v1:172.21.15.60:6789/0 conn(0x7fe7e01449d0 legacy=0x7fe7e014db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.652+0000 7fe7e6bc8700 1 -- 172.21.15.60:0/1124576047 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e00bac40 con 0x7fe7e00b8d90 2023-07-12T02:02:19.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.652+0000 7fe7e6bc8700 1 --2- 172.21.15.60:0/1124576047 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe7e00b8d90 0x7fe7e006ade0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8009dc0 tx=0x7fe7d800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9593f45e72d363ca server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.652+0000 7f0d23fff700 1 --2- 172.21.15.60:0/2696085302 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f0d2806ace0 0x7f0d2806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.652+0000 7f0d23fff700 1 -- 172.21.15.60:0/2696085302 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0d2c088fd0 con 0x7f0d3c0b4810 2023-07-12T02:02:19.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.652+0000 7f43f1364700 1 -- 172.21.15.60:0/2458710065 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e8004230 con 0x7f43ec0bb270 2023-07-12T02:02:19.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.653+0000 7fe7e53c5700 1 -- 172.21.15.60:0/1124576047 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d800e070 con 0x7fe7e00b8d90 2023-07-12T02:02:19.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.653+0000 7f43f1364700 1 -- 172.21.15.60:0/2458710065 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e8004390 con 0x7f43ec0bb270 2023-07-12T02:02:19.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.653+0000 7f43f1364700 1 -- 172.21.15.60:0/2458710065 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e80036a0 con 0x7f43ec0bb270 2023-07-12T02:02:19.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.653+0000 7f0d3affd700 1 --2- 172.21.15.60:0/2696085302 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f0d2806ace0 0x7f0d2806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.653+0000 7fe7e53c5700 1 -- 172.21.15.60:0/1124576047 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d800bbd0 con 0x7fe7e00b8d90 2023-07-12T02:02:19.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.653+0000 7fe7e53c5700 1 -- 172.21.15.60:0/1124576047 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d8003a20 con 0x7fe7e00b8d90 2023-07-12T02:02:19.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.653+0000 7f0d3affd700 1 --2- 172.21.15.60:0/2696085302 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f0d2806ace0 0x7f0d2806d190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c145e00 tx=0x7f0d30009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.654+0000 7fe7e862b700 1 -- 172.21.15.60:0/1124576047 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe7e00b8d90 msgr2=0x7fe7e006ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.654+0000 7fe7e862b700 1 --2- 172.21.15.60:0/1124576047 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe7e00b8d90 0x7fe7e006ade0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8009dc0 tx=0x7fe7d800b330 comp rx=0 tx=0).stop 2023-07-12T02:02:19.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.654+0000 7f43f45ca700 1 -- 172.21.15.60:0/2458710065 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f43ec0bb270 msgr2=0x7f43ec0b6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.654+0000 7f43f45ca700 1 --2- 172.21.15.60:0/2458710065 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f43ec0bb270 0x7f43ec0b6d10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f43e8009870 tx=0x7f43e8009b80 comp rx=0 tx=0).stop 2023-07-12T02:02:19.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.654+0000 7fe7e862b700 1 -- 172.21.15.60:0/1124576047 shutdown_connections 2023-07-12T02:02:19.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.654+0000 7fe7e862b700 1 --2- 172.21.15.60:0/1124576047 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe7e00b8d90 0x7fe7e006ade0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.654+0000 7fe7e862b700 1 -- 172.21.15.60:0/1124576047 >> 172.21.15.60:0/1124576047 conn(0x7fe7e00c0860 msgr2=0x7fe7e00c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:19.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.654+0000 7f43f45ca700 1 -- 172.21.15.60:0/2458710065 shutdown_connections 2023-07-12T02:02:19.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.654+0000 7f43f45ca700 1 --2- 172.21.15.60:0/2458710065 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f43ec0bb270 0x7f43ec0b6d10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.654+0000 7f43f45ca700 1 -- 172.21.15.60:0/2458710065 >> 172.21.15.60:0/2458710065 conn(0x7f43ec0c08f0 msgr2=0x7f43ec0c0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:19.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.654+0000 7f6ea6ffd700 1 -- 172.21.15.60:0/3729472854 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f6ea80542f0 con 0x7f6eb0153850 2023-07-12T02:02:19.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.655+0000 7f3f72623700 1 -- 172.21.15.60:0/2419000275 shutdown_connections 2023-07-12T02:02:19.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.655+0000 7f3f72623700 1 --2- 172.21.15.60:0/2419000275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f6c0b4670 0x7f3f6c0b4ac0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.655+0000 7f3f72623700 1 -- 172.21.15.60:0/2419000275 >> 172.21.15.60:0/2419000275 conn(0x7f3f6c069f30 msgr2=0x7f3f6c06a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:19.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.655+0000 7fdbf3fff700 1 -- 172.21.15.60:0/1931623299 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fdbfc055bd0 con 0x7fdc0c06aa40 2023-07-12T02:02:19.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.655+0000 7f3f72623700 1 -- 172.21.15.60:0/2419000275 shutdown_connections 2023-07-12T02:02:19.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.655+0000 7f3f72623700 1 -- 172.21.15.60:0/2419000275 wait complete. 2023-07-12T02:02:19.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.655+0000 7f43f45ca700 1 -- 172.21.15.60:0/2458710065 shutdown_connections 2023-07-12T02:02:19.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.655+0000 7f43f45ca700 1 -- 172.21.15.60:0/2458710065 wait complete. 2023-07-12T02:02:19.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.656+0000 7f43f45ca700 1 Processor -- start 2023-07-12T02:02:19.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.656+0000 7f3f72623700 1 Processor -- start 2023-07-12T02:02:19.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.656+0000 7f43f45ca700 1 -- start start 2023-07-12T02:02:19.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.657+0000 7f43f45ca700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43ec0bb270 0x7f43ec0ba1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.657+0000 7f43f45ca700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f43ec152210 0x7f43ec0b91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.657+0000 7f43f45ca700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43ec1573b0 0x7f43ec147790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.657+0000 7f43f45ca700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec0bab10 con 0x7f43ec1573b0 2023-07-12T02:02:19.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.657+0000 7f43f45ca700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec14e0a0 con 0x7f43ec0bb270 2023-07-12T02:02:19.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.657+0000 7f43f45ca700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec0b96f0 con 0x7f43ec152210 2023-07-12T02:02:19.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.657+0000 7f3f72623700 1 -- start start 2023-07-12T02:02:19.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.657+0000 7f43f2b67700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43ec1573b0 0x7f43ec147790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.657+0000 7f43f2b67700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43ec1573b0 0x7f43ec147790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50576/0 (socket says 172.21.15.60:50576) 2023-07-12T02:02:19.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.657+0000 7f43f2b67700 1 -- 172.21.15.60:0/628016284 learned_addr learned my addr 172.21.15.60:0/628016284 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:19.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.657+0000 7f43f1b65700 1 --2- 172.21.15.60:0/628016284 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f43ec152210 0x7f43ec0b91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.657+0000 7f43f2366700 1 --2- 172.21.15.60:0/628016284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43ec0bb270 0x7f43ec0ba1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.658+0000 7f43f2b67700 1 -- 172.21.15.60:0/628016284 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f43ec152210 msgr2=0x7f43ec0b91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.658+0000 7f43f2b67700 1 --2- 172.21.15.60:0/628016284 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f43ec152210 0x7f43ec0b91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.658+0000 7f43f2b67700 1 -- 172.21.15.60:0/628016284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43ec0bb270 msgr2=0x7f43ec0ba1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.658+0000 7f43f2b67700 1 --2- 172.21.15.60:0/628016284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43ec0bb270 0x7f43ec0ba1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.658+0000 7f43f2b67700 1 -- 172.21.15.60:0/628016284 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e80094a0 con 0x7f43ec1573b0 2023-07-12T02:02:19.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.658+0000 7f43f1b65700 1 --2- 172.21.15.60:0/628016284 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f43ec152210 0x7f43ec0b91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:19.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.658+0000 7f43f2b67700 1 --2- 172.21.15.60:0/628016284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43ec1573b0 0x7f43ec147790 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f43e400ca80 tx=0x7f43e400cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.658+0000 7f3f72623700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f6c0b3ad0 0x7f3f6c1511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.658+0000 7f3f72623700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f6c0b4670 0x7f3f6c13fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.658+0000 7f3f72623700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f6c148950 0x7f3f6c13ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.658+0000 7f3f72623700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6c140d80 con 0x7f3f6c0b4670 2023-07-12T02:02:19.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.658+0000 7f3f72623700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6c146e70 con 0x7f3f6c148950 2023-07-12T02:02:19.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.658+0000 7f3f72623700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6c13b050 con 0x7f3f6c0b3ad0 2023-07-12T02:02:19.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.658+0000 7f3f6b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f6c0b4670 0x7f3f6c13fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.658+0000 7f3f6b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f6c0b4670 0x7f3f6c13fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50586/0 (socket says 172.21.15.60:50586) 2023-07-12T02:02:19.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.658+0000 7f3f6b7fe700 1 -- 172.21.15.60:0/1390747024 learned_addr learned my addr 172.21.15.60:0/1390747024 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:19.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.658+0000 7f3f70bc0700 1 --2- 172.21.15.60:0/1390747024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f6c148950 0x7f3f6c13ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.659+0000 7f3f70bc0700 1 -- 172.21.15.60:0/1390747024 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f6c0b3ad0 msgr2=0x7f3f6c1511a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-12T02:02:19.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.659+0000 7f3f70bc0700 1 --2- 172.21.15.60:0/1390747024 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f6c0b3ad0 0x7f3f6c1511a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.659+0000 7f3f70bc0700 1 -- 172.21.15.60:0/1390747024 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f6c0b4670 msgr2=0x7f3f6c13fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.659+0000 7f3f70bc0700 1 --2- 172.21.15.60:0/1390747024 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f6c0b4670 0x7f3f6c13fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.659+0000 7f3f70bc0700 1 -- 172.21.15.60:0/1390747024 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f600094a0 con 0x7f3f6c148950 2023-07-12T02:02:19.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.659+0000 7f3f70bc0700 1 --2- 172.21.15.60:0/1390747024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f6c148950 0x7f3f6c13ead0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3f6400ca70 tx=0x7f3f6400cd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.659+0000 7f0d23fff700 1 -- 172.21.15.60:0/2696085302 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f0d2c0541a0 con 0x7f0d3c0b4810 2023-07-12T02:02:19.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.660+0000 7f43e2ffd700 1 -- 172.21.15.60:0/628016284 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e400a980 con 0x7f43ec1573b0 2023-07-12T02:02:19.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.660+0000 7f43f45ca700 1 -- 172.21.15.60:0/628016284 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43ec147cd0 con 0x7f43ec1573b0 2023-07-12T02:02:19.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.660+0000 7f43f45ca700 1 -- 172.21.15.60:0/628016284 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43ec0ba830 con 0x7f43ec1573b0 2023-07-12T02:02:19.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.660+0000 7f43e2ffd700 1 -- 172.21.15.60:0/628016284 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e4001b60 con 0x7f43ec1573b0 2023-07-12T02:02:19.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.660+0000 7f43e2ffd700 1 -- 172.21.15.60:0/628016284 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e400ace0 con 0x7f43ec1573b0 2023-07-12T02:02:19.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.660+0000 7fe7e862b700 1 -- 172.21.15.60:0/1124576047 shutdown_connections 2023-07-12T02:02:19.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.661+0000 7f43f45ca700 1 -- 172.21.15.60:0/628016284 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43d0005320 con 0x7f43ec1573b0 2023-07-12T02:02:19.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.668+0000 7fc724107700 1 Processor -- start 2023-07-12T02:02:19.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.668+0000 7fc724107700 1 -- start start 2023-07-12T02:02:19.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.668+0000 7f43e2ffd700 1 -- 172.21.15.60:0/628016284 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f43e401c440 con 0x7f43ec1573b0 2023-07-12T02:02:19.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.668+0000 7f43e2ffd700 1 --2- 172.21.15.60:0/628016284 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f43d806ae30 0x7f43d806d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.668+0000 7f43e2ffd700 1 -- 172.21.15.60:0/628016284 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f43e4089330 con 0x7f43ec1573b0 2023-07-12T02:02:19.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.668+0000 7f43f2366700 1 --2- 172.21.15.60:0/628016284 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f43d806ae30 0x7f43d806d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.669+0000 7f43f2366700 1 --2- 172.21.15.60:0/628016284 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f43d806ae30 0x7f43d806d2e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f43dc007fd0 tx=0x7f43dc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.669+0000 7fc724107700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc71c0b96b0 0x7fc71c069f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.669+0000 7fc724107700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc71c070e70 con 0x7fc71c071a30 2023-07-12T02:02:19.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.669+0000 7fc724107700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc71c0ba720 con 0x7fc71c141780 2023-07-12T02:02:19.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.669+0000 7fc724107700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc71c071ea0 con 0x7fc71c0b96b0 2023-07-12T02:02:19.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.669+0000 7fc7226a4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc71c0b96b0 0x7fc71c069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.669+0000 7fc721ea3700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc71c141780 0x7fc71c0ba010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.60:57990/0 (socket says 172.21.15.60:57990) 2023-07-12T02:02:19.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.669+0000 7fc721ea3700 1 -- 172.21.15.60:0/7070229 learned_addr learned my addr 172.21.15.60:0/7070229 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:19.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.670+0000 7fc720ea1700 1 -- 172.21.15.60:0/7070229 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2672052807 0 0) 0x7fc71c0ba720 con 0x7fc71c141780 2023-07-12T02:02:19.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.670+0000 7fc7226a4700 1 -- 172.21.15.60:0/7070229 >> v1:172.21.15.79:6789/0 conn(0x7fc71c141780 legacy=0x7fc71c0ba010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.670+0000 7fc7226a4700 1 -- 172.21.15.60:0/7070229 >> v1:172.21.15.60:6789/0 conn(0x7fc71c071a30 legacy=0x7fc71c14ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:19.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.670+0000 7fc7226a4700 1 -- 172.21.15.60:0/7070229 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc71c0b9b40 con 0x7fc71c0b96b0 2023-07-12T02:02:19.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.670+0000 7fc7226a4700 1 --2- 172.21.15.60:0/7070229 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc71c0b96b0 0x7fc71c069f30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc714009d90 tx=0x7fc71400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=367ed8c4a9983325 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.670+0000 7fc720ea1700 1 -- 172.21.15.60:0/7070229 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71400e070 con 0x7fc71c0b96b0 2023-07-12T02:02:19.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.668+0000 7fe7e862b700 1 -- 172.21.15.60:0/1124576047 wait complete. 2023-07-12T02:02:19.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.669+0000 7fe7e862b700 1 Processor -- start 2023-07-12T02:02:19.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.674+0000 7f43e2ffd700 1 -- 172.21.15.60:0/628016284 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f43e4057e80 con 0x7f43ec1573b0 2023-07-12T02:02:19.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.674+0000 7f3f68ff9700 1 -- 172.21.15.60:0/1390747024 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6400cea0 con 0x7f3f6c148950 2023-07-12T02:02:19.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.674+0000 7f3f68ff9700 1 -- 172.21.15.60:0/1390747024 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f6400a9e0 con 0x7f3f6c148950 2023-07-12T02:02:19.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.674+0000 7f3f68ff9700 1 -- 172.21.15.60:0/1390747024 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6400ad50 con 0x7f3f6c148950 2023-07-12T02:02:19.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.674+0000 7f3f72623700 1 -- 172.21.15.60:0/1390747024 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f6c146af0 con 0x7f3f6c148950 2023-07-12T02:02:19.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.674+0000 7f3f72623700 1 -- 172.21.15.60:0/1390747024 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f6c141290 con 0x7f3f6c148950 2023-07-12T02:02:19.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.675+0000 7fc720ea1700 1 -- 172.21.15.60:0/7070229 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc71400bb90 con 0x7fc71c0b96b0 2023-07-12T02:02:19.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.675+0000 7fc720ea1700 1 -- 172.21.15.60:0/7070229 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc714003a20 con 0x7fc71c0b96b0 2023-07-12T02:02:19.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.674+0000 7fe7e862b700 1 -- start start 2023-07-12T02:02:19.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.675+0000 7fe7e862b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7e00b8d90 0x7fe7e0147330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.675+0000 7fe7e862b700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe7e01449d0 0x7fe7e00b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.675+0000 7fe7e862b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7e006d6c0 0x7fe7e00b5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.675+0000 7fe7e862b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e0147870 con 0x7fe7e00b8d90 2023-07-12T02:02:19.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.675+0000 7fe7e862b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e006d230 con 0x7fe7e006d6c0 2023-07-12T02:02:19.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.675+0000 7fe7e862b700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e0149a90 con 0x7fe7e01449d0 2023-07-12T02:02:19.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.676+0000 7fe7e5bc6700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe7e01449d0 0x7fe7e00b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.676+0000 7fe7e6bc8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7e006d6c0 0x7fe7e00b5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.676+0000 7fe7e5bc6700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe7e01449d0 0x7fe7e00b49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.60:44710/0 (socket says 172.21.15.60:44710) 2023-07-12T02:02:19.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.676+0000 7fe7e5bc6700 1 -- 172.21.15.60:0/3753323214 learned_addr learned my addr 172.21.15.60:0/3753323214 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:19.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.676+0000 7fe7e6bc8700 1 -- 172.21.15.60:0/3753323214 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe7e01449d0 msgr2=0x7fe7e00b49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.676+0000 7fe7e6bc8700 1 --2- 172.21.15.60:0/3753323214 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe7e01449d0 0x7fe7e00b49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.676+0000 7fe7e6bc8700 1 -- 172.21.15.60:0/3753323214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7e00b8d90 msgr2=0x7fe7e0147330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.676+0000 7fe7e6bc8700 1 --2- 172.21.15.60:0/3753323214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7e00b8d90 0x7fe7e0147330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.676+0000 7fe7e6bc8700 1 -- 172.21.15.60:0/3753323214 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d8009a70 con 0x7fe7e006d6c0 2023-07-12T02:02:19.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.676+0000 7f3f72623700 1 -- 172.21.15.60:0/1390747024 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f4c0052f0 con 0x7f3f6c148950 2023-07-12T02:02:19.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.676+0000 7fe7e5bc6700 1 --2- 172.21.15.60:0/3753323214 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe7e01449d0 0x7fe7e00b49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:02:19.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.676+0000 7fe7e6bc8700 1 --2- 172.21.15.60:0/3753323214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7e006d6c0 0x7fe7e00b5e30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8015000 tx=0x7fe7d8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.677+0000 7fc724107700 1 -- 172.21.15.60:0/7070229 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc71c0b96b0 msgr2=0x7fc71c069f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.677+0000 7fc724107700 1 --2- 172.21.15.60:0/7070229 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc71c0b96b0 0x7fc71c069f30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc714009d90 tx=0x7fc71400b330 comp rx=0 tx=0).stop 2023-07-12T02:02:19.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.677+0000 7fc724107700 1 -- 172.21.15.60:0/7070229 shutdown_connections 2023-07-12T02:02:19.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.677+0000 7fc724107700 1 --2- 172.21.15.60:0/7070229 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc71c0b96b0 0x7fc71c069f30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.677+0000 7fc724107700 1 -- 172.21.15.60:0/7070229 >> 172.21.15.60:0/7070229 conn(0x7fc71c06d0e0 msgr2=0x7fc71c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:19.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.677+0000 7fc724107700 1 -- 172.21.15.60:0/7070229 shutdown_connections 2023-07-12T02:02:19.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.677+0000 7fc724107700 1 -- 172.21.15.60:0/7070229 wait complete. 2023-07-12T02:02:19.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.679+0000 7fc724107700 1 Processor -- start 2023-07-12T02:02:19.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.680+0000 7fc724107700 1 -- start start 2023-07-12T02:02:19.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.681+0000 7fc724107700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc71c071a30 0x7fc71c146be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.681+0000 7fc724107700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc71c0b96b0 0x7fc71c147690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.681+0000 7fc724107700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc71c141780 0x7fc71c1e4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.681+0000 7fc724107700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc71c145260 con 0x7fc71c0b96b0 2023-07-12T02:02:19.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.681+0000 7fc724107700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc71c144670 con 0x7fc71c141780 2023-07-12T02:02:19.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.681+0000 7fc724107700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc71c145f70 con 0x7fc71c071a30 2023-07-12T02:02:19.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.682+0000 7fc721ea3700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc71c071a30 0x7fc71c146be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.682+0000 7fc721ea3700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc71c071a30 0x7fc71c146be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.60:44724/0 (socket says 172.21.15.60:44724) 2023-07-12T02:02:19.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.682+0000 7fc721ea3700 1 -- 172.21.15.60:0/2470308481 learned_addr learned my addr 172.21.15.60:0/2470308481 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:19.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.682+0000 7fc721ea3700 1 -- 172.21.15.60:0/2470308481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc71c141780 msgr2=0x7fc71c1e4640 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-12T02:02:19.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.682+0000 7fc721ea3700 1 --2- 172.21.15.60:0/2470308481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc71c141780 0x7fc71c1e4640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.682+0000 7fc721ea3700 1 -- 172.21.15.60:0/2470308481 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc71c0b96b0 msgr2=0x7fc71c147690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:19.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.682+0000 7fc721ea3700 1 --2- 172.21.15.60:0/2470308481 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc71c0b96b0 0x7fc71c147690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:19.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.682+0000 7fc721ea3700 1 -- 172.21.15.60:0/2470308481 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc714009a70 con 0x7fc71c071a30 2023-07-12T02:02:19.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.682+0000 7fc721ea3700 1 --2- 172.21.15.60:0/2470308481 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc71c071a30 0x7fc71c146be0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc71800c550 tx=0x7fc71800c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.682+0000 7fc7127fc700 1 -- 172.21.15.60:0/2470308481 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc718004c80 con 0x7fc71c071a30 2023-07-12T02:02:19.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.682+0000 7fc7127fc700 1 -- 172.21.15.60:0/2470308481 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc718004e00 con 0x7fc71c071a30 2023-07-12T02:02:19.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.682+0000 7fc7127fc700 1 -- 172.21.15.60:0/2470308481 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc718007310 con 0x7fc71c071a30 2023-07-12T02:02:19.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.683+0000 7fc724107700 1 -- 172.21.15.60:0/2470308481 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc71c147bd0 con 0x7fc71c071a30 2023-07-12T02:02:19.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.683+0000 7fc724107700 1 -- 172.21.15.60:0/2470308481 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc71c1448c0 con 0x7fc71c071a30 2023-07-12T02:02:19.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.676+0000 7fe7d6ffd700 1 -- 172.21.15.60:0/3753323214 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d8012630 con 0x7fe7e006d6c0 2023-07-12T02:02:19.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.677+0000 7fe7d6ffd700 1 -- 172.21.15.60:0/3753323214 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d80127d0 con 0x7fe7e006d6c0 2023-07-12T02:02:19.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.677+0000 7fe7e862b700 1 -- 172.21.15.60:0/3753323214 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7e0149d30 con 0x7fe7e006d6c0 2023-07-12T02:02:19.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.677+0000 7fe7d6ffd700 1 -- 172.21.15.60:0/3753323214 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d8012b80 con 0x7fe7e006d6c0 2023-07-12T02:02:19.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.677+0000 7fe7e862b700 1 -- 172.21.15.60:0/3753323214 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7e00b4f10 con 0x7fe7e006d6c0 2023-07-12T02:02:19.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.679+0000 7fe7d6ffd700 1 -- 172.21.15.60:0/3753323214 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe7d8012ce0 con 0x7fe7e006d6c0 2023-07-12T02:02:19.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.679+0000 7fe7d6ffd700 1 --2- 172.21.15.60:0/3753323214 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fe7c406ace0 0x7fe7c406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.680+0000 7fe7d6ffd700 1 -- 172.21.15.60:0/3753323214 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe7d808b930 con 0x7fe7e006d6c0 2023-07-12T02:02:19.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.680+0000 7fe7e63c7700 1 --2- 172.21.15.60:0/3753323214 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fe7c406ace0 0x7fe7c406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.680+0000 7fe7e63c7700 1 --2- 172.21.15.60:0/3753323214 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fe7c406ace0 0x7fe7c406d190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc0015d0 tx=0x7fe7dc007ad0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.683+0000 7fe7e862b700 1 -- 172.21.15.60:0/3753323214 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7c80052f0 con 0x7fe7e006d6c0 2023-07-12T02:02:19.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.684+0000 7fc724107700 1 -- 172.21.15.60:0/2470308481 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc71c074360 con 0x7fc71c071a30 2023-07-12T02:02:19.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.685+0000 7fc7127fc700 1 -- 172.21.15.60:0/2470308481 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc718007470 con 0x7fc71c071a30 2023-07-12T02:02:19.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.685+0000 7fc7127fc700 1 --2- 172.21.15.60:0/2470308481 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc70006ace0 0x7fc70006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.685+0000 7fc7127fc700 1 -- 172.21.15.60:0/2470308481 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc718089130 con 0x7fc71c071a30 2023-07-12T02:02:19.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.686+0000 7fc7216a2700 1 --2- 172.21.15.60:0/2470308481 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc70006ace0 0x7fc70006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.686+0000 7fc7216a2700 1 --2- 172.21.15.60:0/2470308481 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc70006ace0 0x7fc70006d190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc71c13db30 tx=0x7fc70c007a20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:19.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.687+0000 7f3f68ff9700 1 -- 172.21.15.60:0/1390747024 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3f6401b3b0 con 0x7f3f6c148950 2023-07-12T02:02:19.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.687+0000 7f3f68ff9700 1 --2- 172.21.15.60:0/1390747024 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f3f5806adb0 0x7f3f5806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:19.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.687+0000 7f3f68ff9700 1 -- 172.21.15.60:0/1390747024 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3f64088e40 con 0x7f3f6c148950 2023-07-12T02:02:19.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.689+0000 7fe7d6ffd700 1 -- 172.21.15.60:0/3753323214 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fe7d8056a70 con 0x7fe7e006d6c0 2023-07-12T02:02:19.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.690+0000 7fc7127fc700 1 -- 172.21.15.60:0/2470308481 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fc718054270 con 0x7fc71c071a30 2023-07-12T02:02:19.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.696+0000 7f3f68ff9700 1 -- 172.21.15.60:0/1390747024 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f3f64053f80 con 0x7f3f6c148950 2023-07-12T02:02:19.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.700+0000 7f3f6bfff700 1 --2- 172.21.15.60:0/1390747024 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f3f5806adb0 0x7f3f5806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:19.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:19.755+0000 7f3f6bfff700 1 --2- 172.21.15.60:0/1390747024 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f3f5806adb0 0x7f3f5806d260 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c009710 tx=0x7f3f5c006c60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:20.038 INFO:teuthology.orchestra.run.smithi060.stdout:55834574854 2023-07-12T02:02:20.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.032+0000 7fdc11824700 1 -- 172.21.15.60:0/1931623299 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fdbec0055a0 con 0x7fdc0c06aa40 2023-07-12T02:02:20.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.033+0000 7fdbf3fff700 1 -- 172.21.15.60:0/1931623299 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdbfc006cc0 con 0x7fdc0c06aa40 2023-07-12T02:02:20.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.036+0000 7fdc11824700 1 -- 172.21.15.60:0/1931623299 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fdbf806ad60 msgr2=0x7fdbf806d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:20.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.036+0000 7fdc11824700 1 --2- 172.21.15.60:0/1931623299 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fdbf806ad60 0x7fdbf806d210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdc00006ac0 tx=0x7fdc00006a50 comp rx=0 tx=0).stop 2023-07-12T02:02:20.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.036+0000 7fdc11824700 1 -- 172.21.15.60:0/1931623299 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc0c06aa40 msgr2=0x7fdc0c0bcc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:20.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.036+0000 7fdc11824700 1 --2- 172.21.15.60:0/1931623299 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc0c06aa40 0x7fdc0c0bcc90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc0090b0 tx=0x7fdbfc004750 comp rx=0 tx=0).stop 2023-07-12T02:02:20.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.036+0000 7fdc11824700 1 -- 172.21.15.60:0/1931623299 shutdown_connections 2023-07-12T02:02:20.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.036+0000 7fdc11824700 1 --2- 172.21.15.60:0/1931623299 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fdbf806ad60 0x7fdbf806d210 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdc00006ac0 tx=0x7fdc00006a50 comp rx=0 tx=0).stop 2023-07-12T02:02:20.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.036+0000 7fdc11824700 1 --2- 172.21.15.60:0/1931623299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc0c0b93d0 0x7fdc0c070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:20.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.037+0000 7fdc11824700 1 --2- 172.21.15.60:0/1931623299 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc0c06aa40 0x7fdc0c0bcc90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:20.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.037+0000 7fdc11824700 1 --2- 172.21.15.60:0/1931623299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc0c0b8700 0x7fdc0c06ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:20.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.037+0000 7fdc11824700 1 -- 172.21.15.60:0/1931623299 >> 172.21.15.60:0/1931623299 conn(0x7fdc0c069f30 msgr2=0x7fdc0c13edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:20.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.037+0000 7fdc11824700 1 -- 172.21.15.60:0/1931623299 shutdown_connections 2023-07-12T02:02:20.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.037+0000 7fdc11824700 1 -- 172.21.15.60:0/1931623299 wait complete. 2023-07-12T02:02:20.059 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2023-07-12T02:02:20.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.072+0000 7f1c4c99f700 1 -- 172.21.15.60:0/2273996397 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1c48074360 con 0x7f1c48141780 2023-07-12T02:02:20.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.073+0000 7f1c36ffd700 1 -- 172.21.15.60:0/2273996397 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1c40019020 con 0x7f1c48141780 2023-07-12T02:02:20.076 INFO:teuthology.orchestra.run.smithi060.stdout:55834574852 2023-07-12T02:02:20.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.077+0000 7f1c4c99f700 1 -- 172.21.15.60:0/2273996397 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f1c2806ace0 msgr2=0x7f1c2806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:20.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.077+0000 7f1c4c99f700 1 --2- 172.21.15.60:0/2273996397 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f1c2806ace0 0x7f1c2806d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c00beb0 tx=0x7f1c3c01b040 comp rx=0 tx=0).stop 2023-07-12T02:02:20.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.077+0000 7f1c4c99f700 1 -- 172.21.15.60:0/2273996397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c48141780 msgr2=0x7f1c4813c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:20.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.077+0000 7f1c4c99f700 1 --2- 172.21.15.60:0/2273996397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c48141780 0x7f1c4813c2c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1c4000bb00 tx=0x7f1c4000be10 comp rx=0 tx=0).stop 2023-07-12T02:02:20.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.077+0000 7f1c4c99f700 1 -- 172.21.15.60:0/2273996397 shutdown_connections 2023-07-12T02:02:20.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.077+0000 7f1c4c99f700 1 --2- 172.21.15.60:0/2273996397 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f1c2806ace0 0x7f1c2806d190 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:20.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.077+0000 7f1c4c99f700 1 --2- 172.21.15.60:0/2273996397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c48141780 0x7f1c4813c2c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:20.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.077+0000 7f1c4c99f700 1 --2- 172.21.15.60:0/2273996397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c48071a30 0x7f1c48148df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:20.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.077+0000 7f1c4c99f700 1 --2- 172.21.15.60:0/2273996397 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c480b96b0 0x7f1c4813bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:20.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.077+0000 7f1c4c99f700 1 -- 172.21.15.60:0/2273996397 >> 172.21.15.60:0/2273996397 conn(0x7f1c4806d0e0 msgr2=0x7f1c4813f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:20.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.077+0000 7f1c4c99f700 1 -- 172.21.15.60:0/2273996397 shutdown_connections 2023-07-12T02:02:20.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.077+0000 7f1c4c99f700 1 -- 172.21.15.60:0/2273996397 wait complete. 2023-07-12T02:02:20.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.078+0000 7f6eb872d700 1 -- 172.21.15.60:0/3729472854 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f6eb01571c0 con 0x7f6eb0153850 2023-07-12T02:02:20.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.079+0000 7f0d41ccb700 1 -- 172.21.15.60:0/2696085302 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0d3c0b7e10 con 0x7f0d3c0b4810 2023-07-12T02:02:20.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.079+0000 7f6ea6ffd700 1 -- 172.21.15.60:0/3729472854 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6ea8057910 con 0x7f6eb0153850 2023-07-12T02:02:20.083 INFO:teuthology.orchestra.run.smithi060.stdout:55834574853 2023-07-12T02:02:20.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.079+0000 7f43f45ca700 1 -- 172.21.15.60:0/628016284 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f43d00058a0 con 0x7f43ec1573b0 2023-07-12T02:02:20.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.079+0000 7f0d23fff700 1 -- 172.21.15.60:0/2696085302 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0d3c0b7e10 con 0x7f0d3c0b4810 2023-07-12T02:02:20.086 INFO:teuthology.orchestra.run.smithi060.stdout:55834574853 2023-07-12T02:02:20.086 INFO:teuthology.orchestra.run.smithi060.stdout:55834574853 2023-07-12T02:02:20.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.081+0000 7f6eb872d700 1 -- 172.21.15.60:0/3729472854 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f6e9c06c7f0 msgr2=0x7f6e9c06eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:20.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.081+0000 7f6eb872d700 1 --2- 172.21.15.60:0/3729472854 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f6e9c06c7f0 0x7f6e9c06eca0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6eac00c010 tx=0x7f6eac010000 comp rx=0 tx=0).stop 2023-07-12T02:02:20.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.081+0000 7f6eb872d700 1 -- 172.21.15.60:0/3729472854 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6eb0153850 msgr2=0x7f6eb01ef890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:20.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.081+0000 7f6eb872d700 1 --2- 172.21.15.60:0/3729472854 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6eb0153850 0x7f6eb01ef890 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6ea8009ba0 tx=0x7f6ea8009f60 comp rx=0 tx=0).stop 2023-07-12T02:02:20.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.082+0000 7f6eb872d700 1 -- 172.21.15.60:0/3729472854 shutdown_connections 2023-07-12T02:02:20.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.082+0000 7f6eb872d700 1 --2- 172.21.15.60:0/3729472854 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f6e9c06c7f0 0x7f6e9c06eca0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:20.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.082+0000 7f6eb872d700 1 --2- 172.21.15.60:0/3729472854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6eb01efdd0 0x7f6eb0159530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:20.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.082+0000 7f6eb872d700 1 --2- 172.21.15.60:0/3729472854 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6e9c007e10 0x7f6eb00bbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:20.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.082+0000 7f6eb872d700 1 --2- 172.21.15.60:0/3729472854 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6eb0153850 0x7f6eb01ef890 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6ea8009ba0 tx=0x7f6ea8009f60 comp rx=0 tx=0).stop 2023-07-12T02:02:20.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.082+0000 7f6eb872d700 1 -- 172.21.15.60:0/3729472854 >> 172.21.15.60:0/3729472854 conn(0x7f6eb0069f30 msgr2=0x7f6eb0086890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:20.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.083+0000 7f0d41ccb700 1 -- 172.21.15.60:0/2696085302 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f0d2806ace0 msgr2=0x7f0d2806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:20.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.083+0000 7f0d41ccb700 1 --2- 172.21.15.60:0/2696085302 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f0d2806ace0 0x7f0d2806d190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c145e00 tx=0x7f0d30009040 comp rx=0 tx=0).stop 2023-07-12T02:02:20.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.083+0000 7f0d41ccb700 1 -- 172.21.15.60:0/2696085302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d3c0b4810 msgr2=0x7f0d3c1d91e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:20.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.083+0000 7f0d41ccb700 1 --2- 172.21.15.60:0/2696085302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d3c0b4810 0x7f0d3c1d91e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c00c520 tx=0x7f0d2c00c8e0 comp rx=0 tx=0).stop 2023-07-12T02:02:20.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.083+0000 7f6eb872d700 1 -- 172.21.15.60:0/3729472854 shutdown_connections 2023-07-12T02:02:20.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.084+0000 7f0d41ccb700 1 -- 172.21.15.60:0/2696085302 shutdown_connections 2023-07-12T02:02:20.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.084+0000 7f0d41ccb700 1 --2- 172.21.15.60:0/2696085302 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f0d2806ace0 0x7f0d2806d190 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:20.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.084+0000 7f0d41ccb700 1 --2- 172.21.15.60:0/2696085302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d3c0b4810 0x7f0d3c1d91e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:20.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.084+0000 7f0d41ccb700 1 --2- 172.21.15.60:0/2696085302 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d3c152040 0x7f0d3c144fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:20.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.084+0000 7f0d41ccb700 1 --2- 172.21.15.60:0/2696085302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d3c148e60 0x7f0d3c0bb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:20.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.084+0000 7f0d41ccb700 1 -- 172.21.15.60:0/2696085302 >> 172.21.15.60:0/2696085302 conn(0x7f0d3c069f30 msgr2=0x7f0d3c141ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:20.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.084+0000 7f0d41ccb700 1 -- 172.21.15.60:0/2696085302 shutdown_connections 2023-07-12T02:02:20.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.084+0000 7f0d41ccb700 1 -- 172.21.15.60:0/2696085302 wait complete. 2023-07-12T02:02:20.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.082+0000 7f43e2ffd700 1 -- 172.21.15.60:0/628016284 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f43e4057a10 con 0x7f43ec1573b0 2023-07-12T02:02:20.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.084+0000 7f6eb872d700 1 -- 172.21.15.60:0/3729472854 wait complete. 2023-07-12T02:02:20.095 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:02:20.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.093+0000 7f43f45ca700 1 -- 172.21.15.60:0/628016284 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f43d806ae30 msgr2=0x7f43d806d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:20.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.093+0000 7f43f45ca700 1 --2- 172.21.15.60:0/628016284 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f43d806ae30 0x7f43d806d2e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f43dc007fd0 tx=0x7f43dc009040 comp rx=0 tx=0).stop 2023-07-12T02:02:20.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.093+0000 7f43f45ca700 1 -- 172.21.15.60:0/628016284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43ec1573b0 msgr2=0x7f43ec147790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:20.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.093+0000 7f43f45ca700 1 --2- 172.21.15.60:0/628016284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43ec1573b0 0x7f43ec147790 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f43e400ca80 tx=0x7f43e400cd90 comp rx=0 tx=0).stop 2023-07-12T02:02:20.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.092+0000 7fc724107700 1 -- 172.21.15.60:0/2470308481 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fc71c0b9490 con 0x7fc71c071a30 2023-07-12T02:02:20.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.093+0000 7fc7127fc700 1 -- 172.21.15.60:0/2470308481 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc718057890 con 0x7fc71c071a30 2023-07-12T02:02:20.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.093+0000 7f43f45ca700 1 -- 172.21.15.60:0/628016284 shutdown_connections 2023-07-12T02:02:20.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.093+0000 7f43f45ca700 1 --2- 172.21.15.60:0/628016284 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f43d806ae30 0x7f43d806d2e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:20.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.093+0000 7f43f45ca700 1 --2- 172.21.15.60:0/628016284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43ec1573b0 0x7f43ec147790 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:20.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.093+0000 7f43f45ca700 1 --2- 172.21.15.60:0/628016284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43ec0bb270 0x7f43ec0ba1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:20.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.093+0000 7f43f45ca700 1 --2- 172.21.15.60:0/628016284 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f43ec152210 0x7f43ec0b91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:20.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.093+0000 7f43f45ca700 1 -- 172.21.15.60:0/628016284 >> 172.21.15.60:0/628016284 conn(0x7f43ec0c08f0 msgr2=0x7f43ec148df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:20.098 INFO:teuthology.orchestra.run.smithi060.stdout:55834574852 2023-07-12T02:02:20.099 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:02:20.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.093+0000 7f43f45ca700 1 -- 172.21.15.60:0/628016284 shutdown_connections 2023-07-12T02:02:20.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.094+0000 7f43f45ca700 1 -- 172.21.15.60:0/628016284 wait complete. 2023-07-12T02:02:20.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.096+0000 7f3f72623700 1 -- 172.21.15.60:0/1390747024 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3f4c0055a0 con 0x7f3f6c148950 2023-07-12T02:02:20.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.097+0000 7fc724107700 1 -- 172.21.15.60:0/2470308481 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc70006ace0 msgr2=0x7fc70006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:20.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.097+0000 7fc724107700 1 --2- 172.21.15.60:0/2470308481 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc70006ace0 0x7fc70006d190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc71c13db30 tx=0x7fc70c007a20 comp rx=0 tx=0).stop 2023-07-12T02:02:20.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.097+0000 7fc724107700 1 -- 172.21.15.60:0/2470308481 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc71c071a30 msgr2=0x7fc71c146be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:20.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.097+0000 7fc724107700 1 --2- 172.21.15.60:0/2470308481 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc71c071a30 0x7fc71c146be0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc71800c550 tx=0x7fc71800c910 comp rx=0 tx=0).stop 2023-07-12T02:02:20.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.097+0000 7fc724107700 1 -- 172.21.15.60:0/2470308481 shutdown_connections 2023-07-12T02:02:20.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.097+0000 7fc724107700 1 --2- 172.21.15.60:0/2470308481 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc70006ace0 0x7fc70006d190 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:20.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.097+0000 7fc724107700 1 --2- 172.21.15.60:0/2470308481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc71c141780 0x7fc71c1e4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:20.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.097+0000 7fc724107700 1 --2- 172.21.15.60:0/2470308481 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc71c071a30 0x7fc71c146be0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:20.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.097+0000 7fc724107700 1 --2- 172.21.15.60:0/2470308481 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc71c0b96b0 0x7fc71c147690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:20.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.097+0000 7fc724107700 1 -- 172.21.15.60:0/2470308481 >> 172.21.15.60:0/2470308481 conn(0x7fc71c06d0e0 msgr2=0x7fc71c0b8980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:20.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.097+0000 7fc724107700 1 -- 172.21.15.60:0/2470308481 shutdown_connections 2023-07-12T02:02:20.102 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.097+0000 7fc724107700 1 -- 172.21.15.60:0/2470308481 wait complete. 2023-07-12T02:02:20.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.098+0000 7f3f68ff9700 1 -- 172.21.15.60:0/1390747024 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3f640575a0 con 0x7f3f6c148950 2023-07-12T02:02:20.103 INFO:teuthology.orchestra.run.smithi060.stdout:55834574853 2023-07-12T02:02:20.104 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.5 2023-07-12T02:02:20.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.101+0000 7f3f72623700 1 -- 172.21.15.60:0/1390747024 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f3f5806adb0 msgr2=0x7f3f5806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:20.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.101+0000 7f3f72623700 1 --2- 172.21.15.60:0/1390747024 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f3f5806adb0 0x7f3f5806d260 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c009710 tx=0x7f3f5c006c60 comp rx=0 tx=0).stop 2023-07-12T02:02:20.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.101+0000 7f3f72623700 1 -- 172.21.15.60:0/1390747024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f6c148950 msgr2=0x7f3f6c13ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:20.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.101+0000 7f3f72623700 1 --2- 172.21.15.60:0/1390747024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f6c148950 0x7f3f6c13ead0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3f6400ca70 tx=0x7f3f6400cd80 comp rx=0 tx=0).stop 2023-07-12T02:02:20.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.101+0000 7f3f72623700 1 -- 172.21.15.60:0/1390747024 shutdown_connections 2023-07-12T02:02:20.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.101+0000 7f3f72623700 1 --2- 172.21.15.60:0/1390747024 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f3f5806adb0 0x7f3f5806d260 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:20.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.101+0000 7f3f72623700 1 --2- 172.21.15.60:0/1390747024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f6c148950 0x7f3f6c13ead0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:20.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.101+0000 7f3f72623700 1 --2- 172.21.15.60:0/1390747024 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3f6c0b3ad0 0x7f3f6c1511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:20.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.101+0000 7f3f72623700 1 --2- 172.21.15.60:0/1390747024 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f6c0b4670 0x7f3f6c13fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:20.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.101+0000 7f3f72623700 1 -- 172.21.15.60:0/1390747024 >> 172.21.15.60:0/1390747024 conn(0x7f3f6c069f30 msgr2=0x7f3f6c0b6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:20.106 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-07-12T02:02:20.107 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:02:20.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.104+0000 7f3f72623700 1 -- 172.21.15.60:0/1390747024 shutdown_connections 2023-07-12T02:02:20.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.104+0000 7f3f72623700 1 -- 172.21.15.60:0/1390747024 wait complete. 2023-07-12T02:02:20.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.107+0000 7fe7e862b700 1 -- 172.21.15.60:0/3753323214 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe7c8005870 con 0x7fe7e006d6c0 2023-07-12T02:02:20.112 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2023-07-12T02:02:20.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.109+0000 7fe7d6ffd700 1 -- 172.21.15.60:0/3753323214 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe7d802a070 con 0x7fe7e006d6c0 2023-07-12T02:02:20.113 INFO:teuthology.orchestra.run.smithi060.stdout:55834574851 2023-07-12T02:02:20.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.112+0000 7fe7e862b700 1 -- 172.21.15.60:0/3753323214 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fe7c406ace0 msgr2=0x7fe7c406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:20.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.112+0000 7fe7e862b700 1 --2- 172.21.15.60:0/3753323214 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fe7c406ace0 0x7fe7c406d190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc0015d0 tx=0x7fe7dc007ad0 comp rx=0 tx=0).stop 2023-07-12T02:02:20.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.112+0000 7fe7e862b700 1 -- 172.21.15.60:0/3753323214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7e006d6c0 msgr2=0x7fe7e00b5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:20.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.112+0000 7fe7e862b700 1 --2- 172.21.15.60:0/3753323214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7e006d6c0 0x7fe7e00b5e30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8015000 tx=0x7fe7d8004ad0 comp rx=0 tx=0).stop 2023-07-12T02:02:20.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.113+0000 7fe7e862b700 1 -- 172.21.15.60:0/3753323214 shutdown_connections 2023-07-12T02:02:20.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.113+0000 7fe7e862b700 1 --2- 172.21.15.60:0/3753323214 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fe7c406ace0 0x7fe7c406d190 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:20.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.113+0000 7fe7e862b700 1 --2- 172.21.15.60:0/3753323214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7e00b8d90 0x7fe7e0147330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:20.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.113+0000 7fe7e862b700 1 --2- 172.21.15.60:0/3753323214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7e006d6c0 0x7fe7e00b5e30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:20.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.113+0000 7fe7e862b700 1 --2- 172.21.15.60:0/3753323214 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe7e01449d0 0x7fe7e00b49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:20.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.113+0000 7fe7e862b700 1 -- 172.21.15.60:0/3753323214 >> 172.21.15.60:0/3753323214 conn(0x7fe7e00c0860 msgr2=0x7fe7e00bae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:20.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.113+0000 7fe7e862b700 1 -- 172.21.15.60:0/3753323214 shutdown_connections 2023-07-12T02:02:20.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:20.113+0000 7fe7e862b700 1 -- 172.21.15.60:0/3753323214 wait complete. 2023-07-12T02:02:20.126 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2023-07-12T02:02:20.128 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2023-07-12T02:02:20.129 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-07-12T02:02:20.133 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.2 2023-07-12T02:02:21.060 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-12T02:02:21.105 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-12T02:02:21.107 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-12T02:02:21.113 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-12T02:02:21.127 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-12T02:02:21.129 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-12T02:02:21.130 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-12T02:02:21.134 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-12T02:02:21.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.252+0000 7f4658159700 1 Processor -- start 2023-07-12T02:02:21.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.256+0000 7f4658159700 1 -- start start 2023-07-12T02:02:21.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.257+0000 7f4658159700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46501467d0 0x7f4650146c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.257+0000 7f4658159700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46500b4210 con 0x7f46500b93d0 2023-07-12T02:02:21.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.257+0000 7f4658159700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46500b46f0 con 0x7f465006aa40 2023-07-12T02:02:21.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.257+0000 7f4658159700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46501471b0 con 0x7f46501467d0 2023-07-12T02:02:21.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.258+0000 7f46566f6700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46501467d0 0x7f4650146c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:21.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.258+0000 7f46566f6700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46501467d0 0x7f4650146c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.60:44730/0 (socket says 172.21.15.60:44730) 2023-07-12T02:02:21.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.258+0000 7f46566f6700 1 -- 172.21.15.60:0/165197393 learned_addr learned my addr 172.21.15.60:0/165197393 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:21.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.258+0000 7f46566f6700 1 -- 172.21.15.60:0/165197393 >> v1:172.21.15.79:6789/0 conn(0x7f465006aa40 legacy=0x7f46500b3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:21.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.258+0000 7f46566f6700 1 -- 172.21.15.60:0/165197393 >> v1:172.21.15.60:6789/0 conn(0x7f46500b93d0 legacy=0x7f46500b8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:21.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.258+0000 7f46566f6700 1 -- 172.21.15.60:0/165197393 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46500b8c30 con 0x7f46501467d0 2023-07-12T02:02:21.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.259+0000 7f46566f6700 1 --2- 172.21.15.60:0/165197393 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46501467d0 0x7f4650146c70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4648009e80 tx=0x7f464800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4632d9e8503603aa server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:21.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.259+0000 7f4654ef3700 1 -- 172.21.15.60:0/165197393 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464800e070 con 0x7f46501467d0 2023-07-12T02:02:21.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.259+0000 7f4654ef3700 1 -- 172.21.15.60:0/165197393 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4648003a20 con 0x7f46501467d0 2023-07-12T02:02:21.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.259+0000 7f4654ef3700 1 -- 172.21.15.60:0/165197393 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4648003dd0 con 0x7f46501467d0 2023-07-12T02:02:21.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.260+0000 7f4658159700 1 -- 172.21.15.60:0/165197393 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46501467d0 msgr2=0x7f4650146c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:21.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.260+0000 7f4658159700 1 --2- 172.21.15.60:0/165197393 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46501467d0 0x7f4650146c70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4648009e80 tx=0x7f464800b330 comp rx=0 tx=0).stop 2023-07-12T02:02:21.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.260+0000 7f4658159700 1 -- 172.21.15.60:0/165197393 shutdown_connections 2023-07-12T02:02:21.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.260+0000 7f4658159700 1 --2- 172.21.15.60:0/165197393 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46501467d0 0x7f4650146c70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.260+0000 7f4658159700 1 -- 172.21.15.60:0/165197393 >> 172.21.15.60:0/165197393 conn(0x7f4650069f30 msgr2=0x7f465006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:21.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.261+0000 7f4658159700 1 -- 172.21.15.60:0/165197393 shutdown_connections 2023-07-12T02:02:21.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.261+0000 7f4658159700 1 -- 172.21.15.60:0/165197393 wait complete. 2023-07-12T02:02:21.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.262+0000 7f4658159700 1 Processor -- start 2023-07-12T02:02:21.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.263+0000 7f4658159700 1 -- start start 2023-07-12T02:02:21.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.264+0000 7f4658159700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f465006aa40 0x7f465006f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.264+0000 7f4658159700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46500b93d0 0x7f465006ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.264+0000 7f4658159700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46501467d0 0x7f46501ed090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.264+0000 7f4658159700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465006f640 con 0x7f465006aa40 2023-07-12T02:02:21.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.264+0000 7f4658159700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46501ecc00 con 0x7f46501467d0 2023-07-12T02:02:21.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.264+0000 7f4658159700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4650070510 con 0x7f46500b93d0 2023-07-12T02:02:21.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.265+0000 7f46566f6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46501467d0 0x7f46501ed090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:21.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.265+0000 7f46566f6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46501467d0 0x7f46501ed090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.60:43450/0 (socket says 172.21.15.60:43450) 2023-07-12T02:02:21.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.265+0000 7f46566f6700 1 -- 172.21.15.60:0/1734074379 learned_addr learned my addr 172.21.15.60:0/1734074379 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:21.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.265+0000 7f46556f4700 1 --2- 172.21.15.60:0/1734074379 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46500b93d0 0x7f465006ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:21.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.265+0000 7f4655ef5700 1 --2- 172.21.15.60:0/1734074379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f465006aa40 0x7f465006f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:21.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.266+0000 7f4655ef5700 1 -- 172.21.15.60:0/1734074379 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46500b93d0 msgr2=0x7f465006ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:21.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.266+0000 7f4655ef5700 1 --2- 172.21.15.60:0/1734074379 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46500b93d0 0x7f465006ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.266+0000 7f4655ef5700 1 -- 172.21.15.60:0/1734074379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46501467d0 msgr2=0x7f46501ed090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:21.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.266+0000 7f4655ef5700 1 --2- 172.21.15.60:0/1734074379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46501467d0 0x7f46501ed090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.266+0000 7f4655ef5700 1 -- 172.21.15.60:0/1734074379 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4648009b30 con 0x7f465006aa40 2023-07-12T02:02:21.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.266+0000 7f4655ef5700 1 --2- 172.21.15.60:0/1734074379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f465006aa40 0x7f465006f100 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f464c00c4d0 tx=0x7f464c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:21.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.267+0000 7f46467fc700 1 -- 172.21.15.60:0/1734074379 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464c0052d0 con 0x7f465006aa40 2023-07-12T02:02:21.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.267+0000 7f46467fc700 1 -- 172.21.15.60:0/1734074379 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464c005430 con 0x7f465006aa40 2023-07-12T02:02:21.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.267+0000 7f46467fc700 1 -- 172.21.15.60:0/1734074379 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464c003880 con 0x7f465006aa40 2023-07-12T02:02:21.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.268+0000 7f4658159700 1 -- 172.21.15.60:0/1734074379 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f465013aa30 con 0x7f465006aa40 2023-07-12T02:02:21.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.268+0000 7f4658159700 1 -- 172.21.15.60:0/1734074379 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f465006ebc0 con 0x7f465006aa40 2023-07-12T02:02:21.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.271+0000 7f46467fc700 1 -- 172.21.15.60:0/1734074379 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f464c0039e0 con 0x7f465006aa40 2023-07-12T02:02:21.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.272+0000 7f46467fc700 1 --2- 172.21.15.60:0/1734074379 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f463406adb0 0x7f463406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.272+0000 7f46467fc700 1 -- 172.21.15.60:0/1734074379 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f464c088770 con 0x7f465006aa40 2023-07-12T02:02:21.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.272+0000 7f4658159700 1 -- 172.21.15.60:0/1734074379 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46500b4000 con 0x7f465006aa40 2023-07-12T02:02:21.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.282+0000 7f46467fc700 1 -- 172.21.15.60:0/1734074379 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f464c053940 con 0x7f465006aa40 2023-07-12T02:02:21.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.283+0000 7f46556f4700 1 --2- 172.21.15.60:0/1734074379 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f463406adb0 0x7f463406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:21.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.284+0000 7f46556f4700 1 --2- 172.21.15.60:0/1734074379 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f463406adb0 0x7f463406d260 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f465006e6a0 tx=0x7f4640009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:21.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.316+0000 7f3de46d8700 1 Processor -- start 2023-07-12T02:02:21.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.316+0000 7f3de46d8700 1 -- start start 2023-07-12T02:02:21.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.318+0000 7f3de46d8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3ddc0b8700 0x7f3ddc0b3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.318+0000 7f3de46d8700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ddc0b46f0 con 0x7f3ddc146ee0 2023-07-12T02:02:21.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.318+0000 7f3de46d8700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ddc0b4940 con 0x7f3ddc0b93d0 2023-07-12T02:02:21.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.318+0000 7f3de46d8700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ddc0b4c20 con 0x7f3ddc0b8700 2023-07-12T02:02:21.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.318+0000 7f3de2474700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3ddc0b8700 0x7f3ddc0b3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:21.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.318+0000 7f3de1c73700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f3ddc0b93d0 0x7f3ddc1467d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.60:58010/0 (socket says 172.21.15.60:58010) 2023-07-12T02:02:21.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.318+0000 7f3de1c73700 1 -- 172.21.15.60:0/820487809 learned_addr learned my addr 172.21.15.60:0/820487809 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:21.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.319+0000 7f3de1472700 1 -- 172.21.15.60:0/820487809 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1192263107 0 0) 0x7f3ddc0b46f0 con 0x7f3ddc146ee0 2023-07-12T02:02:21.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.319+0000 7f3de1472700 1 -- 172.21.15.60:0/820487809 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dc80035b0 con 0x7f3ddc146ee0 2023-07-12T02:02:21.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.320+0000 7f3de1472700 1 -- 172.21.15.60:0/820487809 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2111514954 0 0) 0x7f3dc80035b0 con 0x7f3ddc146ee0 2023-07-12T02:02:21.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.320+0000 7f3de1472700 1 -- 172.21.15.60:0/820487809 >> v2:172.21.15.79:3300/0 conn(0x7f3ddc0b8700 msgr2=0x7f3ddc0b3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:21.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.320+0000 7f3de1472700 1 --2- 172.21.15.60:0/820487809 >> v2:172.21.15.79:3300/0 conn(0x7f3ddc0b8700 0x7f3ddc0b3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.320+0000 7f3de1472700 1 -- 172.21.15.60:0/820487809 >> v1:172.21.15.79:6789/0 conn(0x7f3ddc0b93d0 legacy=0x7f3ddc1467d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:21.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.320+0000 7f3de1472700 1 -- 172.21.15.60:0/820487809 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ddc0b4f00 con 0x7f3ddc146ee0 2023-07-12T02:02:21.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.320+0000 7f3de1472700 1 -- 172.21.15.60:0/820487809 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1141905739 0 0) 0x7f3dd40019f0 con 0x7f3ddc146ee0 2023-07-12T02:02:21.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.320+0000 7f3de1472700 1 -- 172.21.15.60:0/820487809 >> v1:172.21.15.60:6789/0 conn(0x7f3ddc146ee0 legacy=0x7f3ddc140240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:21.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.320+0000 7f3de1472700 1 --2- 172.21.15.60:0/820487809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3dc80037f0 0x7f3dc8003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.320+0000 7f3de1472700 1 --2- 172.21.15.60:0/820487809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dc8004170 0x7f3dc800b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.320+0000 7f3de1472700 1 --2- 172.21.15.60:0/820487809 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3dc800b690 0x7f3dc800db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.320+0000 7f3de1472700 1 -- 172.21.15.60:0/820487809 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc0b4c20 con 0x7f3dc8004170 2023-07-12T02:02:21.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.320+0000 7f3de1472700 1 -- 172.21.15.60:0/820487809 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc800e3e0 con 0x7f3dc80037f0 2023-07-12T02:02:21.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.320+0000 7f3de1472700 1 -- 172.21.15.60:0/820487809 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc800e5a0 con 0x7f3dc800b690 2023-07-12T02:02:21.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.321+0000 7f3de1c73700 1 --2- 172.21.15.60:0/820487809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dc8004170 0x7f3dc800b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:21.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.321+0000 7f3de1c73700 1 -- 172.21.15.60:0/820487809 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3dc800b690 msgr2=0x7f3dc800db10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-12T02:02:21.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.321+0000 7f3de1c73700 1 --2- 172.21.15.60:0/820487809 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3dc800b690 0x7f3dc800db10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.321+0000 7f3de1c73700 1 -- 172.21.15.60:0/820487809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3dc80037f0 msgr2=0x7f3dc8003be0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-12T02:02:21.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.321+0000 7f3de1c73700 1 --2- 172.21.15.60:0/820487809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3dc80037f0 0x7f3dc8003be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.321+0000 7f3de1c73700 1 -- 172.21.15.60:0/820487809 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ddc0b4f00 con 0x7f3dc8004170 2023-07-12T02:02:21.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.322+0000 7f3de1c73700 1 --2- 172.21.15.60:0/820487809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dc8004170 0x7f3dc800b0a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc004dd0 tx=0x7f3dc8004870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd0e0da01740108 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:21.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.322+0000 7f3de2c75700 1 -- 172.21.15.60:0/820487809 reap_dead start 2023-07-12T02:02:21.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.323+0000 7f3de1472700 1 -- 172.21.15.60:0/820487809 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc005b60 con 0x7f3dc8004170 2023-07-12T02:02:21.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.323+0000 7f3de1472700 1 -- 172.21.15.60:0/820487809 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dcc005cc0 con 0x7f3dc8004170 2023-07-12T02:02:21.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.323+0000 7f3de1472700 1 -- 172.21.15.60:0/820487809 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc0072d0 con 0x7f3dc8004170 2023-07-12T02:02:21.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.324+0000 7f3de46d8700 1 -- 172.21.15.60:0/820487809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dc8004170 msgr2=0x7f3dc800b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:21.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.324+0000 7f3de46d8700 1 --2- 172.21.15.60:0/820487809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dc8004170 0x7f3dc800b0a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc004dd0 tx=0x7f3dc8004870 comp rx=0 tx=0).stop 2023-07-12T02:02:21.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.325+0000 7f3de46d8700 1 -- 172.21.15.60:0/820487809 shutdown_connections 2023-07-12T02:02:21.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.325+0000 7f3de46d8700 1 --2- 172.21.15.60:0/820487809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dc8004170 0x7f3dc800b0a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.325+0000 7f3de46d8700 1 -- 172.21.15.60:0/820487809 >> 172.21.15.60:0/820487809 conn(0x7f3ddc069f30 msgr2=0x7f3ddc06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:21.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.327+0000 7f3de46d8700 1 -- 172.21.15.60:0/820487809 shutdown_connections 2023-07-12T02:02:21.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.328+0000 7f3de46d8700 1 -- 172.21.15.60:0/820487809 wait complete. 2023-07-12T02:02:21.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.329+0000 7f3de46d8700 1 Processor -- start 2023-07-12T02:02:21.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.330+0000 7f3de46d8700 1 -- start start 2023-07-12T02:02:21.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.331+0000 7f3de46d8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dc8004170 0x7f3ddc145890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.331+0000 7f3de46d8700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3ddc146390 0x7f3ddc142b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.331+0000 7f3de46d8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ddc143060 0x7f3ddc1f0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.331+0000 7f3de46d8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc145dd0 con 0x7f3dc8004170 2023-07-12T02:02:21.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.331+0000 7f3de46d8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc1ce090 con 0x7f3ddc143060 2023-07-12T02:02:21.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.331+0000 7f3de46d8700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc1f0130 con 0x7f3ddc146390 2023-07-12T02:02:21.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.332+0000 7f3de2c75700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ddc143060 0x7f3ddc1f0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:21.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.332+0000 7f3de2c75700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ddc143060 0x7f3ddc1f0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.60:43474/0 (socket says 172.21.15.60:43474) 2023-07-12T02:02:21.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.332+0000 7f3de2c75700 1 -- 172.21.15.60:0/3646571918 learned_addr learned my addr 172.21.15.60:0/3646571918 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:21.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.332+0000 7f3de1c73700 1 --2- 172.21.15.60:0/3646571918 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3ddc146390 0x7f3ddc142b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:21.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.333+0000 7f3de2474700 1 --2- 172.21.15.60:0/3646571918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dc8004170 0x7f3ddc145890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:21.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.334+0000 7f3de1c73700 1 -- 172.21.15.60:0/3646571918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ddc143060 msgr2=0x7f3ddc1f0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:21.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.334+0000 7f3de1c73700 1 --2- 172.21.15.60:0/3646571918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ddc143060 0x7f3ddc1f0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.334+0000 7f3de1c73700 1 -- 172.21.15.60:0/3646571918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dc8004170 msgr2=0x7f3ddc145890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:21.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.334+0000 7f3de1c73700 1 --2- 172.21.15.60:0/3646571918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dc8004170 0x7f3ddc145890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.334+0000 7f3de1c73700 1 -- 172.21.15.60:0/3646571918 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ddc143e30 con 0x7f3ddc146390 2023-07-12T02:02:21.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.334+0000 7f3de1c73700 1 --2- 172.21.15.60:0/3646571918 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3ddc146390 0x7f3ddc142b20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc0b9830 tx=0x7f3dcc004a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:21.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.343+0000 7f3dd2ffd700 1 -- 172.21.15.60:0/3646571918 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc005960 con 0x7f3ddc146390 2023-07-12T02:02:21.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.343+0000 7f3dd2ffd700 1 -- 172.21.15.60:0/3646571918 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dcc005ae0 con 0x7f3ddc146390 2023-07-12T02:02:21.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.343+0000 7f3dd2ffd700 1 -- 172.21.15.60:0/3646571918 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc011860 con 0x7f3ddc146390 2023-07-12T02:02:21.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.343+0000 7f3de46d8700 1 -- 172.21.15.60:0/3646571918 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ddc1440d0 con 0x7f3ddc146390 2023-07-12T02:02:21.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.343+0000 7f3de46d8700 1 -- 172.21.15.60:0/3646571918 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ddc1ccce0 con 0x7f3ddc146390 2023-07-12T02:02:21.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.348+0000 7f3dd2ffd700 1 -- 172.21.15.60:0/3646571918 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3dcc017020 con 0x7f3ddc146390 2023-07-12T02:02:21.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.349+0000 7f3dd2ffd700 1 --2- 172.21.15.60:0/3646571918 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f3dc006ad80 0x7f3dc006d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.349+0000 7f3dd2ffd700 1 -- 172.21.15.60:0/3646571918 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3dcc089240 con 0x7f3ddc146390 2023-07-12T02:02:21.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.350+0000 7f3de46d8700 1 -- 172.21.15.60:0/3646571918 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ddc0bcc00 con 0x7f3ddc146390 2023-07-12T02:02:21.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.351+0000 7f3de2474700 1 --2- 172.21.15.60:0/3646571918 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f3dc006ad80 0x7f3dc006d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:21.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.351+0000 7f3de2474700 1 --2- 172.21.15.60:0/3646571918 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f3dc006ad80 0x7f3dc006d230 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc063b00 tx=0x7f3dd8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:21.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.356+0000 7f3dd2ffd700 1 -- 172.21.15.60:0/3646571918 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f3dcc054360 con 0x7f3ddc146390 2023-07-12T02:02:21.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.365+0000 7fdb7a756700 1 Processor -- start 2023-07-12T02:02:21.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.365+0000 7fdb7a756700 1 -- start start 2023-07-12T02:02:21.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.366+0000 7fdb7a756700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdb74152040 0x7fdb74148750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.366+0000 7fdb7a756700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb740b3a20 con 0x7fdb740b4810 2023-07-12T02:02:21.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.366+0000 7fdb7a756700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb740b3d00 con 0x7fdb74148c90 2023-07-12T02:02:21.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.366+0000 7fdb7a756700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb740b3fe0 con 0x7fdb74152040 2023-07-12T02:02:21.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.367+0000 7fdb78cf3700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fdb74148c90 0x7fdb741593d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.60:58016/0 (socket says 172.21.15.60:58016) 2023-07-12T02:02:21.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.367+0000 7fdb78cf3700 1 -- 172.21.15.60:0/1280383606 learned_addr learned my addr 172.21.15.60:0/1280383606 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:21.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.367+0000 7fde02951700 1 Processor -- start 2023-07-12T02:02:21.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.367+0000 7fde02951700 1 -- start start 2023-07-12T02:02:21.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.367+0000 7fdb72ffd700 1 -- 172.21.15.60:0/1280383606 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 678132613 0 0) 0x7fdb740b3d00 con 0x7fdb74148c90 2023-07-12T02:02:21.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.367+0000 7fdb72ffd700 1 -- 172.21.15.60:0/1280383606 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb5c0035b0 con 0x7fdb74148c90 2023-07-12T02:02:21.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.367+0000 7fbe84531700 1 Processor -- start 2023-07-12T02:02:21.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.367+0000 7fbe84531700 1 -- start start 2023-07-12T02:02:21.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.368+0000 7fdb72ffd700 1 -- 172.21.15.60:0/1280383606 <== mon.1 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1989133009 0 0) 0x7fdb5c0035b0 con 0x7fdb74148c90 2023-07-12T02:02:21.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.368+0000 7fdb72ffd700 1 -- 172.21.15.60:0/1280383606 >> v2:172.21.15.60:3300/0 conn(0x7fdb74152040 msgr2=0x7fdb74148750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:21.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.368+0000 7fdb72ffd700 1 --2- 172.21.15.60:0/1280383606 >> v2:172.21.15.60:3300/0 conn(0x7fdb74152040 0x7fdb74148750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.368+0000 7fdb72ffd700 1 -- 172.21.15.60:0/1280383606 >> v1:172.21.15.60:6789/0 conn(0x7fdb740b4810 legacy=0x7fdb740b8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:21.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.368+0000 7fdb72ffd700 1 -- 172.21.15.60:0/1280383606 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb740b90a0 con 0x7fdb74148c90 2023-07-12T02:02:21.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.368+0000 7fdb72ffd700 1 -- 172.21.15.60:0/1280383606 <== mon.1 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1141905739 0 0) 0x7fdb6c0019f0 con 0x7fdb74148c90 2023-07-12T02:02:21.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.368+0000 7fdb72ffd700 1 -- 172.21.15.60:0/1280383606 >> v1:172.21.15.79:6789/0 conn(0x7fdb74148c90 legacy=0x7fdb741593d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:21.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.368+0000 7fdb72ffd700 1 --2- 172.21.15.60:0/1280383606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb5c003a00 0x7fdb5c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.368+0000 7fdb72ffd700 1 --2- 172.21.15.60:0/1280383606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb5c004850 0x7fdb5c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.368+0000 7fdb72ffd700 1 --2- 172.21.15.60:0/1280383606 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdb5c005320 0x7fdb5c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.368+0000 7fdb72ffd700 1 -- 172.21.15.60:0/1280383606 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb740b3fe0 con 0x7fdb5c004850 2023-07-12T02:02:21.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.368+0000 7fdb72ffd700 1 -- 172.21.15.60:0/1280383606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5c00c1e0 con 0x7fdb5c003a00 2023-07-12T02:02:21.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.368+0000 7fdb72ffd700 1 -- 172.21.15.60:0/1280383606 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5c00c3a0 con 0x7fdb5c005320 2023-07-12T02:02:21.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.368+0000 7fdb73fff700 1 --2- 172.21.15.60:0/1280383606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb5c003a00 0x7fdb5c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:21.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.368+0000 7fde02951700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fddfc06b120 0x7fddfc0b9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.368+0000 7fde02951700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fddfc14f770 0x7fddfc1593d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.368+0000 7fde02951700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddfc06ef40 con 0x7fddfc14f320 2023-07-12T02:02:21.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.368+0000 7fde02951700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddfc06f220 con 0x7fddfc06b120 2023-07-12T02:02:21.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.368+0000 7fde02951700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc070300 con 0x7fddfc14f770 2023-07-12T02:02:21.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.368+0000 7fbe84531700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbe7c0bdcc0 0x7fbe7c0bc280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.368+0000 7fbe84531700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbe7c0bc7c0 0x7fbe7c159320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.368+0000 7fbe84531700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe7c0bab40 con 0x7fbe7c0ba620 2023-07-12T02:02:21.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.368+0000 7fbe84531700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe7c0ba260 con 0x7fbe7c0bdcc0 2023-07-12T02:02:21.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.368+0000 7fbe84531700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe7c0b9a60 con 0x7fbe7c0bc7c0 2023-07-12T02:02:21.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.369+0000 7fdb78cf3700 1 --2- 172.21.15.60:0/1280383606 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdb5c005320 0x7fdb5c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:21.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.369+0000 7fde00eee700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fddfc14f770 0x7fddfc1593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:21.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.369+0000 7fde00eee700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fddfc14f770 0x7fddfc1593d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.60:44760/0 (socket says 172.21.15.60:44760) 2023-07-12T02:02:21.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.369+0000 7fde00eee700 1 -- 172.21.15.60:0/2743976614 learned_addr learned my addr 172.21.15.60:0/2743976614 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:21.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.369+0000 7fbe82ace700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbe7c0bc7c0 0x7fbe7c159320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:21.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.369+0000 7fbe82ace700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbe7c0bc7c0 0x7fbe7c159320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.60:43492/0 (socket says 172.21.15.60:43492) 2023-07-12T02:02:21.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.369+0000 7fbe82ace700 1 -- 172.21.15.60:0/572785300 learned_addr learned my addr 172.21.15.60:0/572785300 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:21.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.369+0000 7fde00eee700 1 -- 172.21.15.60:0/2743976614 >> v2:172.21.15.60:3300/0 conn(0x7fddfc06b120 msgr2=0x7fddfc0b9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:21.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.369+0000 7fde00eee700 1 --2- 172.21.15.60:0/2743976614 >> v2:172.21.15.60:3300/0 conn(0x7fddfc06b120 0x7fddfc0b9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.369+0000 7fde00eee700 1 -- 172.21.15.60:0/2743976614 >> v1:172.21.15.60:6789/0 conn(0x7fddfc14f320 legacy=0x7fddfc070e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:21.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.369+0000 7fde00eee700 1 -- 172.21.15.60:0/2743976614 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddfc14eb50 con 0x7fddfc14f770 2023-07-12T02:02:21.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.370+0000 7fde00eee700 1 --2- 172.21.15.60:0/2743976614 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fddfc14f770 0x7fddfc1593d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fddf4009e50 tx=0x7fddf400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2608f365937cf3 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:21.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.370+0000 7fddfaffd700 1 -- 172.21.15.60:0/2743976614 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf400e070 con 0x7fddfc14f770 2023-07-12T02:02:21.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.370+0000 7fddfaffd700 1 -- 172.21.15.60:0/2743976614 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf4003a20 con 0x7fddfc14f770 2023-07-12T02:02:21.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.370+0000 7fddfaffd700 1 -- 172.21.15.60:0/2743976614 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf4003dd0 con 0x7fddfc14f770 2023-07-12T02:02:21.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.369+0000 7fdb73fff700 1 -- 172.21.15.60:0/1280383606 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdb5c005320 msgr2=0x7fdb5c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:21.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.369+0000 7fdb73fff700 1 --2- 172.21.15.60:0/1280383606 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdb5c005320 0x7fdb5c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.369+0000 7fdb73fff700 1 -- 172.21.15.60:0/1280383606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb5c004850 msgr2=0x7fdb5c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:21.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.369+0000 7fdb73fff700 1 --2- 172.21.15.60:0/1280383606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb5c004850 0x7fdb5c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.369+0000 7fdb73fff700 1 -- 172.21.15.60:0/1280383606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb740b90a0 con 0x7fdb5c003a00 2023-07-12T02:02:21.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.370+0000 7fdb78cf3700 1 -- 172.21.15.60:0/1280383606 reap_dead start 2023-07-12T02:02:21.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.370+0000 7fdb73fff700 1 --2- 172.21.15.60:0/1280383606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb5c003a00 0x7fdb5c003df0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdb680016c0 tx=0x7fdb5c005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d9fd47659f18ed server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:21.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.369+0000 7fbe822cd700 1 --2- 172.21.15.60:0/572785300 >> v2:172.21.15.60:3300/0 conn(0x7fbe7c0bdcc0 0x7fbe7c0bc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:21.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.370+0000 7fbe822cd700 1 -- 172.21.15.60:0/572785300 >> v2:172.21.15.79:3300/0 conn(0x7fbe7c0bc7c0 msgr2=0x7fbe7c159320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:21.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.370+0000 7fbe822cd700 1 --2- 172.21.15.60:0/572785300 >> v2:172.21.15.79:3300/0 conn(0x7fbe7c0bc7c0 0x7fbe7c159320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.370+0000 7fbe822cd700 1 -- 172.21.15.60:0/572785300 >> v1:172.21.15.60:6789/0 conn(0x7fbe7c0ba620 legacy=0x7fbe7c148420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:21.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.370+0000 7fbe822cd700 1 -- 172.21.15.60:0/572785300 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe7c0b9d40 con 0x7fbe7c0bdcc0 2023-07-12T02:02:21.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.370+0000 7fbe822cd700 1 --2- 172.21.15.60:0/572785300 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe7c0bdcc0 0x7fbe7c0bc280 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c0bd320 tx=0x7fbe78009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68f22b6b423a01d2 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:21.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.370+0000 7fbe812cb700 1 -- 172.21.15.60:0/572785300 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe78004230 con 0x7fbe7c0bdcc0 2023-07-12T02:02:21.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.370+0000 7fbe812cb700 1 -- 172.21.15.60:0/572785300 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe78004390 con 0x7fbe7c0bdcc0 2023-07-12T02:02:21.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.370+0000 7fbe812cb700 1 -- 172.21.15.60:0/572785300 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe780036a0 con 0x7fbe7c0bdcc0 2023-07-12T02:02:21.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.371+0000 7fde02951700 1 -- 172.21.15.60:0/2743976614 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fddfc14f770 msgr2=0x7fddfc1593d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:21.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.371+0000 7fde02951700 1 --2- 172.21.15.60:0/2743976614 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fddfc14f770 0x7fddfc1593d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fddf4009e50 tx=0x7fddf400b330 comp rx=0 tx=0).stop 2023-07-12T02:02:21.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.371+0000 7fbe84531700 1 -- 172.21.15.60:0/572785300 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe7c0bdcc0 msgr2=0x7fbe7c0bc280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:21.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.371+0000 7fbe84531700 1 --2- 172.21.15.60:0/572785300 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe7c0bdcc0 0x7fbe7c0bc280 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c0bd320 tx=0x7fbe78009b20 comp rx=0 tx=0).stop 2023-07-12T02:02:21.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.372+0000 7fbe84531700 1 -- 172.21.15.60:0/572785300 shutdown_connections 2023-07-12T02:02:21.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.372+0000 7fbe84531700 1 --2- 172.21.15.60:0/572785300 >> v2:172.21.15.79:3300/0 conn(0x7fbe7c0bc7c0 0x7fbe7c159320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.372+0000 7fbe84531700 1 --2- 172.21.15.60:0/572785300 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe7c0bdcc0 0x7fbe7c0bc280 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.372+0000 7fbe84531700 1 -- 172.21.15.60:0/572785300 >> 172.21.15.60:0/572785300 conn(0x7fbe7c0c1580 msgr2=0x7fbe7c0bd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:21.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.372+0000 7fdb72ffd700 1 -- 172.21.15.60:0/1280383606 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb680052d0 con 0x7fdb5c003a00 2023-07-12T02:02:21.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.372+0000 7fdb72ffd700 1 -- 172.21.15.60:0/1280383606 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb68005430 con 0x7fdb5c003a00 2023-07-12T02:02:21.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.372+0000 7fdb72ffd700 1 -- 172.21.15.60:0/1280383606 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb680038c0 con 0x7fdb5c003a00 2023-07-12T02:02:21.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.372+0000 7fde02951700 1 -- 172.21.15.60:0/2743976614 shutdown_connections 2023-07-12T02:02:21.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.372+0000 7fde02951700 1 --2- 172.21.15.60:0/2743976614 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fddfc14f770 0x7fddfc1593d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.372+0000 7fde02951700 1 --2- 172.21.15.60:0/2743976614 >> v2:172.21.15.60:3300/0 conn(0x7fddfc06b120 0x7fddfc0b9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.372+0000 7fde02951700 1 -- 172.21.15.60:0/2743976614 >> 172.21.15.60:0/2743976614 conn(0x7fddfc0bd980 msgr2=0x7fddfc0b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:21.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.373+0000 7fde02951700 1 -- 172.21.15.60:0/2743976614 shutdown_connections 2023-07-12T02:02:21.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.373+0000 7fbe84531700 1 -- 172.21.15.60:0/572785300 shutdown_connections 2023-07-12T02:02:21.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.373+0000 7fde02951700 1 -- 172.21.15.60:0/2743976614 wait complete. 2023-07-12T02:02:21.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.373+0000 7fdb7a756700 1 -- 172.21.15.60:0/1280383606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb5c003a00 msgr2=0x7fdb5c003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:21.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.373+0000 7fdb7a756700 1 --2- 172.21.15.60:0/1280383606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb5c003a00 0x7fdb5c003df0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdb680016c0 tx=0x7fdb5c005880 comp rx=0 tx=0).stop 2023-07-12T02:02:21.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.373+0000 7fbe84531700 1 -- 172.21.15.60:0/572785300 wait complete. 2023-07-12T02:02:21.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.374+0000 7fde02951700 1 Processor -- start 2023-07-12T02:02:21.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.375+0000 7fbe84531700 1 Processor -- start 2023-07-12T02:02:21.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.375+0000 7fde02951700 1 -- start start 2023-07-12T02:02:21.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.376+0000 7fde02951700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddfc06b120 0x7fddfc1e5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.376+0000 7fde02951700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fddfc14f320 0x7fddfc14c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.376+0000 7fde02951700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddfc14f770 0x7fddfc1d4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.376+0000 7fde02951700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc14c810 con 0x7fddfc14f770 2023-07-12T02:02:21.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.376+0000 7fde02951700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc149970 con 0x7fddfc06b120 2023-07-12T02:02:21.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.376+0000 7fde02951700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc1d5ab0 con 0x7fddfc14f320 2023-07-12T02:02:21.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.375+0000 7fbe84531700 1 -- start start 2023-07-12T02:02:21.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.376+0000 7fbe84531700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe7c0bc7c0 0x7fbe7c1d7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.376+0000 7fbe84531700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbe7c0bdcc0 0x7fbe7c06f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.376+0000 7fbe84531700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe7c06fa50 0x7fbe7c071540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.376+0000 7fbe84531700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c1d8360 con 0x7fbe7c0bc7c0 2023-07-12T02:02:21.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.376+0000 7fbe84531700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c1dab70 con 0x7fbe7c06fa50 2023-07-12T02:02:21.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.376+0000 7fbe84531700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c070a60 con 0x7fbe7c0bdcc0 2023-07-12T02:02:21.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.376+0000 7fbe82ace700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe7c06fa50 0x7fbe7c071540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:21.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.376+0000 7fbe82ace700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe7c06fa50 0x7fbe7c071540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.60:43520/0 (socket says 172.21.15.60:43520) 2023-07-12T02:02:21.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.376+0000 7fbe82ace700 1 -- 172.21.15.60:0/713414645 learned_addr learned my addr 172.21.15.60:0/713414645 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:21.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.377+0000 7fddfbfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddfc06b120 0x7fddfc1e5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:21.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.377+0000 7fde00eee700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddfc14f770 0x7fddfc1d4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:21.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.377+0000 7fde00eee700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddfc14f770 0x7fddfc1d4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50690/0 (socket says 172.21.15.60:50690) 2023-07-12T02:02:21.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.377+0000 7fde00eee700 1 -- 172.21.15.60:0/2540530046 learned_addr learned my addr 172.21.15.60:0/2540530046 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:21.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.377+0000 7fbe82ace700 1 -- 172.21.15.60:0/713414645 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbe7c0bdcc0 msgr2=0x7fbe7c06f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:21.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.377+0000 7fbe82ace700 1 --2- 172.21.15.60:0/713414645 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbe7c0bdcc0 0x7fbe7c06f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.377+0000 7fbe82ace700 1 -- 172.21.15.60:0/713414645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe7c0bc7c0 msgr2=0x7fbe7c1d7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:21.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.377+0000 7fbe82ace700 1 --2- 172.21.15.60:0/713414645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe7c0bc7c0 0x7fbe7c1d7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.377+0000 7fbe82ace700 1 -- 172.21.15.60:0/713414645 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe780094a0 con 0x7fbe7c06fa50 2023-07-12T02:02:21.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.377+0000 7fbe82ace700 1 --2- 172.21.15.60:0/713414645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe7c06fa50 0x7fbe7c071540 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbe7400efc0 tx=0x7fbe7400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:21.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.377+0000 7fdb7a756700 1 -- 172.21.15.60:0/1280383606 shutdown_connections 2023-07-12T02:02:21.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.377+0000 7fdb7a756700 1 --2- 172.21.15.60:0/1280383606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb5c003a00 0x7fdb5c003df0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.377+0000 7fdb7a756700 1 -- 172.21.15.60:0/1280383606 >> 172.21.15.60:0/1280383606 conn(0x7fdb74069f30 msgr2=0x7fdb7406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:21.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.377+0000 7fdb7a756700 1 -- 172.21.15.60:0/1280383606 shutdown_connections 2023-07-12T02:02:21.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.377+0000 7fddfb7fe700 1 --2- 172.21.15.60:0/2540530046 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fddfc14f320 0x7fddfc14c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:21.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.377+0000 7fde00eee700 1 -- 172.21.15.60:0/2540530046 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fddfc14f320 msgr2=0x7fddfc14c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:21.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.377+0000 7fde00eee700 1 --2- 172.21.15.60:0/2540530046 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fddfc14f320 0x7fddfc14c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.377+0000 7fde00eee700 1 -- 172.21.15.60:0/2540530046 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddfc06b120 msgr2=0x7fddfc1e5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:21.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.377+0000 7fde00eee700 1 --2- 172.21.15.60:0/2540530046 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddfc06b120 0x7fddfc1e5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.377+0000 7fde00eee700 1 -- 172.21.15.60:0/2540530046 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf4009b30 con 0x7fddfc14f770 2023-07-12T02:02:21.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.378+0000 7fddfb7fe700 1 --2- 172.21.15.60:0/2540530046 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fddfc14f320 0x7fddfc14c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:21.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.378+0000 7fde00eee700 1 --2- 172.21.15.60:0/2540530046 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddfc14f770 0x7fddfc1d4d70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fddf400b730 tx=0x7fddf4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:21.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.379+0000 7fddf8ff9700 1 -- 172.21.15.60:0/2540530046 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf4004440 con 0x7fddfc14f770 2023-07-12T02:02:21.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.378+0000 7fdb7a756700 1 -- 172.21.15.60:0/1280383606 wait complete. 2023-07-12T02:02:21.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.379+0000 7fdb7a756700 1 Processor -- start 2023-07-12T02:02:21.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.379+0000 7fde02951700 1 -- 172.21.15.60:0/2540530046 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddfc1e46a0 con 0x7fddfc14f770 2023-07-12T02:02:21.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.379+0000 7fde02951700 1 -- 172.21.15.60:0/2540530046 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddfc1e4c60 con 0x7fddfc14f770 2023-07-12T02:02:21.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.380+0000 7fddf8ff9700 1 -- 172.21.15.60:0/2540530046 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf40045a0 con 0x7fddfc14f770 2023-07-12T02:02:21.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.380+0000 7fddf8ff9700 1 -- 172.21.15.60:0/2540530046 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf4004950 con 0x7fddfc14f770 2023-07-12T02:02:21.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.380+0000 7fbe72ffd700 1 -- 172.21.15.60:0/713414645 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe74003c20 con 0x7fbe7c06fa50 2023-07-12T02:02:21.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.380+0000 7fbe72ffd700 1 -- 172.21.15.60:0/713414645 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe7400f040 con 0x7fbe7c06fa50 2023-07-12T02:02:21.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.380+0000 7fbe72ffd700 1 -- 172.21.15.60:0/713414645 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7400c930 con 0x7fbe7c06fa50 2023-07-12T02:02:21.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.380+0000 7fbe84531700 1 -- 172.21.15.60:0/713414645 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe7c070d40 con 0x7fbe7c06fa50 2023-07-12T02:02:21.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.380+0000 7fbe84531700 1 -- 172.21.15.60:0/713414645 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe7c072390 con 0x7fbe7c06fa50 2023-07-12T02:02:21.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.380+0000 7fdb7a756700 1 -- start start 2023-07-12T02:02:21.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.381+0000 7fdb7a756700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdb5c003a00 0x7fdb741dd540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.381+0000 7fdb7a756700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb741ed1f0 0x7fdb741e1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.381+0000 7fdb7a756700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb74150e60 0x7fdb741512d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.381+0000 7fdb7a756700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb741e2370 con 0x7fdb74150e60 2023-07-12T02:02:21.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.381+0000 7fdb7a756700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb741ed660 con 0x7fdb741ed1f0 2023-07-12T02:02:21.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.381+0000 7fdb7a756700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb741de660 con 0x7fdb5c003a00 2023-07-12T02:02:21.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.381+0000 7fbe84531700 1 -- 172.21.15.60:0/713414645 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe7c071260 con 0x7fbe7c06fa50 2023-07-12T02:02:21.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.382+0000 7fdb737fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb741ed1f0 0x7fdb741e1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:21.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.382+0000 7fdb737fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb741ed1f0 0x7fdb741e1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.60:43534/0 (socket says 172.21.15.60:43534) 2023-07-12T02:02:21.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.382+0000 7fdb737fe700 1 -- 172.21.15.60:0/1140135276 learned_addr learned my addr 172.21.15.60:0/1140135276 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:21.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.382+0000 7fdb78cf3700 1 --2- 172.21.15.60:0/1140135276 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb74150e60 0x7fdb741512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:21.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.382+0000 7fdb737fe700 1 -- 172.21.15.60:0/1140135276 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdb5c003a00 msgr2=0x7fdb741dd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:21.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.382+0000 7fdb737fe700 1 --2- 172.21.15.60:0/1140135276 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdb5c003a00 0x7fdb741dd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.382+0000 7fdb737fe700 1 -- 172.21.15.60:0/1140135276 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb74150e60 msgr2=0x7fdb741512d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:21.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.382+0000 7fdb737fe700 1 --2- 172.21.15.60:0/1140135276 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb74150e60 0x7fdb741512d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.382+0000 7fdb737fe700 1 -- 172.21.15.60:0/1140135276 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb74151910 con 0x7fdb741ed1f0 2023-07-12T02:02:21.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.382+0000 7fde02951700 1 -- 172.21.15.60:0/2540530046 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdddc0052f0 con 0x7fddfc14f770 2023-07-12T02:02:21.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.382+0000 7fddf8ff9700 1 -- 172.21.15.60:0/2540530046 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fddf4012430 con 0x7fddfc14f770 2023-07-12T02:02:21.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.383+0000 7fdb737fe700 1 --2- 172.21.15.60:0/1140135276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb741ed1f0 0x7fdb741e1e30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdb6400b7b0 tx=0x7fdb6400bb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:21.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.378+0000 7f49f6e78700 1 Processor -- start 2023-07-12T02:02:21.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.378+0000 7f49f6e78700 1 -- start start 2023-07-12T02:02:21.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.379+0000 7f49f6e78700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f49f00b4810 0x7f49f00b8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.379+0000 7f49f6e78700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49f0152040 0x7f49f0148750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.379+0000 7f49f6e78700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49f00b3a20 con 0x7f49f0152490 2023-07-12T02:02:21.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.379+0000 7f49f6e78700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49f00b3fe0 con 0x7f49f00b4810 2023-07-12T02:02:21.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.379+0000 7f49f6e78700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f00b55d0 con 0x7f49f0152040 2023-07-12T02:02:21.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.379+0000 7f49f5415700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f49f0152490 0x7f49f0148c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46152/0 (socket says 172.21.15.60:46152) 2023-07-12T02:02:21.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.380+0000 7f49f5415700 1 -- 172.21.15.60:0/734909750 learned_addr learned my addr 172.21.15.60:0/734909750 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:21.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.383+0000 7f49f4c14700 1 --2- 172.21.15.60:0/734909750 >> v2:172.21.15.60:3300/0 conn(0x7f49f00b4810 0x7f49f00b8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:21.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.383+0000 7f49ef7fe700 1 -- 172.21.15.60:0/734909750 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2130781991 0 0) 0x7f49f00b3a20 con 0x7f49f0152490 2023-07-12T02:02:21.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.383+0000 7f49ef7fe700 1 -- 172.21.15.60:0/734909750 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49d80035b0 con 0x7f49f0152490 2023-07-12T02:02:21.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.383+0000 7fddf8ff9700 1 --2- 172.21.15.60:0/2540530046 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fdde806ace0 0x7fdde806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.383+0000 7fddf8ff9700 1 -- 172.21.15.60:0/2540530046 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fddf408ac80 con 0x7fddfc14f770 2023-07-12T02:02:21.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.383+0000 7fddfbfff700 1 --2- 172.21.15.60:0/2540530046 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fdde806ace0 0x7fdde806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:21.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.383+0000 7f49effff700 1 --2- 172.21.15.60:0/734909750 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49f0152040 0x7f49f0148750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:21.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.383+0000 7f49ef7fe700 1 -- 172.21.15.60:0/734909750 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 823513751 0 0) 0x7f49d80035b0 con 0x7f49f0152490 2023-07-12T02:02:21.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.383+0000 7f49ef7fe700 1 -- 172.21.15.60:0/734909750 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49f0152040 msgr2=0x7f49f0148750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:21.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.383+0000 7f49ef7fe700 1 --2- 172.21.15.60:0/734909750 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49f0152040 0x7f49f0148750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.383+0000 7f49ef7fe700 1 -- 172.21.15.60:0/734909750 >> v2:172.21.15.60:3300/0 conn(0x7f49f00b4810 msgr2=0x7f49f00b8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:21.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.383+0000 7f49ef7fe700 1 --2- 172.21.15.60:0/734909750 >> v2:172.21.15.60:3300/0 conn(0x7f49f00b4810 0x7f49f00b8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.383+0000 7f49ef7fe700 1 -- 172.21.15.60:0/734909750 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f00b3d00 con 0x7f49f0152490 2023-07-12T02:02:21.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.383+0000 7f49ef7fe700 1 -- 172.21.15.60:0/734909750 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1141905739 0 0) 0x7f49e80019f0 con 0x7f49f0152490 2023-07-12T02:02:21.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.383+0000 7f49ef7fe700 1 -- 172.21.15.60:0/734909750 >> v1:172.21.15.60:6789/0 conn(0x7f49f0152490 legacy=0x7f49f0148c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:21.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.383+0000 7f57aa1b0700 1 Processor -- start 2023-07-12T02:02:21.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.384+0000 7f57aa1b0700 1 -- start start 2023-07-12T02:02:21.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.383+0000 7f49ef7fe700 1 --2- 172.21.15.60:0/734909750 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49d8003a30 0x7f49d8003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.384+0000 7f49ef7fe700 1 --2- 172.21.15.60:0/734909750 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49f0152040 0x7f49d8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.384+0000 7f49ef7fe700 1 --2- 172.21.15.60:0/734909750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49d8004d90 0x7f49d8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.384+0000 7f49ef7fe700 1 -- 172.21.15.60:0/734909750 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f00b3fe0 con 0x7f49d8004d90 2023-07-12T02:02:21.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.384+0000 7f49ef7fe700 1 -- 172.21.15.60:0/734909750 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d800bb20 con 0x7f49d8003a30 2023-07-12T02:02:21.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.384+0000 7f49ef7fe700 1 -- 172.21.15.60:0/734909750 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d800bce0 con 0x7f49f0152040 2023-07-12T02:02:21.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.384+0000 7f49effff700 1 --2- 172.21.15.60:0/734909750 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49f0152040 0x7f49d8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:21.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.384+0000 7f49f4c14700 1 --2- 172.21.15.60:0/734909750 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49d8003a30 0x7f49d8003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:21.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.384+0000 7fbe72ffd700 1 -- 172.21.15.60:0/713414645 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbe7400ca90 con 0x7fbe7c06fa50 2023-07-12T02:02:21.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.385+0000 7fbe72ffd700 1 --2- 172.21.15.60:0/713414645 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fbe6006adb0 0x7fbe6006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.385+0000 7fbe72ffd700 1 -- 172.21.15.60:0/713414645 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbe7408a600 con 0x7fbe7c06fa50 2023-07-12T02:02:21.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.385+0000 7f57aa1b0700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f57a40b3ad0 0x7f57a40b6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.385+0000 7f57aa1b0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f57a4147360 0x7f57a4147800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.385+0000 7f57aa1b0700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57a40b9330 con 0x7f57a40b8100 2023-07-12T02:02:21.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.385+0000 7f57aa1b0700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57a40b97c0 con 0x7f57a40b3ad0 2023-07-12T02:02:21.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.385+0000 7f57aa1b0700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57a40b8720 con 0x7f57a4147360 2023-07-12T02:02:21.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.385+0000 7fbe822cd700 1 --2- 172.21.15.60:0/713414645 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fbe6006adb0 0x7fbe6006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:21.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.385+0000 7f57a3fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f57a4147360 0x7f57a4147800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:21.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.385+0000 7f57a3fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f57a4147360 0x7f57a4147800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.60:43550/0 (socket says 172.21.15.60:43550) 2023-07-12T02:02:21.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.385+0000 7f57a3fff700 1 -- 172.21.15.60:0/3196216437 learned_addr learned my addr 172.21.15.60:0/3196216437 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:21.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.385+0000 7fddfbfff700 1 --2- 172.21.15.60:0/2540530046 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fdde806ace0 0x7fdde806d190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fddec006fd0 tx=0x7fddec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:21.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.384+0000 7f49f5415700 1 --2- 172.21.15.60:0/734909750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49d8004d90 0x7f49d8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:21.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.384+0000 7f49f5415700 1 -- 172.21.15.60:0/734909750 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49f0152040 msgr2=0x7f49d8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:21.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.384+0000 7f49f5415700 1 --2- 172.21.15.60:0/734909750 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49f0152040 0x7f49d8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.384+0000 7f49f5415700 1 -- 172.21.15.60:0/734909750 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49d8003a30 msgr2=0x7f49d8003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:21.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.384+0000 7f49f5415700 1 --2- 172.21.15.60:0/734909750 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49d8003a30 0x7f49d8003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.384+0000 7f49f5415700 1 -- 172.21.15.60:0/734909750 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f00b3d00 con 0x7f49d8004d90 2023-07-12T02:02:21.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.385+0000 7f49f5415700 1 --2- 172.21.15.60:0/734909750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49d8004d90 0x7f49d8005200 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f49f00b4ff0 tx=0x7f49d8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bb96861e404bd9b server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:21.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.385+0000 7f57a37fe700 1 --2- 172.21.15.60:0/3196216437 >> v2:172.21.15.60:3300/0 conn(0x7f57a40b3ad0 0x7f57a40b6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:21.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.385+0000 7f57a3fff700 1 -- 172.21.15.60:0/3196216437 >> v2:172.21.15.60:3300/0 conn(0x7f57a40b3ad0 msgr2=0x7f57a40b6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:21.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.385+0000 7f57a3fff700 1 --2- 172.21.15.60:0/3196216437 >> v2:172.21.15.60:3300/0 conn(0x7f57a40b3ad0 0x7f57a40b6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.385+0000 7f57a3fff700 1 -- 172.21.15.60:0/3196216437 >> v1:172.21.15.79:6789/0 conn(0x7f57a40b8100 legacy=0x7f57a40b4580 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-12T02:02:21.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.385+0000 7f57a3fff700 1 -- 172.21.15.60:0/3196216437 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a40b68b0 con 0x7f57a4147360 2023-07-12T02:02:21.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.385+0000 7f57a37fe700 1 --2- 172.21.15.60:0/3196216437 >> v2:172.21.15.60:3300/0 conn(0x7f57a40b3ad0 0x7f57a40b6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:02:21.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.386+0000 7fbe822cd700 1 --2- 172.21.15.60:0/713414645 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fbe6006adb0 0x7fbe6006d260 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbe780090b0 tx=0x7fbe78013040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:21.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.386+0000 7f57a3fff700 1 --2- 172.21.15.60:0/3196216437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57a4147360 0x7f57a4147800 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f57a40b5e10 tx=0x7f5794009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0f899a27e7de6e7 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:21.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.387+0000 7fdb70ff9700 1 -- 172.21.15.60:0/1140135276 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb64005b80 con 0x7fdb741ed1f0 2023-07-12T02:02:21.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.387+0000 7f57a27fc700 1 -- 172.21.15.60:0/3196216437 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5794004230 con 0x7f57a4147360 2023-07-12T02:02:21.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.387+0000 7fbe72ffd700 1 -- 172.21.15.60:0/713414645 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fbe74055690 con 0x7fbe7c06fa50 2023-07-12T02:02:21.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.387+0000 7fdb70ff9700 1 -- 172.21.15.60:0/1140135276 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb64005d00 con 0x7fdb741ed1f0 2023-07-12T02:02:21.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.387+0000 7fdb70ff9700 1 -- 172.21.15.60:0/1140135276 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb64011870 con 0x7fdb741ed1f0 2023-07-12T02:02:21.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.387+0000 7f57a27fc700 1 -- 172.21.15.60:0/3196216437 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5794004390 con 0x7f57a4147360 2023-07-12T02:02:21.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.387+0000 7f57a27fc700 1 -- 172.21.15.60:0/3196216437 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57940036a0 con 0x7f57a4147360 2023-07-12T02:02:21.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.387+0000 7fdb7a756700 1 -- 172.21.15.60:0/1140135276 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb741ec710 con 0x7fdb741ed1f0 2023-07-12T02:02:21.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.388+0000 7fdb7a756700 1 -- 172.21.15.60:0/1140135276 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb741eccd0 con 0x7fdb741ed1f0 2023-07-12T02:02:21.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.388+0000 7f57aa1b0700 1 -- 172.21.15.60:0/3196216437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57a4147360 msgr2=0x7f57a4147800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:21.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.388+0000 7f57aa1b0700 1 --2- 172.21.15.60:0/3196216437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57a4147360 0x7f57a4147800 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f57a40b5e10 tx=0x7f5794009bd0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.388+0000 7f57aa1b0700 1 -- 172.21.15.60:0/3196216437 shutdown_connections 2023-07-12T02:02:21.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.388+0000 7f57aa1b0700 1 --2- 172.21.15.60:0/3196216437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57a4147360 0x7f57a4147800 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.388+0000 7f57aa1b0700 1 --2- 172.21.15.60:0/3196216437 >> v2:172.21.15.60:3300/0 conn(0x7f57a40b3ad0 0x7f57a40b6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.388+0000 7f57aa1b0700 1 -- 172.21.15.60:0/3196216437 >> 172.21.15.60:0/3196216437 conn(0x7f57a4069f30 msgr2=0x7f57a406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:21.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.388+0000 7f57aa1b0700 1 -- 172.21.15.60:0/3196216437 shutdown_connections 2023-07-12T02:02:21.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.388+0000 7f57aa1b0700 1 -- 172.21.15.60:0/3196216437 wait complete. 2023-07-12T02:02:21.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.390+0000 7f57aa1b0700 1 Processor -- start 2023-07-12T02:02:21.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.389+0000 7fdb7a756700 1 -- 172.21.15.60:0/1140135276 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb741ecef0 con 0x7fdb741ed1f0 2023-07-12T02:02:21.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.390+0000 7fdb70ff9700 1 -- 172.21.15.60:0/1140135276 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdb640119d0 con 0x7fdb741ed1f0 2023-07-12T02:02:21.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.391+0000 7fdb70ff9700 1 --2- 172.21.15.60:0/1140135276 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fdb6006ace0 0x7fdb6006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.391+0000 7f57aa1b0700 1 -- start start 2023-07-12T02:02:21.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.391+0000 7fdb70ff9700 1 -- 172.21.15.60:0/1140135276 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdb64089180 con 0x7fdb741ed1f0 2023-07-12T02:02:21.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.391+0000 7f57aa1b0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57a40b3ad0 0x7f57a41d2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.391+0000 7fdb73fff700 1 --2- 172.21.15.60:0/1140135276 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fdb6006ace0 0x7fdb6006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:21.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.391+0000 7f57aa1b0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57a40b8100 0x7f57a41487a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.391+0000 7f57aa1b0700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57a4147360 0x7f57a41d2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.391+0000 7f57aa1b0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a414a480 con 0x7f57a40b8100 2023-07-12T02:02:21.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.391+0000 7f57aa1b0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a41d26d0 con 0x7f57a40b3ad0 2023-07-12T02:02:21.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.391+0000 7f57aa1b0700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a406e8a0 con 0x7f57a4147360 2023-07-12T02:02:21.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.391+0000 7f57a37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57a40b3ad0 0x7f57a41d2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:21.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.391+0000 7f57a37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57a40b3ad0 0x7f57a41d2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.60:43566/0 (socket says 172.21.15.60:43566) 2023-07-12T02:02:21.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.391+0000 7f57a37fe700 1 -- 172.21.15.60:0/2948038878 learned_addr learned my addr 172.21.15.60:0/2948038878 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:21.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.391+0000 7f57a2ffd700 1 --2- 172.21.15.60:0/2948038878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57a40b8100 0x7f57a41487a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:21.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.392+0000 7f57a3fff700 1 --2- 172.21.15.60:0/2948038878 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57a4147360 0x7f57a41d2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:21.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.392+0000 7f57a37fe700 1 -- 172.21.15.60:0/2948038878 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57a4147360 msgr2=0x7f57a41d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:21.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.392+0000 7f57a37fe700 1 --2- 172.21.15.60:0/2948038878 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57a4147360 0x7f57a41d2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.392+0000 7f57a37fe700 1 -- 172.21.15.60:0/2948038878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57a40b8100 msgr2=0x7f57a41487a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:21.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.392+0000 7f57a37fe700 1 --2- 172.21.15.60:0/2948038878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57a40b8100 0x7f57a41487a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.392+0000 7f57a37fe700 1 -- 172.21.15.60:0/2948038878 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5794009550 con 0x7f57a40b3ad0 2023-07-12T02:02:21.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.392+0000 7fdb73fff700 1 --2- 172.21.15.60:0/1140135276 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fdb6006ace0 0x7fdb6006d190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdb680016c0 tx=0x7fdb6800f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:21.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.392+0000 7f57a37fe700 1 --2- 172.21.15.60:0/2948038878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57a40b3ad0 0x7f57a41d2190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f579c00ce00 tx=0x7f579c00a560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:21.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.394+0000 7f49ef7fe700 1 -- 172.21.15.60:0/734909750 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e8012600 con 0x7f49d8004d90 2023-07-12T02:02:21.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.394+0000 7f49ef7fe700 1 -- 172.21.15.60:0/734909750 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e8012760 con 0x7f49d8004d90 2023-07-12T02:02:21.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.394+0000 7f49ef7fe700 1 -- 172.21.15.60:0/734909750 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e8012ad0 con 0x7f49d8004d90 2023-07-12T02:02:21.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.394+0000 7fddf8ff9700 1 -- 172.21.15.60:0/2540530046 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fddf4091080 con 0x7fddfc14f770 2023-07-12T02:02:21.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.395+0000 7f49f6e78700 1 -- 172.21.15.60:0/734909750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49d8004d90 msgr2=0x7f49d8005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:21.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.395+0000 7f49f6e78700 1 --2- 172.21.15.60:0/734909750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49d8004d90 0x7f49d8005200 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f49f00b4ff0 tx=0x7f49d8005880 comp rx=0 tx=0).stop 2023-07-12T02:02:21.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.395+0000 7f49f5415700 1 -- 172.21.15.60:0/734909750 reap_dead start 2023-07-12T02:02:21.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.395+0000 7f49f6e78700 1 -- 172.21.15.60:0/734909750 shutdown_connections 2023-07-12T02:02:21.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.395+0000 7f49f6e78700 1 -- 172.21.15.60:0/734909750 >> 172.21.15.60:0/734909750 conn(0x7f49f0069f30 msgr2=0x7f49f006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:21.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.396+0000 7f578bfff700 1 -- 172.21.15.60:0/2948038878 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579c00f480 con 0x7f57a40b3ad0 2023-07-12T02:02:21.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.396+0000 7f578bfff700 1 -- 172.21.15.60:0/2948038878 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f579c00f5e0 con 0x7f57a40b3ad0 2023-07-12T02:02:21.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.396+0000 7f578bfff700 1 -- 172.21.15.60:0/2948038878 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579c00f950 con 0x7f57a40b3ad0 2023-07-12T02:02:21.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.396+0000 7f49f6e78700 1 -- 172.21.15.60:0/734909750 shutdown_connections 2023-07-12T02:02:21.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.396+0000 7f49f6e78700 1 -- 172.21.15.60:0/734909750 wait complete. 2023-07-12T02:02:21.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.396+0000 7f57aa1b0700 1 -- 172.21.15.60:0/2948038878 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57a41ef770 con 0x7f57a40b3ad0 2023-07-12T02:02:21.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.396+0000 7f57aa1b0700 1 -- 172.21.15.60:0/2948038878 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57a414a0a0 con 0x7f57a40b3ad0 2023-07-12T02:02:21.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.397+0000 7f57aa1b0700 1 -- 172.21.15.60:0/2948038878 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57a41d3cd0 con 0x7f57a40b3ad0 2023-07-12T02:02:21.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.398+0000 7fdb70ff9700 1 -- 172.21.15.60:0/1140135276 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fdb64057b90 con 0x7fdb741ed1f0 2023-07-12T02:02:21.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.397+0000 7f49f6e78700 1 Processor -- start 2023-07-12T02:02:21.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.398+0000 7f49f6e78700 1 -- start start 2023-07-12T02:02:21.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.399+0000 7f49f6e78700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49d8004d90 0x7f49f014f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.399+0000 7f49f6e78700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49f0149950 0x7f49f0149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.399+0000 7f49f6e78700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49f014a9b0 0x7f49f014ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.399+0000 7f49f6e78700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f014f830 con 0x7f49f0149950 2023-07-12T02:02:21.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.399+0000 7f49f6e78700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f0145d20 con 0x7f49d8004d90 2023-07-12T02:02:21.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.399+0000 7f49f6e78700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f014a300 con 0x7f49f014a9b0 2023-07-12T02:02:21.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.399+0000 7f49effff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49f0149950 0x7f49f0149dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:21.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.399+0000 7f49effff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49f0149950 0x7f49f0149dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50738/0 (socket says 172.21.15.60:50738) 2023-07-12T02:02:21.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.399+0000 7f49effff700 1 -- 172.21.15.60:0/260624579 learned_addr learned my addr 172.21.15.60:0/260624579 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:21.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.400+0000 7f49f5415700 1 --2- 172.21.15.60:0/260624579 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49f014a9b0 0x7f49f014ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:21.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.400+0000 7f49effff700 1 -- 172.21.15.60:0/260624579 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49f014a9b0 msgr2=0x7f49f014ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:21.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.400+0000 7f49effff700 1 --2- 172.21.15.60:0/260624579 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49f014a9b0 0x7f49f014ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.400+0000 7f49effff700 1 -- 172.21.15.60:0/260624579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49d8004d90 msgr2=0x7f49f014f2f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-12T02:02:21.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.400+0000 7f49effff700 1 --2- 172.21.15.60:0/260624579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49d8004d90 0x7f49f014f2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.400+0000 7f49effff700 1 -- 172.21.15.60:0/260624579 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f014a590 con 0x7f49f0149950 2023-07-12T02:02:21.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.400+0000 7f49effff700 1 --2- 172.21.15.60:0/260624579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49f0149950 0x7f49f0149dc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f49e4011650 tx=0x7f49e4011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:21.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.401+0000 7f49ed7fa700 1 -- 172.21.15.60:0/260624579 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e400c070 con 0x7f49f0149950 2023-07-12T02:02:21.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.401+0000 7f49ed7fa700 1 -- 172.21.15.60:0/260624579 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e4005e30 con 0x7f49f0149950 2023-07-12T02:02:21.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.401+0000 7f49ed7fa700 1 -- 172.21.15.60:0/260624579 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e4006270 con 0x7f49f0149950 2023-07-12T02:02:21.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.401+0000 7f49f6e78700 1 -- 172.21.15.60:0/260624579 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49f0150fa0 con 0x7f49f0149950 2023-07-12T02:02:21.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.401+0000 7f49f6e78700 1 -- 172.21.15.60:0/260624579 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49f014b370 con 0x7f49f0149950 2023-07-12T02:02:21.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.404+0000 7f49ed7fa700 1 -- 172.21.15.60:0/260624579 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f49e40063d0 con 0x7f49f0149950 2023-07-12T02:02:21.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.404+0000 7f49ed7fa700 1 --2- 172.21.15.60:0/260624579 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f49dc06ace0 0x7f49dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.404+0000 7f49ed7fa700 1 -- 172.21.15.60:0/260624579 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f49e4089a00 con 0x7f49f0149950 2023-07-12T02:02:21.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.404+0000 7f49f4c14700 1 --2- 172.21.15.60:0/260624579 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f49dc06ace0 0x7f49dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:21.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.405+0000 7f49f6e78700 1 -- 172.21.15.60:0/260624579 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49f0145b80 con 0x7f49f0149950 2023-07-12T02:02:21.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.405+0000 7f3b3629d700 1 Processor -- start 2023-07-12T02:02:21.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.405+0000 7f3b3629d700 1 -- start start 2023-07-12T02:02:21.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.407+0000 7f3b3629d700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3b30153220 0x7f3b30155600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.407+0000 7f3b3629d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b300b9330 con 0x7f3b300b8100 2023-07-12T02:02:21.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.407+0000 7f3b3629d700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b300b8720 con 0x7f3b300b3ad0 2023-07-12T02:02:21.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.407+0000 7f3b3629d700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b300b97c0 con 0x7f3b30153220 2023-07-12T02:02:21.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.407+0000 7f3b2ffff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f3b300b3ad0 0x7f3b300b6370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.60:58036/0 (socket says 172.21.15.60:58036) 2023-07-12T02:02:21.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.407+0000 7f3b2ffff700 1 -- 172.21.15.60:0/2923781499 learned_addr learned my addr 172.21.15.60:0/2923781499 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:21.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.406+0000 7f49f4c14700 1 --2- 172.21.15.60:0/260624579 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f49dc06ace0 0x7f49dc06d190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f49e0006fd0 tx=0x7f49e0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:21.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.407+0000 7f3b3483a700 1 --2- 172.21.15.60:0/2923781499 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3b30153220 0x7f3b30155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:21.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.408+0000 7f3b3483a700 1 -- 172.21.15.60:0/2923781499 >> v1:172.21.15.79:6789/0 conn(0x7f3b300b3ad0 legacy=0x7f3b300b6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:21.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.408+0000 7f3b3483a700 1 -- 172.21.15.60:0/2923781499 >> v1:172.21.15.60:6789/0 conn(0x7f3b300b8100 legacy=0x7f3b300b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:21.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.408+0000 7f3b3483a700 1 -- 172.21.15.60:0/2923781499 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b300b8c70 con 0x7f3b30153220 2023-07-12T02:02:21.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.411+0000 7f578bfff700 1 -- 172.21.15.60:0/2948038878 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f579c00b040 con 0x7f57a40b3ad0 2023-07-12T02:02:21.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.411+0000 7f578bfff700 1 --2- 172.21.15.60:0/2948038878 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f579006ace0 0x7f579006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.411+0000 7f578bfff700 1 -- 172.21.15.60:0/2948038878 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f579c08a150 con 0x7f57a40b3ad0 2023-07-12T02:02:21.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.411+0000 7f57a2ffd700 1 --2- 172.21.15.60:0/2948038878 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f579006ace0 0x7f579006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:21.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.412+0000 7f578bfff700 1 -- 172.21.15.60:0/2948038878 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f579c055270 con 0x7f57a40b3ad0 2023-07-12T02:02:21.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.415+0000 7f49ed7fa700 1 -- 172.21.15.60:0/260624579 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f49f0145b80 con 0x7f49f0149950 2023-07-12T02:02:21.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.423+0000 7f3b3483a700 1 --2- 172.21.15.60:0/2923781499 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3b30153220 0x7f3b30155600 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3b28009870 tx=0x7f3b28009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fbe4e22ceff43cd server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:21.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.424+0000 7f57a2ffd700 1 --2- 172.21.15.60:0/2948038878 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f579006ace0 0x7f579006d190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f57a41d47d0 tx=0x7f5798009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:21.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.424+0000 7f3b2f7fe700 1 -- 172.21.15.60:0/2923781499 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b28004230 con 0x7f3b30153220 2023-07-12T02:02:21.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.424+0000 7f3b2f7fe700 1 -- 172.21.15.60:0/2923781499 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b28004390 con 0x7f3b30153220 2023-07-12T02:02:21.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.424+0000 7f3b2f7fe700 1 -- 172.21.15.60:0/2923781499 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b280036a0 con 0x7f3b30153220 2023-07-12T02:02:21.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.425+0000 7f3b3629d700 1 -- 172.21.15.60:0/2923781499 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3b30153220 msgr2=0x7f3b30155600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:21.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.425+0000 7f3b3629d700 1 --2- 172.21.15.60:0/2923781499 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3b30153220 0x7f3b30155600 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3b28009870 tx=0x7f3b28009b80 comp rx=0 tx=0).stop 2023-07-12T02:02:21.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.426+0000 7f3b3629d700 1 -- 172.21.15.60:0/2923781499 shutdown_connections 2023-07-12T02:02:21.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.426+0000 7f3b3629d700 1 --2- 172.21.15.60:0/2923781499 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3b30153220 0x7f3b30155600 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.426+0000 7f3b3629d700 1 -- 172.21.15.60:0/2923781499 >> 172.21.15.60:0/2923781499 conn(0x7f3b30069f30 msgr2=0x7f3b3006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:21.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.426+0000 7f3b3629d700 1 -- 172.21.15.60:0/2923781499 shutdown_connections 2023-07-12T02:02:21.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.426+0000 7f3b3629d700 1 -- 172.21.15.60:0/2923781499 wait complete. 2023-07-12T02:02:21.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.428+0000 7f3b3629d700 1 Processor -- start 2023-07-12T02:02:21.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.428+0000 7f3b3629d700 1 -- start start 2023-07-12T02:02:21.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.429+0000 7f3b3629d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b300b3ad0 0x7f3b3014f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.429+0000 7f3b3629d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b300b8100 0x7f3b3014e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.429+0000 7f3b3629d700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3b30153220 0x7f3b3014d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.429+0000 7f3b3629d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3014e360 con 0x7f3b300b8100 2023-07-12T02:02:21.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.429+0000 7f3b3629d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3014ecc0 con 0x7f3b300b3ad0 2023-07-12T02:02:21.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.429+0000 7f3b3629d700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3014e110 con 0x7f3b30153220 2023-07-12T02:02:21.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.430+0000 7f3b277fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b300b8100 0x7f3b3014e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:21.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.430+0000 7f3b277fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b300b8100 0x7f3b3014e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50740/0 (socket says 172.21.15.60:50740) 2023-07-12T02:02:21.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.430+0000 7f3b277fe700 1 -- 172.21.15.60:0/2294718510 learned_addr learned my addr 172.21.15.60:0/2294718510 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:21.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.430+0000 7f3b277fe700 1 -- 172.21.15.60:0/2294718510 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3b30153220 msgr2=0x7f3b3014d6d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-12T02:02:21.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.430+0000 7f3b277fe700 1 --2- 172.21.15.60:0/2294718510 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3b30153220 0x7f3b3014d6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.430+0000 7f3b277fe700 1 -- 172.21.15.60:0/2294718510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b300b3ad0 msgr2=0x7f3b3014f750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-12T02:02:21.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.430+0000 7f3b277fe700 1 --2- 172.21.15.60:0/2294718510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b300b3ad0 0x7f3b3014f750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.430+0000 7f3b277fe700 1 -- 172.21.15.60:0/2294718510 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b280094a0 con 0x7f3b300b8100 2023-07-12T02:02:21.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.431+0000 7f3b277fe700 1 --2- 172.21.15.60:0/2294718510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b300b8100 0x7f3b3014e780 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3b2000cc50 tx=0x7f3b2000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:21.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.432+0000 7f3b2d7fa700 1 -- 172.21.15.60:0/2294718510 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2000ada0 con 0x7f3b300b8100 2023-07-12T02:02:21.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.433+0000 7f3b2d7fa700 1 -- 172.21.15.60:0/2294718510 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2000ce50 con 0x7f3b300b8100 2023-07-12T02:02:21.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.433+0000 7f3b2d7fa700 1 -- 172.21.15.60:0/2294718510 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b20003c20 con 0x7f3b300b8100 2023-07-12T02:02:21.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.433+0000 7f3b3629d700 1 -- 172.21.15.60:0/2294718510 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b3014d240 con 0x7f3b300b8100 2023-07-12T02:02:21.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.433+0000 7f3b3629d700 1 -- 172.21.15.60:0/2294718510 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b3014ced0 con 0x7f3b300b8100 2023-07-12T02:02:21.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.445+0000 7f3b2d7fa700 1 -- 172.21.15.60:0/2294718510 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3b200050d0 con 0x7f3b300b8100 2023-07-12T02:02:21.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.446+0000 7f3b2d7fa700 1 --2- 172.21.15.60:0/2294718510 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f3b1006adb0 0x7f3b1006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:21.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.446+0000 7f3b2d7fa700 1 -- 172.21.15.60:0/2294718510 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3b20089580 con 0x7f3b300b8100 2023-07-12T02:02:21.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.447+0000 7f3b2ffff700 1 --2- 172.21.15.60:0/2294718510 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f3b1006adb0 0x7f3b1006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:21.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.447+0000 7f3b3629d700 1 -- 172.21.15.60:0/2294718510 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b140052f0 con 0x7f3b300b8100 2023-07-12T02:02:21.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.457+0000 7f3b2d7fa700 1 -- 172.21.15.60:0/2294718510 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f3b20054610 con 0x7f3b300b8100 2023-07-12T02:02:21.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.483+0000 7f3b2ffff700 1 --2- 172.21.15.60:0/2294718510 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f3b1006adb0 0x7f3b1006d260 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3b18005030 tx=0x7f3b18007b30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:21.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.705+0000 7f4658159700 1 -- 172.21.15.60:0/1734074379 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f4650074360 con 0x7f465006aa40 2023-07-12T02:02:21.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.706+0000 7f46467fc700 1 -- 172.21.15.60:0/1734074379 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f464c017070 con 0x7f465006aa40 2023-07-12T02:02:21.711 INFO:teuthology.orchestra.run.smithi060.stdout:55834574855 2023-07-12T02:02:21.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.709+0000 7f4658159700 1 -- 172.21.15.60:0/1734074379 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f463406adb0 msgr2=0x7f463406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:21.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.709+0000 7f4658159700 1 --2- 172.21.15.60:0/1734074379 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f463406adb0 0x7f463406d260 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f465006e6a0 tx=0x7f4640009040 comp rx=0 tx=0).stop 2023-07-12T02:02:21.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.709+0000 7f4658159700 1 -- 172.21.15.60:0/1734074379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f465006aa40 msgr2=0x7f465006f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:21.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.709+0000 7f4658159700 1 --2- 172.21.15.60:0/1734074379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f465006aa40 0x7f465006f100 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f464c00c4d0 tx=0x7f464c00c890 comp rx=0 tx=0).stop 2023-07-12T02:02:21.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.710+0000 7f4658159700 1 -- 172.21.15.60:0/1734074379 shutdown_connections 2023-07-12T02:02:21.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.710+0000 7f4658159700 1 --2- 172.21.15.60:0/1734074379 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f463406adb0 0x7f463406d260 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.710+0000 7f4658159700 1 --2- 172.21.15.60:0/1734074379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f465006aa40 0x7f465006f100 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.710+0000 7f4658159700 1 --2- 172.21.15.60:0/1734074379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46501467d0 0x7f46501ed090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.710+0000 7f4658159700 1 --2- 172.21.15.60:0/1734074379 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46500b93d0 0x7f465006ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.710+0000 7f4658159700 1 -- 172.21.15.60:0/1734074379 >> 172.21.15.60:0/1734074379 conn(0x7f4650069f30 msgr2=0x7f46500b38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:21.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.710+0000 7f4658159700 1 -- 172.21.15.60:0/1734074379 shutdown_connections 2023-07-12T02:02:21.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.710+0000 7f4658159700 1 -- 172.21.15.60:0/1734074379 wait complete. 2023-07-12T02:02:21.731 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2023-07-12T02:02:21.732 DEBUG:teuthology.parallel:result is None 2023-07-12T02:02:21.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.743+0000 7f3de46d8700 1 -- 172.21.15.60:0/3646571918 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f3ddc13fce0 con 0x7f3ddc146390 2023-07-12T02:02:21.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.744+0000 7f3dd2ffd700 1 -- 172.21.15.60:0/3646571918 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3dcc057980 con 0x7f3ddc146390 2023-07-12T02:02:21.748 INFO:teuthology.orchestra.run.smithi060.stdout:55834574853 2023-07-12T02:02:21.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.747+0000 7f3de46d8700 1 -- 172.21.15.60:0/3646571918 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f3dc006ad80 msgr2=0x7f3dc006d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:21.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.747+0000 7f3de46d8700 1 --2- 172.21.15.60:0/3646571918 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f3dc006ad80 0x7f3dc006d230 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc063b00 tx=0x7f3dd8008040 comp rx=0 tx=0).stop 2023-07-12T02:02:21.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.748+0000 7f3de46d8700 1 -- 172.21.15.60:0/3646571918 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3ddc146390 msgr2=0x7f3ddc142b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:21.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.748+0000 7f3de46d8700 1 --2- 172.21.15.60:0/3646571918 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3ddc146390 0x7f3ddc142b20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc0b9830 tx=0x7f3dcc004a60 comp rx=0 tx=0).stop 2023-07-12T02:02:21.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.748+0000 7f3de46d8700 1 -- 172.21.15.60:0/3646571918 shutdown_connections 2023-07-12T02:02:21.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.748+0000 7f3de46d8700 1 --2- 172.21.15.60:0/3646571918 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f3dc006ad80 0x7f3dc006d230 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.748+0000 7f3de46d8700 1 --2- 172.21.15.60:0/3646571918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3dc8004170 0x7f3ddc145890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.748+0000 7f3de46d8700 1 --2- 172.21.15.60:0/3646571918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ddc143060 0x7f3ddc1f0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.748+0000 7f3de46d8700 1 --2- 172.21.15.60:0/3646571918 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3ddc146390 0x7f3ddc142b20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.748+0000 7f3de46d8700 1 -- 172.21.15.60:0/3646571918 >> 172.21.15.60:0/3646571918 conn(0x7f3ddc069f30 msgr2=0x7f3ddc0bc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:21.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.753+0000 7f3de46d8700 1 -- 172.21.15.60:0/3646571918 shutdown_connections 2023-07-12T02:02:21.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.753+0000 7f3de46d8700 1 -- 172.21.15.60:0/3646571918 wait complete. 2023-07-12T02:02:21.774 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2023-07-12T02:02:21.774 DEBUG:teuthology.parallel:result is None 2023-07-12T02:02:21.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.782+0000 7f57aa1b0700 1 -- 172.21.15.60:0/2948038878 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f57a41485f0 con 0x7f57a40b3ad0 2023-07-12T02:02:21.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.782+0000 7f578bfff700 1 -- 172.21.15.60:0/2948038878 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f579c01d020 con 0x7f57a40b3ad0 2023-07-12T02:02:21.785 INFO:teuthology.orchestra.run.smithi060.stdout:55834574854 2023-07-12T02:02:21.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.785+0000 7f57aa1b0700 1 -- 172.21.15.60:0/2948038878 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f579006ace0 msgr2=0x7f579006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:21.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.785+0000 7f57aa1b0700 1 --2- 172.21.15.60:0/2948038878 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f579006ace0 0x7f579006d190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f57a41d47d0 tx=0x7f5798009190 comp rx=0 tx=0).stop 2023-07-12T02:02:21.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.785+0000 7f57aa1b0700 1 -- 172.21.15.60:0/2948038878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57a40b3ad0 msgr2=0x7f57a41d2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:21.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.785+0000 7f57aa1b0700 1 --2- 172.21.15.60:0/2948038878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57a40b3ad0 0x7f57a41d2190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f579c00ce00 tx=0x7f579c00a560 comp rx=0 tx=0).stop 2023-07-12T02:02:21.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.785+0000 7f57aa1b0700 1 -- 172.21.15.60:0/2948038878 shutdown_connections 2023-07-12T02:02:21.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.785+0000 7f57aa1b0700 1 --2- 172.21.15.60:0/2948038878 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f579006ace0 0x7f579006d190 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f57a41d47d0 tx=0x7f5798009190 comp rx=0 tx=0).stop 2023-07-12T02:02:21.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.785+0000 7f57aa1b0700 1 --2- 172.21.15.60:0/2948038878 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57a4147360 0x7f57a41d2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.785+0000 7f57aa1b0700 1 --2- 172.21.15.60:0/2948038878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57a40b3ad0 0x7f57a41d2190 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.785+0000 7f57aa1b0700 1 --2- 172.21.15.60:0/2948038878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57a40b8100 0x7f57a41487a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.785+0000 7f57aa1b0700 1 -- 172.21.15.60:0/2948038878 >> 172.21.15.60:0/2948038878 conn(0x7f57a4069f30 msgr2=0x7f57a40bc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:21.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.786+0000 7f57aa1b0700 1 -- 172.21.15.60:0/2948038878 shutdown_connections 2023-07-12T02:02:21.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.786+0000 7f57aa1b0700 1 -- 172.21.15.60:0/2948038878 wait complete. 2023-07-12T02:02:21.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.789+0000 7fdb7a756700 1 -- 172.21.15.60:0/1140135276 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdb74144090 con 0x7fdb741ed1f0 2023-07-12T02:02:21.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.790+0000 7fdb70ff9700 1 -- 172.21.15.60:0/1140135276 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdb64015090 con 0x7fdb741ed1f0 2023-07-12T02:02:21.793 INFO:teuthology.orchestra.run.smithi060.stdout:55834574852 2023-07-12T02:02:21.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.792+0000 7fdb7a756700 1 -- 172.21.15.60:0/1140135276 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fdb6006ace0 msgr2=0x7fdb6006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:21.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.792+0000 7fdb7a756700 1 --2- 172.21.15.60:0/1140135276 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fdb6006ace0 0x7fdb6006d190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdb680016c0 tx=0x7fdb6800f000 comp rx=0 tx=0).stop 2023-07-12T02:02:21.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.792+0000 7fdb7a756700 1 -- 172.21.15.60:0/1140135276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb741ed1f0 msgr2=0x7fdb741e1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:21.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.792+0000 7fdb7a756700 1 --2- 172.21.15.60:0/1140135276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb741ed1f0 0x7fdb741e1e30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdb6400b7b0 tx=0x7fdb6400bb70 comp rx=0 tx=0).stop 2023-07-12T02:02:21.796 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.792+0000 7fdb7a756700 1 -- 172.21.15.60:0/1140135276 shutdown_connections 2023-07-12T02:02:21.796 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.792+0000 7fdb7a756700 1 --2- 172.21.15.60:0/1140135276 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fdb6006ace0 0x7fdb6006d190 secure :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdb680016c0 tx=0x7fdb6800f000 comp rx=0 tx=0).stop 2023-07-12T02:02:21.796 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.792+0000 7fdb7a756700 1 --2- 172.21.15.60:0/1140135276 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb74150e60 0x7fdb741512d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.796 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.792+0000 7fdb7a756700 1 --2- 172.21.15.60:0/1140135276 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdb5c003a00 0x7fdb741dd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.796 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.792+0000 7fdb7a756700 1 --2- 172.21.15.60:0/1140135276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb741ed1f0 0x7fdb741e1e30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.796 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.792+0000 7fdb7a756700 1 -- 172.21.15.60:0/1140135276 >> 172.21.15.60:0/1140135276 conn(0x7fdb74069f30 msgr2=0x7fdb741524a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:21.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.794+0000 7fdb7a756700 1 -- 172.21.15.60:0/1140135276 shutdown_connections 2023-07-12T02:02:21.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.794+0000 7fdb7a756700 1 -- 172.21.15.60:0/1140135276 wait complete. 2023-07-12T02:02:21.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.795+0000 7fbe84531700 1 -- 172.21.15.60:0/713414645 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fbe7c071260 con 0x7fbe7c06fa50 2023-07-12T02:02:21.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.796+0000 7fbe72ffd700 1 -- 172.21.15.60:0/713414645 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbe7c071260 con 0x7fbe7c06fa50 2023-07-12T02:02:21.799 INFO:teuthology.orchestra.run.smithi060.stdout:55834574853 2023-07-12T02:02:21.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.798+0000 7fde02951700 1 -- 172.21.15.60:0/2540530046 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdddc0055a0 con 0x7fddfc14f770 2023-07-12T02:02:21.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.799+0000 7fddf8ff9700 1 -- 172.21.15.60:0/2540530046 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fddf4055ca0 con 0x7fddfc14f770 2023-07-12T02:02:21.804 INFO:teuthology.orchestra.run.smithi060.stdout:55834574854 2023-07-12T02:02:21.804 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.799+0000 7fbe84531700 1 -- 172.21.15.60:0/713414645 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fbe6006adb0 msgr2=0x7fbe6006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:21.804 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.799+0000 7fbe84531700 1 --2- 172.21.15.60:0/713414645 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fbe6006adb0 0x7fbe6006d260 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbe780090b0 tx=0x7fbe78013040 comp rx=0 tx=0).stop 2023-07-12T02:02:21.804 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.799+0000 7fbe84531700 1 -- 172.21.15.60:0/713414645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe7c06fa50 msgr2=0x7fbe7c071540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:21.804 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.799+0000 7fbe84531700 1 --2- 172.21.15.60:0/713414645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe7c06fa50 0x7fbe7c071540 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbe7400efc0 tx=0x7fbe7400c3a0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.805 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2023-07-12T02:02:21.805 DEBUG:teuthology.parallel:result is None 2023-07-12T02:02:21.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.802+0000 7fde02951700 1 -- 172.21.15.60:0/2540530046 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fdde806ace0 msgr2=0x7fdde806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:21.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.802+0000 7fde02951700 1 --2- 172.21.15.60:0/2540530046 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fdde806ace0 0x7fdde806d190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fddec006fd0 tx=0x7fddec008040 comp rx=0 tx=0).stop 2023-07-12T02:02:21.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.802+0000 7fde02951700 1 -- 172.21.15.60:0/2540530046 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddfc14f770 msgr2=0x7fddfc1d4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:21.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.802+0000 7fde02951700 1 --2- 172.21.15.60:0/2540530046 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddfc14f770 0x7fddfc1d4d70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fddf400b730 tx=0x7fddf4004ad0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.802+0000 7fde02951700 1 -- 172.21.15.60:0/2540530046 shutdown_connections 2023-07-12T02:02:21.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.802+0000 7fde02951700 1 --2- 172.21.15.60:0/2540530046 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fdde806ace0 0x7fdde806d190 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.802+0000 7fde02951700 1 --2- 172.21.15.60:0/2540530046 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddfc14f770 0x7fddfc1d4d70 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.802+0000 7fde02951700 1 --2- 172.21.15.60:0/2540530046 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddfc06b120 0x7fddfc1e5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.802+0000 7fde02951700 1 --2- 172.21.15.60:0/2540530046 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fddfc14f320 0x7fddfc14c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.802+0000 7fde02951700 1 -- 172.21.15.60:0/2540530046 >> 172.21.15.60:0/2540530046 conn(0x7fddfc0bd980 msgr2=0x7fddfc0bbd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:21.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.803+0000 7fde02951700 1 -- 172.21.15.60:0/2540530046 shutdown_connections 2023-07-12T02:02:21.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.803+0000 7fde02951700 1 -- 172.21.15.60:0/2540530046 wait complete. 2023-07-12T02:02:21.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.804+0000 7fbe84531700 1 -- 172.21.15.60:0/713414645 shutdown_connections 2023-07-12T02:02:21.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.804+0000 7fbe84531700 1 --2- 172.21.15.60:0/713414645 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fbe6006adb0 0x7fbe6006d260 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.804+0000 7fbe84531700 1 --2- 172.21.15.60:0/713414645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe7c0bc7c0 0x7fbe7c1d7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.804+0000 7fbe84531700 1 --2- 172.21.15.60:0/713414645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe7c06fa50 0x7fbe7c071540 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.804+0000 7fbe84531700 1 --2- 172.21.15.60:0/713414645 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbe7c0bdcc0 0x7fbe7c06f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.804+0000 7fbe84531700 1 -- 172.21.15.60:0/713414645 >> 172.21.15.60:0/713414645 conn(0x7fbe7c0c1580 msgr2=0x7fbe7c148940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:21.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.804+0000 7fbe84531700 1 -- 172.21.15.60:0/713414645 shutdown_connections 2023-07-12T02:02:21.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.804+0000 7fbe84531700 1 -- 172.21.15.60:0/713414645 wait complete. 2023-07-12T02:02:21.813 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.2 2023-07-12T02:02:21.813 DEBUG:teuthology.parallel:result is None 2023-07-12T02:02:21.821 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2023-07-12T02:02:21.821 DEBUG:teuthology.parallel:result is None 2023-07-12T02:02:21.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.819+0000 7f49f6e78700 1 -- 172.21.15.60:0/260624579 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f49f0145b80 con 0x7f49f0149950 2023-07-12T02:02:21.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.819+0000 7f49ed7fa700 1 -- 172.21.15.60:0/260624579 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f49f0145b80 con 0x7f49f0149950 2023-07-12T02:02:21.822 INFO:teuthology.orchestra.run.smithi060.stdout:55834574854 2023-07-12T02:02:21.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.822+0000 7f49f6e78700 1 -- 172.21.15.60:0/260624579 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f49dc06ace0 msgr2=0x7f49dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:21.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.822+0000 7f49f6e78700 1 --2- 172.21.15.60:0/260624579 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f49dc06ace0 0x7f49dc06d190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f49e0006fd0 tx=0x7f49e0008040 comp rx=0 tx=0).stop 2023-07-12T02:02:21.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.822+0000 7f49f6e78700 1 -- 172.21.15.60:0/260624579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49f0149950 msgr2=0x7f49f0149dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:21.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.822+0000 7f49f6e78700 1 --2- 172.21.15.60:0/260624579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49f0149950 0x7f49f0149dc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f49e4011650 tx=0x7f49e4011a10 comp rx=0 tx=0).stop 2023-07-12T02:02:21.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.822+0000 7f49f6e78700 1 -- 172.21.15.60:0/260624579 shutdown_connections 2023-07-12T02:02:21.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.822+0000 7f49f6e78700 1 --2- 172.21.15.60:0/260624579 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f49dc06ace0 0x7f49dc06d190 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.822+0000 7f49f6e78700 1 --2- 172.21.15.60:0/260624579 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49f014a9b0 0x7f49f014ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.822+0000 7f49f6e78700 1 --2- 172.21.15.60:0/260624579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49d8004d90 0x7f49f014f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.822+0000 7f49f6e78700 1 --2- 172.21.15.60:0/260624579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49f0149950 0x7f49f0149dc0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.822+0000 7f49f6e78700 1 -- 172.21.15.60:0/260624579 >> 172.21.15.60:0/260624579 conn(0x7f49f0069f30 msgr2=0x7f49f006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:21.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.822+0000 7f49f6e78700 1 -- 172.21.15.60:0/260624579 shutdown_connections 2023-07-12T02:02:21.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.822+0000 7f49f6e78700 1 -- 172.21.15.60:0/260624579 wait complete. 2023-07-12T02:02:21.827 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2023-07-12T02:02:21.828 DEBUG:teuthology.parallel:result is None 2023-07-12T02:02:21.837 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-07-12T02:02:21.838 DEBUG:teuthology.parallel:result is None 2023-07-12T02:02:21.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.838+0000 7f3b3629d700 1 -- 172.21.15.60:0/2294718510 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3b140055a0 con 0x7f3b300b8100 2023-07-12T02:02:21.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.839+0000 7f3b2d7fa700 1 -- 172.21.15.60:0/2294718510 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3b20057c30 con 0x7f3b300b8100 2023-07-12T02:02:21.842 INFO:teuthology.orchestra.run.smithi060.stdout:55834574854 2023-07-12T02:02:21.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.840+0000 7f3b3629d700 1 -- 172.21.15.60:0/2294718510 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f3b1006adb0 msgr2=0x7f3b1006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:21.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.840+0000 7f3b3629d700 1 --2- 172.21.15.60:0/2294718510 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f3b1006adb0 0x7f3b1006d260 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3b18005030 tx=0x7f3b18007b30 comp rx=0 tx=0).stop 2023-07-12T02:02:21.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.840+0000 7f3b3629d700 1 -- 172.21.15.60:0/2294718510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b300b8100 msgr2=0x7f3b3014e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:21.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.840+0000 7f3b3629d700 1 --2- 172.21.15.60:0/2294718510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b300b8100 0x7f3b3014e780 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3b2000cc50 tx=0x7f3b2000a340 comp rx=0 tx=0).stop 2023-07-12T02:02:21.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.841+0000 7f3b3629d700 1 -- 172.21.15.60:0/2294718510 shutdown_connections 2023-07-12T02:02:21.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.841+0000 7f3b3629d700 1 --2- 172.21.15.60:0/2294718510 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f3b1006adb0 0x7f3b1006d260 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.841+0000 7f3b3629d700 1 --2- 172.21.15.60:0/2294718510 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3b30153220 0x7f3b3014d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.841+0000 7f3b3629d700 1 --2- 172.21.15.60:0/2294718510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b300b3ad0 0x7f3b3014f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.841+0000 7f3b3629d700 1 --2- 172.21.15.60:0/2294718510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b300b8100 0x7f3b3014e780 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:21.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.841+0000 7f3b3629d700 1 -- 172.21.15.60:0/2294718510 >> 172.21.15.60:0/2294718510 conn(0x7f3b30069f30 msgr2=0x7f3b301e3590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:21.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.841+0000 7f3b3629d700 1 -- 172.21.15.60:0/2294718510 shutdown_connections 2023-07-12T02:02:21.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:21.841+0000 7f3b3629d700 1 -- 172.21.15.60:0/2294718510 wait complete. 2023-07-12T02:02:21.855 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2023-07-12T02:02:21.856 DEBUG:teuthology.parallel:result is None 2023-07-12T02:02:21.856 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-12T02:02:21.856 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-12T02:02:22.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.018+0000 7f5ebf2e5700 1 Processor -- start 2023-07-12T02:02:22.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.019+0000 7f5ebf2e5700 1 -- start start 2023-07-12T02:02:22.023 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.019+0000 7f5ebf2e5700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5eb8071a30 0x7f5eb814ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:22.023 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.019+0000 7f5ebf2e5700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5eb80b96b0 0x7f5eb8151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:22.023 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.019+0000 7f5ebf2e5700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eb8070e70 con 0x7f5eb8141780 2023-07-12T02:02:22.023 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.019+0000 7f5ebf2e5700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eb80ba720 con 0x7f5eb8071a30 2023-07-12T02:02:22.023 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.019+0000 7f5ebf2e5700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb8071ea0 con 0x7f5eb80b96b0 2023-07-12T02:02:22.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.019+0000 7f5ebc880700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5eb8071a30 0x7f5eb814ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:22.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.019+0000 7f5ebc880700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5eb8071a30 0x7f5eb814ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50742/0 (socket says 172.21.15.60:50742) 2023-07-12T02:02:22.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.019+0000 7f5ebc880700 1 -- 172.21.15.60:0/1995544070 learned_addr learned my addr 172.21.15.60:0/1995544070 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:22.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.019+0000 7f5ebd882700 1 --2- 172.21.15.60:0/1995544070 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5eb80b96b0 0x7f5eb8151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:22.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.020+0000 7f5ebc880700 1 -- 172.21.15.60:0/1995544070 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5eb80b96b0 msgr2=0x7f5eb8151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:22.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.020+0000 7f5ebc880700 1 --2- 172.21.15.60:0/1995544070 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5eb80b96b0 0x7f5eb8151eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:22.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.020+0000 7f5ebc880700 1 -- 172.21.15.60:0/1995544070 >> v1:172.21.15.79:6789/0 conn(0x7f5eb8141780 legacy=0x7f5eb80ba010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:22.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.020+0000 7f5ebc880700 1 -- 172.21.15.60:0/1995544070 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb80b9b40 con 0x7f5eb8071a30 2023-07-12T02:02:22.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.020+0000 7f5ebd882700 1 --2- 172.21.15.60:0/1995544070 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5eb80b96b0 0x7f5eb8151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:22.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.020+0000 7f5ebc880700 1 --2- 172.21.15.60:0/1995544070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5eb8071a30 0x7f5eb814ab20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5eac00bb90 tx=0x7f5eac00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b58e9584f1bd0ede server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:22.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.020+0000 7f5eabfff700 1 -- 172.21.15.60:0/1995544070 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eac00dd50 con 0x7f5eb8071a30 2023-07-12T02:02:22.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.020+0000 7f5eabfff700 1 -- 172.21.15.60:0/1995544070 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eac010470 con 0x7f5eb8071a30 2023-07-12T02:02:22.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.020+0000 7f5eabfff700 1 -- 172.21.15.60:0/1995544070 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eac010800 con 0x7f5eb8071a30 2023-07-12T02:02:22.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.020+0000 7f5ebf2e5700 1 -- 172.21.15.60:0/1995544070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5eb8071a30 msgr2=0x7f5eb814ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:22.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.020+0000 7f5ebf2e5700 1 --2- 172.21.15.60:0/1995544070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5eb8071a30 0x7f5eb814ab20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5eac00bb90 tx=0x7f5eac00bea0 comp rx=0 tx=0).stop 2023-07-12T02:02:22.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.020+0000 7f5ebf2e5700 1 -- 172.21.15.60:0/1995544070 shutdown_connections 2023-07-12T02:02:22.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.020+0000 7f5ebf2e5700 1 --2- 172.21.15.60:0/1995544070 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5eb80b96b0 0x7f5eb8151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:22.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.020+0000 7f5ebf2e5700 1 --2- 172.21.15.60:0/1995544070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5eb8071a30 0x7f5eb814ab20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:22.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.020+0000 7f5ebf2e5700 1 -- 172.21.15.60:0/1995544070 >> 172.21.15.60:0/1995544070 conn(0x7f5eb806d0e0 msgr2=0x7f5eb806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:22.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.021+0000 7f5ebf2e5700 1 -- 172.21.15.60:0/1995544070 shutdown_connections 2023-07-12T02:02:22.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.021+0000 7f5ebf2e5700 1 -- 172.21.15.60:0/1995544070 wait complete. 2023-07-12T02:02:22.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.022+0000 7f5ebf2e5700 1 Processor -- start 2023-07-12T02:02:22.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.022+0000 7f5ebf2e5700 1 -- start start 2023-07-12T02:02:22.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.022+0000 7f5ebf2e5700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5eb8071a30 0x7f5eb80b7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:22.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.022+0000 7f5ebf2e5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5eb80b96b0 0x7f5eb8147b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:22.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.022+0000 7f5ebf2e5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5eb8141780 0x7f5eb80b5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:22.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.022+0000 7f5ebf2e5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb81450c0 con 0x7f5eb80b96b0 2023-07-12T02:02:22.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.022+0000 7f5ebf2e5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb81dc420 con 0x7f5eb8141780 2023-07-12T02:02:22.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.022+0000 7f5ebf2e5700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb8146130 con 0x7f5eb8071a30 2023-07-12T02:02:22.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.022+0000 7f5ebc880700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5eb80b96b0 0x7f5eb8147b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:22.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.022+0000 7f5ebc880700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5eb80b96b0 0x7f5eb8147b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50750/0 (socket says 172.21.15.60:50750) 2023-07-12T02:02:22.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.022+0000 7f5ebc880700 1 -- 172.21.15.60:0/978237429 learned_addr learned my addr 172.21.15.60:0/978237429 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:22.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.022+0000 7f5ebd081700 1 --2- 172.21.15.60:0/978237429 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5eb8071a30 0x7f5eb80b7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:22.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.023+0000 7f5ebd882700 1 --2- 172.21.15.60:0/978237429 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5eb8141780 0x7f5eb80b5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:22.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.023+0000 7f5ebc880700 1 -- 172.21.15.60:0/978237429 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5eb8071a30 msgr2=0x7f5eb80b7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:22.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.023+0000 7f5ebc880700 1 --2- 172.21.15.60:0/978237429 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5eb8071a30 0x7f5eb80b7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:22.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.023+0000 7f5ebc880700 1 -- 172.21.15.60:0/978237429 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5eb8141780 msgr2=0x7f5eb80b5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:22.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.023+0000 7f5ebc880700 1 --2- 172.21.15.60:0/978237429 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5eb8141780 0x7f5eb80b5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:22.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.023+0000 7f5ebc880700 1 -- 172.21.15.60:0/978237429 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eac00b7f0 con 0x7f5eb80b96b0 2023-07-12T02:02:22.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.023+0000 7f5ebc880700 1 --2- 172.21.15.60:0/978237429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5eb80b96b0 0x7f5eb8147b90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5eac015000 tx=0x7f5eac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:22.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.023+0000 7f5ea9ffb700 1 -- 172.21.15.60:0/978237429 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eac01f070 con 0x7f5eb80b96b0 2023-07-12T02:02:22.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.023+0000 7f5ea9ffb700 1 -- 172.21.15.60:0/978237429 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eac0038b0 con 0x7f5eb80b96b0 2023-07-12T02:02:22.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.023+0000 7f5ebf2e5700 1 -- 172.21.15.60:0/978237429 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eb81463a0 con 0x7f5eb80b96b0 2023-07-12T02:02:22.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.023+0000 7f5ea9ffb700 1 -- 172.21.15.60:0/978237429 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eac003c40 con 0x7f5eb80b96b0 2023-07-12T02:02:22.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.023+0000 7f5ebf2e5700 1 -- 172.21.15.60:0/978237429 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eb81dc0b0 con 0x7f5eb80b96b0 2023-07-12T02:02:22.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.024+0000 7f5ebf2e5700 1 -- 172.21.15.60:0/978237429 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eb81dc270 con 0x7f5eb80b96b0 2023-07-12T02:02:22.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.025+0000 7f5ea9ffb700 1 -- 172.21.15.60:0/978237429 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5eac019400 con 0x7f5eb80b96b0 2023-07-12T02:02:22.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.025+0000 7f5ea9ffb700 1 --2- 172.21.15.60:0/978237429 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f5e9c06ace0 0x7f5e9c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:22.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.025+0000 7f5ea9ffb700 1 -- 172.21.15.60:0/978237429 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5eac08cea0 con 0x7f5eb80b96b0 2023-07-12T02:02:22.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.025+0000 7f5ebd081700 1 --2- 172.21.15.60:0/978237429 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f5e9c06ace0 0x7f5e9c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:22.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.026+0000 7f5ebd081700 1 --2- 172.21.15.60:0/978237429 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f5e9c06ace0 0x7f5e9c06d190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4007fd0 tx=0x7f5eb4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:22.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.029+0000 7f5ea9ffb700 1 -- 172.21.15.60:0/978237429 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f5eac057fe0 con 0x7f5eb80b96b0 2023-07-12T02:02:22.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.218+0000 7f5ebf2e5700 1 -- 172.21.15.60:0/978237429 --> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5eb8070950 con 0x7f5e9c06ace0 2023-07-12T02:02:22.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.226+0000 7f5ea9ffb700 1 -- 172.21.15.60:0/978237429 <== mgr.4105 v2:172.21.15.79:6832/1173177519 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286808 (secure 0 0 0) 0x7f5eb4001cc0 con 0x7f5e9c06ace0 2023-07-12T02:02:22.232 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:02:22.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.229+0000 7f5ebf2e5700 1 -- 172.21.15.60:0/978237429 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f5e9c06ace0 msgr2=0x7f5e9c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:22.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.229+0000 7f5ebf2e5700 1 --2- 172.21.15.60:0/978237429 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f5e9c06ace0 0x7f5e9c06d190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4007fd0 tx=0x7f5eb4009040 comp rx=0 tx=0).stop 2023-07-12T02:02:22.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.229+0000 7f5ebf2e5700 1 -- 172.21.15.60:0/978237429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5eb80b96b0 msgr2=0x7f5eb8147b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:22.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.229+0000 7f5ebf2e5700 1 --2- 172.21.15.60:0/978237429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5eb80b96b0 0x7f5eb8147b90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5eac015000 tx=0x7f5eac004750 comp rx=0 tx=0).stop 2023-07-12T02:02:22.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.229+0000 7f5ebf2e5700 1 -- 172.21.15.60:0/978237429 shutdown_connections 2023-07-12T02:02:22.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.229+0000 7f5ebf2e5700 1 --2- 172.21.15.60:0/978237429 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f5e9c06ace0 0x7f5e9c06d190 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:22.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.229+0000 7f5ebf2e5700 1 --2- 172.21.15.60:0/978237429 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5eb8141780 0x7f5eb80b5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:22.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.230+0000 7f5ebf2e5700 1 --2- 172.21.15.60:0/978237429 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5eb8071a30 0x7f5eb80b7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:22.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.230+0000 7f5ebf2e5700 1 --2- 172.21.15.60:0/978237429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5eb80b96b0 0x7f5eb8147b90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:22.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.230+0000 7f5ebf2e5700 1 -- 172.21.15.60:0/978237429 >> 172.21.15.60:0/978237429 conn(0x7f5eb806d0e0 msgr2=0x7f5eb8069f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:22.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.230+0000 7f5ebf2e5700 1 -- 172.21.15.60:0/978237429 shutdown_connections 2023-07-12T02:02:22.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.230+0000 7f5ebf2e5700 1 -- 172.21.15.60:0/978237429 wait complete. 2023-07-12T02:02:22.235 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-07-12T02:02:22.244 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-07-12T02:02:21.803072+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219084,"kb_used_data":2900,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755636,"statfs":{"total":773094113280,"available":772869771264,"internally_reserved":0,"allocated":2969600,"data_stored":1813447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.493742"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.191540+0000","last_change":"2023-07-12T02:02:13.337541+0000","last_active":"2023-07-12T02:02:15.191540+0000","last_peered":"2023-07-12T02:02:15.191540+0000","last_clean":"2023-07-12T02:02:15.191540+0000","last_became_active":"2023-07-12T02:02:13.337208+0000","last_became_peered":"2023-07-12T02:02:13.337208+0000","last_unstale":"2023-07-12T02:02:15.191540+0000","last_undegraded":"2023-07-12T02:02:15.191540+0000","last_fullsized":"2023-07-12T02:02:15.191540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:20:47.394363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316831+0000","last_change":"2023-07-12T02:02:13.326771+0000","last_active":"2023-07-12T02:02:14.316831+0000","last_peered":"2023-07-12T02:02:14.316831+0000","last_clean":"2023-07-12T02:02:14.316831+0000","last_became_active":"2023-07-12T02:02:13.326496+0000","last_became_peered":"2023-07-12T02:02:13.326496+0000","last_unstale":"2023-07-12T02:02:14.316831+0000","last_undegraded":"2023-07-12T02:02:14.316831+0000","last_fullsized":"2023-07-12T02:02:14.316831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:15:32.479260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317741+0000","last_change":"2023-07-12T02:02:13.329834+0000","last_active":"2023-07-12T02:02:14.317741+0000","last_peered":"2023-07-12T02:02:14.317741+0000","last_clean":"2023-07-12T02:02:14.317741+0000","last_became_active":"2023-07-12T02:02:13.329474+0000","last_became_peered":"2023-07-12T02:02:13.329474+0000","last_unstale":"2023-07-12T02:02:14.317741+0000","last_undegraded":"2023-07-12T02:02:14.317741+0000","last_fullsized":"2023-07-12T02:02:14.317741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:21:36.117239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691723+0000","last_change":"2023-07-12T02:02:13.334760+0000","last_active":"2023-07-12T02:02:15.691723+0000","last_peered":"2023-07-12T02:02:15.691723+0000","last_clean":"2023-07-12T02:02:15.691723+0000","last_became_active":"2023-07-12T02:02:13.329155+0000","last_became_peered":"2023-07-12T02:02:13.329155+0000","last_unstale":"2023-07-12T02:02:15.691723+0000","last_undegraded":"2023-07-12T02:02:15.691723+0000","last_fullsized":"2023-07-12T02:02:15.691723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:51:50.388106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691861+0000","last_change":"2023-07-12T02:02:13.342289+0000","last_active":"2023-07-12T02:02:15.691861+0000","last_peered":"2023-07-12T02:02:15.691861+0000","last_clean":"2023-07-12T02:02:15.691861+0000","last_became_active":"2023-07-12T02:02:13.341024+0000","last_became_peered":"2023-07-12T02:02:13.341024+0000","last_unstale":"2023-07-12T02:02:15.691861+0000","last_undegraded":"2023-07-12T02:02:15.691861+0000","last_fullsized":"2023-07-12T02:02:15.691861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:17:31.378437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316438+0000","last_change":"2023-07-12T02:02:13.328776+0000","last_active":"2023-07-12T02:02:14.316438+0000","last_peered":"2023-07-12T02:02:14.316438+0000","last_clean":"2023-07-12T02:02:14.316438+0000","last_became_active":"2023-07-12T02:02:13.328433+0000","last_became_peered":"2023-07-12T02:02:13.328433+0000","last_unstale":"2023-07-12T02:02:14.316438+0000","last_undegraded":"2023-07-12T02:02:14.316438+0000","last_fullsized":"2023-07-12T02:02:14.316438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:41:14.864536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.315227+0000","last_change":"2023-07-12T02:02:13.333771+0000","last_active":"2023-07-12T02:02:14.315227+0000","last_peered":"2023-07-12T02:02:14.315227+0000","last_clean":"2023-07-12T02:02:14.315227+0000","last_became_active":"2023-07-12T02:02:13.332954+0000","last_became_peered":"2023-07-12T02:02:13.332954+0000","last_unstale":"2023-07-12T02:02:14.315227+0000","last_undegraded":"2023-07-12T02:02:14.315227+0000","last_fullsized":"2023-07-12T02:02:14.315227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:47:51.304545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316880+0000","last_change":"2023-07-12T02:02:13.321126+0000","last_active":"2023-07-12T02:02:14.316880+0000","last_peered":"2023-07-12T02:02:14.316880+0000","last_clean":"2023-07-12T02:02:14.316880+0000","last_became_active":"2023-07-12T02:02:13.320733+0000","last_became_peered":"2023-07-12T02:02:13.320733+0000","last_unstale":"2023-07-12T02:02:14.316880+0000","last_undegraded":"2023-07-12T02:02:14.316880+0000","last_fullsized":"2023-07-12T02:02:14.316880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:09:38.066919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691377+0000","last_change":"2023-07-12T02:02:13.341524+0000","last_active":"2023-07-12T02:02:15.691377+0000","last_peered":"2023-07-12T02:02:15.691377+0000","last_clean":"2023-07-12T02:02:15.691377+0000","last_became_active":"2023-07-12T02:02:13.341060+0000","last_became_peered":"2023-07-12T02:02:13.341060+0000","last_unstale":"2023-07-12T02:02:15.691377+0000","last_undegraded":"2023-07-12T02:02:15.691377+0000","last_fullsized":"2023-07-12T02:02:15.691377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:35:02.686768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317439+0000","last_change":"2023-07-12T02:02:13.335214+0000","last_active":"2023-07-12T02:02:14.317439+0000","last_peered":"2023-07-12T02:02:14.317439+0000","last_clean":"2023-07-12T02:02:14.317439+0000","last_became_active":"2023-07-12T02:02:13.334928+0000","last_became_peered":"2023-07-12T02:02:13.334928+0000","last_unstale":"2023-07-12T02:02:14.317439+0000","last_undegraded":"2023-07-12T02:02:14.317439+0000","last_fullsized":"2023-07-12T02:02:14.317439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:17:05.090789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317721+0000","last_change":"2023-07-12T02:02:13.327183+0000","last_active":"2023-07-12T02:02:14.317721+0000","last_peered":"2023-07-12T02:02:14.317721+0000","last_clean":"2023-07-12T02:02:14.317721+0000","last_became_active":"2023-07-12T02:02:13.326918+0000","last_became_peered":"2023-07-12T02:02:13.326918+0000","last_unstale":"2023-07-12T02:02:14.317721+0000","last_undegraded":"2023-07-12T02:02:14.317721+0000","last_fullsized":"2023-07-12T02:02:14.317721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:07:26.932388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.191555+0000","last_change":"2023-07-12T02:02:13.330866+0000","last_active":"2023-07-12T02:02:15.191555+0000","last_peered":"2023-07-12T02:02:15.191555+0000","last_clean":"2023-07-12T02:02:15.191555+0000","last_became_active":"2023-07-12T02:02:13.330331+0000","last_became_peered":"2023-07-12T02:02:13.330331+0000","last_unstale":"2023-07-12T02:02:15.191555+0000","last_undegraded":"2023-07-12T02:02:15.191555+0000","last_fullsized":"2023-07-12T02:02:15.191555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:07:56.951503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.191446+0000","last_change":"2023-07-12T02:02:13.337965+0000","last_active":"2023-07-12T02:02:15.191446+0000","last_peered":"2023-07-12T02:02:15.191446+0000","last_clean":"2023-07-12T02:02:15.191446+0000","last_became_active":"2023-07-12T02:02:13.337069+0000","last_became_peered":"2023-07-12T02:02:13.337069+0000","last_unstale":"2023-07-12T02:02:15.191446+0000","last_undegraded":"2023-07-12T02:02:15.191446+0000","last_fullsized":"2023-07-12T02:02:15.191446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:26:12.486521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316721+0000","last_change":"2023-07-12T02:02:13.333391+0000","last_active":"2023-07-12T02:02:14.316721+0000","last_peered":"2023-07-12T02:02:14.316721+0000","last_clean":"2023-07-12T02:02:14.316721+0000","last_became_active":"2023-07-12T02:02:13.333091+0000","last_became_peered":"2023-07-12T02:02:13.333091+0000","last_unstale":"2023-07-12T02:02:14.316721+0000","last_undegraded":"2023-07-12T02:02:14.316721+0000","last_fullsized":"2023-07-12T02:02:14.316721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:17:08.165931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.315629+0000","last_change":"2023-07-12T02:02:13.333879+0000","last_active":"2023-07-12T02:02:14.315629+0000","last_peered":"2023-07-12T02:02:14.315629+0000","last_clean":"2023-07-12T02:02:14.315629+0000","last_became_active":"2023-07-12T02:02:13.333334+0000","last_became_peered":"2023-07-12T02:02:13.333334+0000","last_unstale":"2023-07-12T02:02:14.315629+0000","last_undegraded":"2023-07-12T02:02:14.315629+0000","last_fullsized":"2023-07-12T02:02:14.315629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:52:47.727485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316830+0000","last_change":"2023-07-12T02:02:13.328684+0000","last_active":"2023-07-12T02:02:14.316830+0000","last_peered":"2023-07-12T02:02:14.316830+0000","last_clean":"2023-07-12T02:02:14.316830+0000","last_became_active":"2023-07-12T02:02:13.328364+0000","last_became_peered":"2023-07-12T02:02:13.328364+0000","last_unstale":"2023-07-12T02:02:14.316830+0000","last_undegraded":"2023-07-12T02:02:14.316830+0000","last_fullsized":"2023-07-12T02:02:14.316830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:22:15.093456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691489+0000","last_change":"2023-07-12T02:02:13.341527+0000","last_active":"2023-07-12T02:02:15.691489+0000","last_peered":"2023-07-12T02:02:15.691489+0000","last_clean":"2023-07-12T02:02:15.691489+0000","last_became_active":"2023-07-12T02:02:13.341127+0000","last_became_peered":"2023-07-12T02:02:13.341127+0000","last_unstale":"2023-07-12T02:02:15.691489+0000","last_undegraded":"2023-07-12T02:02:15.691489+0000","last_fullsized":"2023-07-12T02:02:15.691489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:38:03.475718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317709+0000","last_change":"2023-07-12T02:02:13.330871+0000","last_active":"2023-07-12T02:02:14.317709+0000","last_peered":"2023-07-12T02:02:14.317709+0000","last_clean":"2023-07-12T02:02:14.317709+0000","last_became_active":"2023-07-12T02:02:13.330590+0000","last_became_peered":"2023-07-12T02:02:13.330590+0000","last_unstale":"2023-07-12T02:02:14.317709+0000","last_undegraded":"2023-07-12T02:02:14.317709+0000","last_fullsized":"2023-07-12T02:02:14.317709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:11:43.867415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.191737+0000","last_change":"2023-07-12T02:02:13.326393+0000","last_active":"2023-07-12T02:02:15.191737+0000","last_peered":"2023-07-12T02:02:15.191737+0000","last_clean":"2023-07-12T02:02:15.191737+0000","last_became_active":"2023-07-12T02:02:13.326082+0000","last_became_peered":"2023-07-12T02:02:13.326082+0000","last_unstale":"2023-07-12T02:02:15.191737+0000","last_undegraded":"2023-07-12T02:02:15.191737+0000","last_fullsized":"2023-07-12T02:02:15.191737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:12:44.190253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317826+0000","last_change":"2023-07-12T02:02:13.322548+0000","last_active":"2023-07-12T02:02:14.317826+0000","last_peered":"2023-07-12T02:02:14.317826+0000","last_clean":"2023-07-12T02:02:14.317826+0000","last_became_active":"2023-07-12T02:02:13.322298+0000","last_became_peered":"2023-07-12T02:02:13.322298+0000","last_unstale":"2023-07-12T02:02:14.317826+0000","last_undegraded":"2023-07-12T02:02:14.317826+0000","last_fullsized":"2023-07-12T02:02:14.317826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:31:00.185527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.315759+0000","last_change":"2023-07-12T02:02:13.337864+0000","last_active":"2023-07-12T02:02:14.315759+0000","last_peered":"2023-07-12T02:02:14.315759+0000","last_clean":"2023-07-12T02:02:14.315759+0000","last_became_active":"2023-07-12T02:02:13.337675+0000","last_became_peered":"2023-07-12T02:02:13.337675+0000","last_unstale":"2023-07-12T02:02:14.315759+0000","last_undegraded":"2023-07-12T02:02:14.315759+0000","last_fullsized":"2023-07-12T02:02:14.315759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:31:00.185527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691909+0000","last_change":"2023-07-12T02:02:13.341938+0000","last_active":"2023-07-12T02:02:15.691909+0000","last_peered":"2023-07-12T02:02:15.691909+0000","last_clean":"2023-07-12T02:02:15.691909+0000","last_became_active":"2023-07-12T02:02:13.341364+0000","last_became_peered":"2023-07-12T02:02:13.341364+0000","last_unstale":"2023-07-12T02:02:15.691909+0000","last_undegraded":"2023-07-12T02:02:15.691909+0000","last_fullsized":"2023-07-12T02:02:15.691909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:47:51.304545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.668205+0000","last_change":"2023-07-12T02:02:13.337225+0000","last_active":"2023-07-12T02:02:15.668205+0000","last_peered":"2023-07-12T02:02:15.668205+0000","last_clean":"2023-07-12T02:02:15.668205+0000","last_became_active":"2023-07-12T02:02:13.336940+0000","last_became_peered":"2023-07-12T02:02:13.336940+0000","last_unstale":"2023-07-12T02:02:15.668205+0000","last_undegraded":"2023-07-12T02:02:15.668205+0000","last_fullsized":"2023-07-12T02:02:15.668205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:17:31.378437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.315161+0000","last_change":"2023-07-12T02:02:13.325230+0000","last_active":"2023-07-12T02:02:14.315161+0000","last_peered":"2023-07-12T02:02:14.315161+0000","last_clean":"2023-07-12T02:02:14.315161+0000","last_became_active":"2023-07-12T02:02:13.324929+0000","last_became_peered":"2023-07-12T02:02:13.324929+0000","last_unstale":"2023-07-12T02:02:14.315161+0000","last_undegraded":"2023-07-12T02:02:14.315161+0000","last_fullsized":"2023-07-12T02:02:14.315161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:25:19.868800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.692169+0000","last_change":"2023-07-12T02:02:13.327418+0000","last_active":"2023-07-12T02:02:15.692169+0000","last_peered":"2023-07-12T02:02:15.692169+0000","last_clean":"2023-07-12T02:02:15.692169+0000","last_became_active":"2023-07-12T02:02:13.327154+0000","last_became_peered":"2023-07-12T02:02:13.327154+0000","last_unstale":"2023-07-12T02:02:15.692169+0000","last_undegraded":"2023-07-12T02:02:15.692169+0000","last_fullsized":"2023-07-12T02:02:15.692169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:17:05.090789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.692234+0000","last_change":"2023-07-12T02:02:13.330432+0000","last_active":"2023-07-12T02:02:15.692234+0000","last_peered":"2023-07-12T02:02:15.692234+0000","last_clean":"2023-07-12T02:02:15.692234+0000","last_became_active":"2023-07-12T02:02:13.330105+0000","last_became_peered":"2023-07-12T02:02:13.330105+0000","last_unstale":"2023-07-12T02:02:15.692234+0000","last_undegraded":"2023-07-12T02:02:15.692234+0000","last_fullsized":"2023-07-12T02:02:15.692234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:40:06.976699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317496+0000","last_change":"2023-07-12T02:02:13.319765+0000","last_active":"2023-07-12T02:02:14.317496+0000","last_peered":"2023-07-12T02:02:14.317496+0000","last_clean":"2023-07-12T02:02:14.317496+0000","last_became_active":"2023-07-12T02:02:13.319286+0000","last_became_peered":"2023-07-12T02:02:13.319286+0000","last_unstale":"2023-07-12T02:02:14.317496+0000","last_undegraded":"2023-07-12T02:02:14.317496+0000","last_fullsized":"2023-07-12T02:02:14.317496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:16:46.331127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316716+0000","last_change":"2023-07-12T02:02:12.321483+0000","last_active":"2023-07-12T02:02:14.316716+0000","last_peered":"2023-07-12T02:02:14.316716+0000","last_clean":"2023-07-12T02:02:14.316716+0000","last_became_active":"2023-07-12T02:02:12.321175+0000","last_became_peered":"2023-07-12T02:02:12.321175+0000","last_unstale":"2023-07-12T02:02:14.316716+0000","last_undegraded":"2023-07-12T02:02:14.316716+0000","last_fullsized":"2023-07-12T02:02:14.316716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:47:50.297258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.668633+0000","last_change":"2023-07-12T02:02:13.330375+0000","last_active":"2023-07-12T02:02:15.668633+0000","last_peered":"2023-07-12T02:02:15.668633+0000","last_clean":"2023-07-12T02:02:15.668633+0000","last_became_active":"2023-07-12T02:02:13.330053+0000","last_became_peered":"2023-07-12T02:02:13.330053+0000","last_unstale":"2023-07-12T02:02:15.668633+0000","last_undegraded":"2023-07-12T02:02:15.668633+0000","last_fullsized":"2023-07-12T02:02:15.668633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:16:17.876200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691910+0000","last_change":"2023-07-12T02:02:12.329289+0000","last_active":"2023-07-12T02:02:15.691910+0000","last_peered":"2023-07-12T02:02:15.691910+0000","last_clean":"2023-07-12T02:02:15.691910+0000","last_became_active":"2023-07-12T02:02:12.328952+0000","last_became_peered":"2023-07-12T02:02:12.328952+0000","last_unstale":"2023-07-12T02:02:15.691910+0000","last_undegraded":"2023-07-12T02:02:15.691910+0000","last_fullsized":"2023-07-12T02:02:15.691910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:38:02.468430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691984+0000","last_change":"2023-07-12T02:02:13.328323+0000","last_active":"2023-07-12T02:02:15.691984+0000","last_peered":"2023-07-12T02:02:15.691984+0000","last_clean":"2023-07-12T02:02:15.691984+0000","last_became_active":"2023-07-12T02:02:13.328037+0000","last_became_peered":"2023-07-12T02:02:13.328037+0000","last_unstale":"2023-07-12T02:02:15.691984+0000","last_undegraded":"2023-07-12T02:02:15.691984+0000","last_fullsized":"2023-07-12T02:02:15.691984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:22:15.093456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.668381+0000","last_change":"2023-07-12T02:02:12.327049+0000","last_active":"2023-07-12T02:02:15.668381+0000","last_peered":"2023-07-12T02:02:15.668381+0000","last_clean":"2023-07-12T02:02:15.668381+0000","last_became_active":"2023-07-12T02:02:12.326705+0000","last_became_peered":"2023-07-12T02:02:12.326705+0000","last_unstale":"2023-07-12T02:02:15.668381+0000","last_undegraded":"2023-07-12T02:02:15.668381+0000","last_fullsized":"2023-07-12T02:02:15.668381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:14:42.639913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691892+0000","last_change":"2023-07-12T02:02:13.324681+0000","last_active":"2023-07-12T02:02:15.691892+0000","last_peered":"2023-07-12T02:02:15.691892+0000","last_clean":"2023-07-12T02:02:15.691892+0000","last_became_active":"2023-07-12T02:02:13.324399+0000","last_became_peered":"2023-07-12T02:02:13.324399+0000","last_unstale":"2023-07-12T02:02:15.691892+0000","last_undegraded":"2023-07-12T02:02:15.691892+0000","last_fullsized":"2023-07-12T02:02:15.691892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:43:24.727241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691505+0000","last_change":"2023-07-12T02:02:12.325851+0000","last_active":"2023-07-12T02:02:15.691505+0000","last_peered":"2023-07-12T02:02:15.691505+0000","last_clean":"2023-07-12T02:02:15.691505+0000","last_became_active":"2023-07-12T02:02:12.325017+0000","last_became_peered":"2023-07-12T02:02:12.325017+0000","last_unstale":"2023-07-12T02:02:15.691505+0000","last_undegraded":"2023-07-12T02:02:15.691505+0000","last_fullsized":"2023-07-12T02:02:15.691505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:43:23.719954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.668328+0000","last_change":"2023-07-12T02:02:13.334083+0000","last_active":"2023-07-12T02:02:15.668328+0000","last_peered":"2023-07-12T02:02:15.668328+0000","last_clean":"2023-07-12T02:02:15.668328+0000","last_became_active":"2023-07-12T02:02:13.328586+0000","last_became_peered":"2023-07-12T02:02:13.328586+0000","last_unstale":"2023-07-12T02:02:15.668328+0000","last_undegraded":"2023-07-12T02:02:15.668328+0000","last_fullsized":"2023-07-12T02:02:15.668328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:22:15.093456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316972+0000","last_change":"2023-07-12T02:02:12.320616+0000","last_active":"2023-07-12T02:02:14.316972+0000","last_peered":"2023-07-12T02:02:14.316972+0000","last_clean":"2023-07-12T02:02:14.316972+0000","last_became_active":"2023-07-12T02:02:12.320352+0000","last_became_peered":"2023-07-12T02:02:12.320352+0000","last_unstale":"2023-07-12T02:02:14.316972+0000","last_undegraded":"2023-07-12T02:02:14.316972+0000","last_fullsized":"2023-07-12T02:02:14.316972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:38:02.468430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.668472+0000","last_change":"2023-07-12T02:02:13.330996+0000","last_active":"2023-07-12T02:02:15.668472+0000","last_peered":"2023-07-12T02:02:15.668472+0000","last_clean":"2023-07-12T02:02:15.668472+0000","last_became_active":"2023-07-12T02:02:13.330717+0000","last_became_peered":"2023-07-12T02:02:13.330717+0000","last_unstale":"2023-07-12T02:02:15.668472+0000","last_undegraded":"2023-07-12T02:02:15.668472+0000","last_fullsized":"2023-07-12T02:02:15.668472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:46:15.278272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.315527+0000","last_change":"2023-07-12T02:02:12.329122+0000","last_active":"2023-07-12T02:02:14.315527+0000","last_peered":"2023-07-12T02:02:14.315527+0000","last_clean":"2023-07-12T02:02:14.315527+0000","last_became_active":"2023-07-12T02:02:12.328805+0000","last_became_peered":"2023-07-12T02:02:12.328805+0000","last_unstale":"2023-07-12T02:02:14.315527+0000","last_undegraded":"2023-07-12T02:02:14.315527+0000","last_fullsized":"2023-07-12T02:02:14.315527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:20:27.289712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691585+0000","last_change":"2023-07-12T02:02:13.326651+0000","last_active":"2023-07-12T02:02:15.691585+0000","last_peered":"2023-07-12T02:02:15.691585+0000","last_clean":"2023-07-12T02:02:15.691585+0000","last_became_active":"2023-07-12T02:02:13.326284+0000","last_became_peered":"2023-07-12T02:02:13.326284+0000","last_unstale":"2023-07-12T02:02:15.691585+0000","last_undegraded":"2023-07-12T02:02:15.691585+0000","last_fullsized":"2023-07-12T02:02:15.691585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:17:08.165931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317640+0000","last_change":"2023-07-12T02:02:12.320231+0000","last_active":"2023-07-12T02:02:14.317640+0000","last_peered":"2023-07-12T02:02:14.317640+0000","last_clean":"2023-07-12T02:02:14.317640+0000","last_became_active":"2023-07-12T02:02:12.319927+0000","last_became_peered":"2023-07-12T02:02:12.319927+0000","last_unstale":"2023-07-12T02:02:14.317640+0000","last_undegraded":"2023-07-12T02:02:14.317640+0000","last_fullsized":"2023-07-12T02:02:14.317640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:35:50.916494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317455+0000","last_change":"2023-07-12T02:02:13.322009+0000","last_active":"2023-07-12T02:02:14.317455+0000","last_peered":"2023-07-12T02:02:14.317455+0000","last_clean":"2023-07-12T02:02:14.317455+0000","last_became_active":"2023-07-12T02:02:13.321743+0000","last_became_peered":"2023-07-12T02:02:13.321743+0000","last_unstale":"2023-07-12T02:02:14.317455+0000","last_undegraded":"2023-07-12T02:02:14.317455+0000","last_fullsized":"2023-07-12T02:02:14.317455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:52:47.727485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.315586+0000","last_change":"2023-07-12T02:02:12.324867+0000","last_active":"2023-07-12T02:02:14.315586+0000","last_peered":"2023-07-12T02:02:14.315586+0000","last_clean":"2023-07-12T02:02:14.315586+0000","last_became_active":"2023-07-12T02:02:12.324548+0000","last_became_peered":"2023-07-12T02:02:12.324548+0000","last_unstale":"2023-07-12T02:02:14.315586+0000","last_undegraded":"2023-07-12T02:02:14.315586+0000","last_fullsized":"2023-07-12T02:02:14.315586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:16:16.868913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.668616+0000","last_change":"2023-07-12T02:02:13.331949+0000","last_active":"2023-07-12T02:02:15.668616+0000","last_peered":"2023-07-12T02:02:15.668616+0000","last_clean":"2023-07-12T02:02:15.668616+0000","last_became_active":"2023-07-12T02:02:13.331691+0000","last_became_peered":"2023-07-12T02:02:13.331691+0000","last_unstale":"2023-07-12T02:02:15.668616+0000","last_undegraded":"2023-07-12T02:02:15.668616+0000","last_fullsized":"2023-07-12T02:02:15.668616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:20:28.296999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.692068+0000","last_change":"2023-07-12T02:02:12.323570+0000","last_active":"2023-07-12T02:02:15.692068+0000","last_peered":"2023-07-12T02:02:15.692068+0000","last_clean":"2023-07-12T02:02:15.692068+0000","last_became_active":"2023-07-12T02:02:12.323259+0000","last_became_peered":"2023-07-12T02:02:12.323259+0000","last_unstale":"2023-07-12T02:02:15.692068+0000","last_undegraded":"2023-07-12T02:02:15.692068+0000","last_fullsized":"2023-07-12T02:02:15.692068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:57:41.776255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317309+0000","last_change":"2023-07-12T02:02:13.319909+0000","last_active":"2023-07-12T02:02:14.317309+0000","last_peered":"2023-07-12T02:02:14.317309+0000","last_clean":"2023-07-12T02:02:14.317309+0000","last_became_active":"2023-07-12T02:02:13.319598+0000","last_became_peered":"2023-07-12T02:02:13.319598+0000","last_unstale":"2023-07-12T02:02:14.317309+0000","last_undegraded":"2023-07-12T02:02:14.317309+0000","last_fullsized":"2023-07-12T02:02:14.317309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:41:14.864536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.315384+0000","last_change":"2023-07-12T02:02:12.324817+0000","last_active":"2023-07-12T02:02:14.315384+0000","last_peered":"2023-07-12T02:02:14.315384+0000","last_clean":"2023-07-12T02:02:14.315384+0000","last_became_active":"2023-07-12T02:02:12.324534+0000","last_became_peered":"2023-07-12T02:02:12.324534+0000","last_unstale":"2023-07-12T02:02:14.315384+0000","last_undegraded":"2023-07-12T02:02:14.315384+0000","last_fullsized":"2023-07-12T02:02:14.315384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:57:41.776255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691748+0000","last_change":"2023-07-12T02:02:13.341596+0000","last_active":"2023-07-12T02:02:15.691748+0000","last_peered":"2023-07-12T02:02:15.691748+0000","last_clean":"2023-07-12T02:02:15.691748+0000","last_became_active":"2023-07-12T02:02:13.341271+0000","last_became_peered":"2023-07-12T02:02:13.341271+0000","last_unstale":"2023-07-12T02:02:15.691748+0000","last_undegraded":"2023-07-12T02:02:15.691748+0000","last_fullsized":"2023-07-12T02:02:15.691748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:41:14.864536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691606+0000","last_change":"2023-07-12T02:02:12.321840+0000","last_active":"2023-07-12T02:02:15.691606+0000","last_peered":"2023-07-12T02:02:15.691606+0000","last_clean":"2023-07-12T02:02:15.691606+0000","last_became_active":"2023-07-12T02:02:12.321551+0000","last_became_peered":"2023-07-12T02:02:12.321551+0000","last_unstale":"2023-07-12T02:02:15.691606+0000","last_undegraded":"2023-07-12T02:02:15.691606+0000","last_fullsized":"2023-07-12T02:02:15.691606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:20:50.862038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.668968+0000","last_change":"2023-07-12T02:02:13.336049+0000","last_active":"2023-07-12T02:02:15.668968+0000","last_peered":"2023-07-12T02:02:15.668968+0000","last_clean":"2023-07-12T02:02:15.668968+0000","last_became_active":"2023-07-12T02:02:13.334580+0000","last_became_peered":"2023-07-12T02:02:13.334580+0000","last_unstale":"2023-07-12T02:02:15.668968+0000","last_undegraded":"2023-07-12T02:02:15.668968+0000","last_fullsized":"2023-07-12T02:02:15.668968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:11:43.867415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.315399+0000","last_change":"2023-07-12T02:02:12.321103+0000","last_active":"2023-07-12T02:02:14.315399+0000","last_peered":"2023-07-12T02:02:14.315399+0000","last_clean":"2023-07-12T02:02:14.315399+0000","last_became_active":"2023-07-12T02:02:12.320783+0000","last_became_peered":"2023-07-12T02:02:12.320783+0000","last_unstale":"2023-07-12T02:02:14.315399+0000","last_undegraded":"2023-07-12T02:02:14.315399+0000","last_fullsized":"2023-07-12T02:02:14.315399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:46:14.270985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316978+0000","last_change":"2023-07-12T02:02:13.319686+0000","last_active":"2023-07-12T02:02:14.316978+0000","last_peered":"2023-07-12T02:02:14.316978+0000","last_clean":"2023-07-12T02:02:14.316978+0000","last_became_active":"2023-07-12T02:02:13.319473+0000","last_became_peered":"2023-07-12T02:02:13.319473+0000","last_unstale":"2023-07-12T02:02:14.316978+0000","last_undegraded":"2023-07-12T02:02:14.316978+0000","last_fullsized":"2023-07-12T02:02:14.316978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:43:24.727241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.315771+0000","last_change":"2023-07-12T02:02:12.323782+0000","last_active":"2023-07-12T02:02:14.315771+0000","last_peered":"2023-07-12T02:02:14.315771+0000","last_clean":"2023-07-12T02:02:14.315771+0000","last_became_active":"2023-07-12T02:02:12.323508+0000","last_became_peered":"2023-07-12T02:02:12.323508+0000","last_unstale":"2023-07-12T02:02:14.315771+0000","last_undegraded":"2023-07-12T02:02:14.315771+0000","last_fullsized":"2023-07-12T02:02:14.315771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:35:50.916494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316527+0000","last_change":"2023-07-12T02:02:13.326752+0000","last_active":"2023-07-12T02:02:14.316527+0000","last_peered":"2023-07-12T02:02:14.316527+0000","last_clean":"2023-07-12T02:02:14.316527+0000","last_became_active":"2023-07-12T02:02:13.326494+0000","last_became_peered":"2023-07-12T02:02:13.326494+0000","last_unstale":"2023-07-12T02:02:14.316527+0000","last_undegraded":"2023-07-12T02:02:14.316527+0000","last_fullsized":"2023-07-12T02:02:14.316527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:17:31.378437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.315358+0000","last_change":"2023-07-12T02:02:12.323136+0000","last_active":"2023-07-12T02:02:14.315358+0000","last_peered":"2023-07-12T02:02:14.315358+0000","last_clean":"2023-07-12T02:02:14.315358+0000","last_became_active":"2023-07-12T02:02:12.322786+0000","last_became_peered":"2023-07-12T02:02:12.322786+0000","last_unstale":"2023-07-12T02:02:14.315358+0000","last_undegraded":"2023-07-12T02:02:14.315358+0000","last_fullsized":"2023-07-12T02:02:14.315358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:14:42.639913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691998+0000","last_change":"2023-07-12T02:02:13.328969+0000","last_active":"2023-07-12T02:02:15.691998+0000","last_peered":"2023-07-12T02:02:15.691998+0000","last_clean":"2023-07-12T02:02:15.691998+0000","last_became_active":"2023-07-12T02:02:13.328727+0000","last_became_peered":"2023-07-12T02:02:13.328727+0000","last_unstale":"2023-07-12T02:02:15.691998+0000","last_undegraded":"2023-07-12T02:02:15.691998+0000","last_fullsized":"2023-07-12T02:02:15.691998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:09:38.066919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316868+0000","last_change":"2023-07-12T02:02:12.329043+0000","last_active":"2023-07-12T02:02:14.316868+0000","last_peered":"2023-07-12T02:02:14.316868+0000","last_clean":"2023-07-12T02:02:14.316868+0000","last_became_active":"2023-07-12T02:02:12.328739+0000","last_became_peered":"2023-07-12T02:02:12.328739+0000","last_unstale":"2023-07-12T02:02:14.316868+0000","last_undegraded":"2023-07-12T02:02:14.316868+0000","last_fullsized":"2023-07-12T02:02:14.316868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:35:01.679481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691479+0000","last_change":"2023-07-12T02:02:13.341847+0000","last_active":"2023-07-12T02:02:15.691479+0000","last_peered":"2023-07-12T02:02:15.691479+0000","last_clean":"2023-07-12T02:02:15.691479+0000","last_became_active":"2023-07-12T02:02:13.341458+0000","last_became_peered":"2023-07-12T02:02:13.341458+0000","last_unstale":"2023-07-12T02:02:15.691479+0000","last_undegraded":"2023-07-12T02:02:15.691479+0000","last_fullsized":"2023-07-12T02:02:15.691479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:09:38.066919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.668658+0000","last_change":"2023-07-12T02:02:12.328920+0000","last_active":"2023-07-12T02:02:15.668658+0000","last_peered":"2023-07-12T02:02:15.668658+0000","last_clean":"2023-07-12T02:02:15.668658+0000","last_became_active":"2023-07-12T02:02:12.328621+0000","last_became_peered":"2023-07-12T02:02:12.328621+0000","last_unstale":"2023-07-12T02:02:15.668658+0000","last_undegraded":"2023-07-12T02:02:15.668658+0000","last_fullsized":"2023-07-12T02:02:15.668658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:52:46.720198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317790+0000","last_change":"2023-07-12T02:02:13.325579+0000","last_active":"2023-07-12T02:02:14.317790+0000","last_peered":"2023-07-12T02:02:14.317790+0000","last_clean":"2023-07-12T02:02:14.317790+0000","last_became_active":"2023-07-12T02:02:13.325322+0000","last_became_peered":"2023-07-12T02:02:13.325322+0000","last_unstale":"2023-07-12T02:02:14.317790+0000","last_undegraded":"2023-07-12T02:02:14.317790+0000","last_fullsized":"2023-07-12T02:02:14.317790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:44:33.522394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691901+0000","last_change":"2023-07-12T02:02:12.326368+0000","last_active":"2023-07-12T02:02:15.691901+0000","last_peered":"2023-07-12T02:02:15.691901+0000","last_clean":"2023-07-12T02:02:15.691901+0000","last_became_active":"2023-07-12T02:02:12.326046+0000","last_became_peered":"2023-07-12T02:02:12.326046+0000","last_unstale":"2023-07-12T02:02:15.691901+0000","last_undegraded":"2023-07-12T02:02:15.691901+0000","last_fullsized":"2023-07-12T02:02:15.691901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:35:01.679481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317887+0000","last_change":"2023-07-12T02:02:13.333650+0000","last_active":"2023-07-12T02:02:14.317887+0000","last_peered":"2023-07-12T02:02:14.317887+0000","last_clean":"2023-07-12T02:02:14.317887+0000","last_became_active":"2023-07-12T02:02:13.333379+0000","last_became_peered":"2023-07-12T02:02:13.333379+0000","last_unstale":"2023-07-12T02:02:14.317887+0000","last_undegraded":"2023-07-12T02:02:14.317887+0000","last_fullsized":"2023-07-12T02:02:14.317887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:40:15.684880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316971+0000","last_change":"2023-07-12T02:02:12.322163+0000","last_active":"2023-07-12T02:02:14.316971+0000","last_peered":"2023-07-12T02:02:14.316971+0000","last_clean":"2023-07-12T02:02:14.316971+0000","last_became_active":"2023-07-12T02:02:12.321873+0000","last_became_peered":"2023-07-12T02:02:12.321873+0000","last_unstale":"2023-07-12T02:02:14.316971+0000","last_undegraded":"2023-07-12T02:02:14.316971+0000","last_fullsized":"2023-07-12T02:02:14.316971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:57:41.776255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317708+0000","last_change":"2023-07-12T02:02:13.324741+0000","last_active":"2023-07-12T02:02:14.317708+0000","last_peered":"2023-07-12T02:02:14.317708+0000","last_clean":"2023-07-12T02:02:14.317708+0000","last_became_active":"2023-07-12T02:02:13.324436+0000","last_became_peered":"2023-07-12T02:02:13.324436+0000","last_unstale":"2023-07-12T02:02:14.317708+0000","last_undegraded":"2023-07-12T02:02:14.317708+0000","last_fullsized":"2023-07-12T02:02:14.317708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:30:11.751660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.668197+0000","last_change":"2023-07-12T02:02:12.328371+0000","last_active":"2023-07-12T02:02:15.668197+0000","last_peered":"2023-07-12T02:02:15.668197+0000","last_clean":"2023-07-12T02:02:15.668197+0000","last_became_active":"2023-07-12T02:02:12.328097+0000","last_became_peered":"2023-07-12T02:02:12.328097+0000","last_unstale":"2023-07-12T02:02:15.668197+0000","last_undegraded":"2023-07-12T02:02:15.668197+0000","last_fullsized":"2023-07-12T02:02:15.668197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:25:18.861513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.692343+0000","last_change":"2023-07-12T02:02:13.327528+0000","last_active":"2023-07-12T02:02:15.692343+0000","last_peered":"2023-07-12T02:02:15.692343+0000","last_clean":"2023-07-12T02:02:15.692343+0000","last_became_active":"2023-07-12T02:02:13.327211+0000","last_became_peered":"2023-07-12T02:02:13.327211+0000","last_unstale":"2023-07-12T02:02:15.692343+0000","last_undegraded":"2023-07-12T02:02:15.692343+0000","last_fullsized":"2023-07-12T02:02:15.692343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:17:31.378437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.668851+0000","last_change":"2023-07-12T02:02:12.326201+0000","last_active":"2023-07-12T02:02:15.668851+0000","last_peered":"2023-07-12T02:02:15.668851+0000","last_clean":"2023-07-12T02:02:15.668851+0000","last_became_active":"2023-07-12T02:02:12.325620+0000","last_became_peered":"2023-07-12T02:02:12.325620+0000","last_unstale":"2023-07-12T02:02:15.668851+0000","last_undegraded":"2023-07-12T02:02:15.668851+0000","last_fullsized":"2023-07-12T02:02:15.668851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:30:10.744373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317820+0000","last_change":"2023-07-12T02:02:07.598601+0000","last_active":"2023-07-12T02:02:14.317820+0000","last_peered":"2023-07-12T02:02:14.317820+0000","last_clean":"2023-07-12T02:02:14.317820+0000","last_became_active":"2023-07-12T02:02:07.598343+0000","last_became_peered":"2023-07-12T02:02:07.598343+0000","last_unstale":"2023-07-12T02:02:14.317820+0000","last_undegraded":"2023-07-12T02:02:14.317820+0000","last_fullsized":"2023-07-12T02:02:14.317820+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:27:59.906561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.668155+0000","last_change":"2023-07-12T02:02:13.323317+0000","last_active":"2023-07-12T02:02:15.668155+0000","last_peered":"2023-07-12T02:02:15.668155+0000","last_clean":"2023-07-12T02:02:15.668155+0000","last_became_active":"2023-07-12T02:02:13.323003+0000","last_became_peered":"2023-07-12T02:02:13.323003+0000","last_unstale":"2023-07-12T02:02:15.668155+0000","last_undegraded":"2023-07-12T02:02:15.668155+0000","last_fullsized":"2023-07-12T02:02:15.668155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:41:14.864536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.668081+0000","last_change":"2023-07-12T02:02:07.268647+0000","last_active":"2023-07-12T02:02:15.668081+0000","last_peered":"2023-07-12T02:02:15.668081+0000","last_clean":"2023-07-12T02:02:15.668081+0000","last_became_active":"2023-07-12T02:02:07.268304+0000","last_became_peered":"2023-07-12T02:02:07.268304+0000","last_unstale":"2023-07-12T02:02:15.668081+0000","last_undegraded":"2023-07-12T02:02:15.668081+0000","last_fullsized":"2023-07-12T02:02:15.668081+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:40:00.932400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.692054+0000","last_change":"2023-07-12T02:02:12.322468+0000","last_active":"2023-07-12T02:02:15.692054+0000","last_peered":"2023-07-12T02:02:15.692054+0000","last_clean":"2023-07-12T02:02:15.692054+0000","last_became_active":"2023-07-12T02:02:12.322170+0000","last_became_peered":"2023-07-12T02:02:12.322170+0000","last_unstale":"2023-07-12T02:02:15.692054+0000","last_undegraded":"2023-07-12T02:02:15.692054+0000","last_fullsized":"2023-07-12T02:02:15.692054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:14:42.639913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317131+0000","last_change":"2023-07-12T02:02:13.317131+0000","last_active":"2023-07-12T02:02:14.317131+0000","last_peered":"2023-07-12T02:02:14.317131+0000","last_clean":"2023-07-12T02:02:14.317131+0000","last_became_active":"2023-07-12T02:02:13.316528+0000","last_became_peered":"2023-07-12T02:02:13.316528+0000","last_unstale":"2023-07-12T02:02:14.317131+0000","last_undegraded":"2023-07-12T02:02:14.317131+0000","last_fullsized":"2023-07-12T02:02:14.317131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:46:15.278272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691739+0000","last_change":"2023-07-12T02:02:07.270653+0000","last_active":"2023-07-12T02:02:15.691739+0000","last_peered":"2023-07-12T02:02:15.691739+0000","last_clean":"2023-07-12T02:02:15.691739+0000","last_became_active":"2023-07-12T02:02:07.270293+0000","last_became_peered":"2023-07-12T02:02:07.270293+0000","last_unstale":"2023-07-12T02:02:15.691739+0000","last_undegraded":"2023-07-12T02:02:15.691739+0000","last_fullsized":"2023-07-12T02:02:15.691739+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:09:32.022620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":169,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.315265+0000","last_change":"2023-07-12T02:02:07.268364+0000","last_active":"2023-07-12T02:02:14.315265+0000","last_peered":"2023-07-12T02:02:14.315265+0000","last_clean":"2023-07-12T02:02:14.315265+0000","last_became_active":"2023-07-12T02:02:07.268074+0000","last_became_peered":"2023-07-12T02:02:07.268074+0000","last_unstale":"2023-07-12T02:02:14.315265+0000","last_undegraded":"2023-07-12T02:02:14.315265+0000","last_fullsized":"2023-07-12T02:02:14.315265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:22:09.049157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691249+0000","last_change":"2023-07-12T02:02:12.324904+0000","last_active":"2023-07-12T02:02:15.691249+0000","last_peered":"2023-07-12T02:02:15.691249+0000","last_clean":"2023-07-12T02:02:15.691249+0000","last_became_active":"2023-07-12T02:02:12.324574+0000","last_became_peered":"2023-07-12T02:02:12.324574+0000","last_unstale":"2023-07-12T02:02:15.691249+0000","last_undegraded":"2023-07-12T02:02:15.691249+0000","last_fullsized":"2023-07-12T02:02:15.691249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:15:31.471972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691896+0000","last_change":"2023-07-12T02:02:13.342641+0000","last_active":"2023-07-12T02:02:15.691896+0000","last_peered":"2023-07-12T02:02:15.691896+0000","last_clean":"2023-07-12T02:02:15.691896+0000","last_became_active":"2023-07-12T02:02:13.341464+0000","last_became_peered":"2023-07-12T02:02:13.341464+0000","last_unstale":"2023-07-12T02:02:15.691896+0000","last_undegraded":"2023-07-12T02:02:15.691896+0000","last_fullsized":"2023-07-12T02:02:15.691896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:25:19.868800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.314955+0000","last_change":"2023-07-12T02:02:07.599189+0000","last_active":"2023-07-12T02:02:14.314955+0000","last_peered":"2023-07-12T02:02:14.314955+0000","last_clean":"2023-07-12T02:02:14.314955+0000","last_became_active":"2023-07-12T02:02:07.598898+0000","last_became_peered":"2023-07-12T02:02:07.598898+0000","last_unstale":"2023-07-12T02:02:14.314955+0000","last_undegraded":"2023-07-12T02:02:14.314955+0000","last_fullsized":"2023-07-12T02:02:14.314955+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:16:40.286828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691543+0000","last_change":"2023-07-12T02:02:12.327140+0000","last_active":"2023-07-12T02:02:15.691543+0000","last_peered":"2023-07-12T02:02:15.691543+0000","last_clean":"2023-07-12T02:02:15.691543+0000","last_became_active":"2023-07-12T02:02:12.326857+0000","last_became_peered":"2023-07-12T02:02:12.326857+0000","last_unstale":"2023-07-12T02:02:15.691543+0000","last_undegraded":"2023-07-12T02:02:15.691543+0000","last_fullsized":"2023-07-12T02:02:15.691543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:37:29.287235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.692241+0000","last_change":"2023-07-12T02:02:13.317477+0000","last_active":"2023-07-12T02:02:15.692241+0000","last_peered":"2023-07-12T02:02:15.692241+0000","last_clean":"2023-07-12T02:02:15.692241+0000","last_became_active":"2023-07-12T02:02:13.317140+0000","last_became_peered":"2023-07-12T02:02:13.317140+0000","last_unstale":"2023-07-12T02:02:15.692241+0000","last_undegraded":"2023-07-12T02:02:15.692241+0000","last_fullsized":"2023-07-12T02:02:15.692241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:41:14.864536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.314948+0000","last_change":"2023-07-12T02:02:07.599193+0000","last_active":"2023-07-12T02:02:14.314948+0000","last_peered":"2023-07-12T02:02:14.314948+0000","last_clean":"2023-07-12T02:02:14.314948+0000","last_became_active":"2023-07-12T02:02:07.598910+0000","last_became_peered":"2023-07-12T02:02:07.598910+0000","last_unstale":"2023-07-12T02:02:14.314948+0000","last_undegraded":"2023-07-12T02:02:14.314948+0000","last_fullsized":"2023-07-12T02:02:14.314948+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:17:25.334138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.668331+0000","last_change":"2023-07-12T02:02:12.325450+0000","last_active":"2023-07-12T02:02:15.668331+0000","last_peered":"2023-07-12T02:02:15.668331+0000","last_clean":"2023-07-12T02:02:15.668331+0000","last_became_active":"2023-07-12T02:02:12.325156+0000","last_became_peered":"2023-07-12T02:02:12.325156+0000","last_unstale":"2023-07-12T02:02:15.668331+0000","last_undegraded":"2023-07-12T02:02:15.668331+0000","last_fullsized":"2023-07-12T02:02:15.668331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:47:50.297258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691914+0000","last_change":"2023-07-12T02:02:13.328081+0000","last_active":"2023-07-12T02:02:15.691914+0000","last_peered":"2023-07-12T02:02:15.691914+0000","last_clean":"2023-07-12T02:02:15.691914+0000","last_became_active":"2023-07-12T02:02:13.327699+0000","last_became_peered":"2023-07-12T02:02:13.327699+0000","last_unstale":"2023-07-12T02:02:15.691914+0000","last_undegraded":"2023-07-12T02:02:15.691914+0000","last_fullsized":"2023-07-12T02:02:15.691914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:15:32.479260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317109+0000","last_change":"2023-07-12T02:02:07.599477+0000","last_active":"2023-07-12T02:02:14.317109+0000","last_peered":"2023-07-12T02:02:14.317109+0000","last_clean":"2023-07-12T02:02:14.317109+0000","last_became_active":"2023-07-12T02:02:07.599111+0000","last_became_peered":"2023-07-12T02:02:07.599111+0000","last_unstale":"2023-07-12T02:02:14.317109+0000","last_undegraded":"2023-07-12T02:02:14.317109+0000","last_fullsized":"2023-07-12T02:02:14.317109+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:40:00.932400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317421+0000","last_change":"2023-07-12T02:02:12.324686+0000","last_active":"2023-07-12T02:02:14.317421+0000","last_peered":"2023-07-12T02:02:14.317421+0000","last_clean":"2023-07-12T02:02:14.317421+0000","last_became_active":"2023-07-12T02:02:12.324422+0000","last_became_peered":"2023-07-12T02:02:12.324422+0000","last_unstale":"2023-07-12T02:02:14.317421+0000","last_undegraded":"2023-07-12T02:02:14.317421+0000","last_fullsized":"2023-07-12T02:02:14.317421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:16:16.868913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.692052+0000","last_change":"2023-07-12T02:02:13.334295+0000","last_active":"2023-07-12T02:02:15.692052+0000","last_peered":"2023-07-12T02:02:15.692052+0000","last_clean":"2023-07-12T02:02:15.692052+0000","last_became_active":"2023-07-12T02:02:13.333688+0000","last_became_peered":"2023-07-12T02:02:13.333688+0000","last_unstale":"2023-07-12T02:02:15.692052+0000","last_undegraded":"2023-07-12T02:02:15.692052+0000","last_fullsized":"2023-07-12T02:02:15.692052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:43:24.727241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.692012+0000","last_change":"2023-07-12T02:02:07.599427+0000","last_active":"2023-07-12T02:02:15.692012+0000","last_peered":"2023-07-12T02:02:15.692012+0000","last_clean":"2023-07-12T02:02:15.692012+0000","last_became_active":"2023-07-12T02:02:07.599063+0000","last_became_peered":"2023-07-12T02:02:07.599063+0000","last_unstale":"2023-07-12T02:02:15.692012+0000","last_undegraded":"2023-07-12T02:02:15.692012+0000","last_fullsized":"2023-07-12T02:02:15.692012+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:37:57.431418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691566+0000","last_change":"2023-07-12T02:02:12.327460+0000","last_active":"2023-07-12T02:02:15.691566+0000","last_peered":"2023-07-12T02:02:15.691566+0000","last_clean":"2023-07-12T02:02:15.691566+0000","last_became_active":"2023-07-12T02:02:12.327176+0000","last_became_peered":"2023-07-12T02:02:12.327176+0000","last_unstale":"2023-07-12T02:02:15.691566+0000","last_undegraded":"2023-07-12T02:02:15.691566+0000","last_fullsized":"2023-07-12T02:02:15.691566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:35:01.679481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691867+0000","last_change":"2023-07-12T02:02:13.340465+0000","last_active":"2023-07-12T02:02:15.691867+0000","last_peered":"2023-07-12T02:02:15.691867+0000","last_clean":"2023-07-12T02:02:15.691867+0000","last_became_active":"2023-07-12T02:02:13.328675+0000","last_became_peered":"2023-07-12T02:02:13.328675+0000","last_unstale":"2023-07-12T02:02:15.691867+0000","last_undegraded":"2023-07-12T02:02:15.691867+0000","last_fullsized":"2023-07-12T02:02:15.691867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:16:46.331127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691845+0000","last_change":"2023-07-12T02:02:07.272059+0000","last_active":"2023-07-12T02:02:15.691845+0000","last_peered":"2023-07-12T02:02:15.691845+0000","last_clean":"2023-07-12T02:02:15.691845+0000","last_became_active":"2023-07-12T02:02:07.271770+0000","last_became_peered":"2023-07-12T02:02:07.271770+0000","last_unstale":"2023-07-12T02:02:15.691845+0000","last_undegraded":"2023-07-12T02:02:15.691845+0000","last_fullsized":"2023-07-12T02:02:15.691845+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:17:02.121632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317463+0000","last_change":"2023-07-12T02:02:12.328981+0000","last_active":"2023-07-12T02:02:14.317463+0000","last_peered":"2023-07-12T02:02:14.317463+0000","last_clean":"2023-07-12T02:02:14.317463+0000","last_became_active":"2023-07-12T02:02:12.328737+0000","last_became_peered":"2023-07-12T02:02:12.328737+0000","last_unstale":"2023-07-12T02:02:14.317463+0000","last_undegraded":"2023-07-12T02:02:14.317463+0000","last_fullsized":"2023-07-12T02:02:14.317463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:17:30.371150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691611+0000","last_change":"2023-07-12T02:02:13.321482+0000","last_active":"2023-07-12T02:02:15.691611+0000","last_peered":"2023-07-12T02:02:15.691611+0000","last_clean":"2023-07-12T02:02:15.691611+0000","last_became_active":"2023-07-12T02:02:13.321146+0000","last_became_peered":"2023-07-12T02:02:13.321146+0000","last_unstale":"2023-07-12T02:02:15.691611+0000","last_undegraded":"2023-07-12T02:02:15.691611+0000","last_fullsized":"2023-07-12T02:02:15.691611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:15:32.479260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691699+0000","last_change":"2023-07-12T02:02:12.324771+0000","last_active":"2023-07-12T02:02:15.691699+0000","last_peered":"2023-07-12T02:02:15.691699+0000","last_clean":"2023-07-12T02:02:15.691699+0000","last_became_active":"2023-07-12T02:02:12.324451+0000","last_became_peered":"2023-07-12T02:02:12.324451+0000","last_unstale":"2023-07-12T02:02:15.691699+0000","last_undegraded":"2023-07-12T02:02:15.691699+0000","last_fullsized":"2023-07-12T02:02:15.691699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:40:05.969412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.191698+0000","last_change":"2023-07-12T02:02:13.330617+0000","last_active":"2023-07-12T02:02:15.191698+0000","last_peered":"2023-07-12T02:02:15.191698+0000","last_clean":"2023-07-12T02:02:15.191698+0000","last_became_active":"2023-07-12T02:02:13.329921+0000","last_became_peered":"2023-07-12T02:02:13.329921+0000","last_unstale":"2023-07-12T02:02:15.191698+0000","last_undegraded":"2023-07-12T02:02:15.191698+0000","last_fullsized":"2023-07-12T02:02:15.191698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:08:44.750937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316667+0000","last_change":"2023-07-12T02:02:12.324065+0000","last_active":"2023-07-12T02:02:14.316667+0000","last_peered":"2023-07-12T02:02:14.316667+0000","last_clean":"2023-07-12T02:02:14.316667+0000","last_became_active":"2023-07-12T02:02:12.323792+0000","last_became_peered":"2023-07-12T02:02:12.323792+0000","last_unstale":"2023-07-12T02:02:14.316667+0000","last_undegraded":"2023-07-12T02:02:14.316667+0000","last_fullsized":"2023-07-12T02:02:14.316667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:37:29.287235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317154+0000","last_change":"2023-07-12T02:02:13.324540+0000","last_active":"2023-07-12T02:02:14.317154+0000","last_peered":"2023-07-12T02:02:14.317154+0000","last_clean":"2023-07-12T02:02:14.317154+0000","last_became_active":"2023-07-12T02:02:13.324245+0000","last_became_peered":"2023-07-12T02:02:13.324245+0000","last_unstale":"2023-07-12T02:02:14.317154+0000","last_undegraded":"2023-07-12T02:02:14.317154+0000","last_fullsized":"2023-07-12T02:02:14.317154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:20:28.296999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317616+0000","last_change":"2023-07-12T02:02:12.323954+0000","last_active":"2023-07-12T02:02:14.317616+0000","last_peered":"2023-07-12T02:02:14.317616+0000","last_clean":"2023-07-12T02:02:14.317616+0000","last_became_active":"2023-07-12T02:02:12.323681+0000","last_became_peered":"2023-07-12T02:02:12.323681+0000","last_unstale":"2023-07-12T02:02:14.317616+0000","last_undegraded":"2023-07-12T02:02:14.317616+0000","last_fullsized":"2023-07-12T02:02:14.317616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:25:18.861513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316914+0000","last_change":"2023-07-12T02:02:13.325210+0000","last_active":"2023-07-12T02:02:14.316914+0000","last_peered":"2023-07-12T02:02:14.316914+0000","last_clean":"2023-07-12T02:02:14.316914+0000","last_became_active":"2023-07-12T02:02:13.324920+0000","last_became_peered":"2023-07-12T02:02:13.324920+0000","last_unstale":"2023-07-12T02:02:14.316914+0000","last_undegraded":"2023-07-12T02:02:14.316914+0000","last_fullsized":"2023-07-12T02:02:14.316914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:14:43.647200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.668728+0000","last_change":"2023-07-12T02:02:12.325289+0000","last_active":"2023-07-12T02:02:15.668728+0000","last_peered":"2023-07-12T02:02:15.668728+0000","last_clean":"2023-07-12T02:02:15.668728+0000","last_became_active":"2023-07-12T02:02:12.324997+0000","last_became_peered":"2023-07-12T02:02:12.324997+0000","last_unstale":"2023-07-12T02:02:15.668728+0000","last_undegraded":"2023-07-12T02:02:15.668728+0000","last_fullsized":"2023-07-12T02:02:15.668728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:35:50.916494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.668398+0000","last_change":"2023-07-12T02:02:13.333732+0000","last_active":"2023-07-12T02:02:15.668398+0000","last_peered":"2023-07-12T02:02:15.668398+0000","last_clean":"2023-07-12T02:02:15.668398+0000","last_became_active":"2023-07-12T02:02:13.332925+0000","last_became_peered":"2023-07-12T02:02:13.332925+0000","last_unstale":"2023-07-12T02:02:15.668398+0000","last_undegraded":"2023-07-12T02:02:15.668398+0000","last_fullsized":"2023-07-12T02:02:15.668398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:57:42.783542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691644+0000","last_change":"2023-07-12T02:02:12.326847+0000","last_active":"2023-07-12T02:02:15.691644+0000","last_peered":"2023-07-12T02:02:15.691644+0000","last_clean":"2023-07-12T02:02:15.691644+0000","last_became_active":"2023-07-12T02:02:12.326564+0000","last_became_peered":"2023-07-12T02:02:12.326564+0000","last_unstale":"2023-07-12T02:02:15.691644+0000","last_undegraded":"2023-07-12T02:02:15.691644+0000","last_fullsized":"2023-07-12T02:02:15.691644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:17:04.083502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316667+0000","last_change":"2023-07-12T02:02:13.324603+0000","last_active":"2023-07-12T02:02:14.316667+0000","last_peered":"2023-07-12T02:02:14.316667+0000","last_clean":"2023-07-12T02:02:14.316667+0000","last_became_active":"2023-07-12T02:02:13.324373+0000","last_became_peered":"2023-07-12T02:02:13.324373+0000","last_unstale":"2023-07-12T02:02:14.316667+0000","last_undegraded":"2023-07-12T02:02:14.316667+0000","last_fullsized":"2023-07-12T02:02:14.316667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:25:19.868800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691820+0000","last_change":"2023-07-12T02:02:13.335337+0000","last_active":"2023-07-12T02:02:15.691820+0000","last_peered":"2023-07-12T02:02:15.691820+0000","last_clean":"2023-07-12T02:02:15.691820+0000","last_became_active":"2023-07-12T02:02:13.335059+0000","last_became_peered":"2023-07-12T02:02:13.335059+0000","last_unstale":"2023-07-12T02:02:15.691820+0000","last_undegraded":"2023-07-12T02:02:15.691820+0000","last_fullsized":"2023-07-12T02:02:15.691820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:37:30.294522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.668217+0000","last_change":"2023-07-12T02:02:13.338052+0000","last_active":"2023-07-12T02:02:15.668217+0000","last_peered":"2023-07-12T02:02:15.668217+0000","last_clean":"2023-07-12T02:02:15.668217+0000","last_became_active":"2023-07-12T02:02:13.337744+0000","last_became_peered":"2023-07-12T02:02:13.337744+0000","last_unstale":"2023-07-12T02:02:15.668217+0000","last_undegraded":"2023-07-12T02:02:15.668217+0000","last_fullsized":"2023-07-12T02:02:15.668217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:16:46.331127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316568+0000","last_change":"2023-07-12T02:02:13.323841+0000","last_active":"2023-07-12T02:02:14.316568+0000","last_peered":"2023-07-12T02:02:14.316568+0000","last_clean":"2023-07-12T02:02:14.316568+0000","last_became_active":"2023-07-12T02:02:13.323558+0000","last_became_peered":"2023-07-12T02:02:13.323558+0000","last_unstale":"2023-07-12T02:02:14.316568+0000","last_undegraded":"2023-07-12T02:02:14.316568+0000","last_fullsized":"2023-07-12T02:02:14.316568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:16:46.331127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.668695+0000","last_change":"2023-07-12T02:02:13.333951+0000","last_active":"2023-07-12T02:02:15.668695+0000","last_peered":"2023-07-12T02:02:15.668695+0000","last_clean":"2023-07-12T02:02:15.668695+0000","last_became_active":"2023-07-12T02:02:13.332574+0000","last_became_peered":"2023-07-12T02:02:13.332574+0000","last_unstale":"2023-07-12T02:02:15.668695+0000","last_undegraded":"2023-07-12T02:02:15.668695+0000","last_fullsized":"2023-07-12T02:02:15.668695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:31:00.185527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691427+0000","last_change":"2023-07-12T02:02:13.320239+0000","last_active":"2023-07-12T02:02:15.691427+0000","last_peered":"2023-07-12T02:02:15.691427+0000","last_clean":"2023-07-12T02:02:15.691427+0000","last_became_active":"2023-07-12T02:02:13.319332+0000","last_became_peered":"2023-07-12T02:02:13.319332+0000","last_unstale":"2023-07-12T02:02:15.691427+0000","last_undegraded":"2023-07-12T02:02:15.691427+0000","last_fullsized":"2023-07-12T02:02:15.691427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:51:50.388106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":835584,"data_stored":670286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":79099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":806912,"data_stored":668506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2969999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5549999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.484}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.621}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.429}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.389}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":78720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":78138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":79189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":79758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.2889999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.1920000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.153}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.3700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":79751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-12T02:02:22.251 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-12T02:02:22.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.407+0000 7f93473aa700 1 Processor -- start 2023-07-12T02:02:22.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.407+0000 7f93473aa700 1 -- start start 2023-07-12T02:02:22.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.408+0000 7f93473aa700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9340071a30 0x7f934014ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:22.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.408+0000 7f93473aa700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f93400b96b0 0x7f9340151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:22.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.408+0000 7f93473aa700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9340070e70 con 0x7f9340141780 2023-07-12T02:02:22.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.408+0000 7f93473aa700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93400ba720 con 0x7f9340071a30 2023-07-12T02:02:22.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.408+0000 7f93473aa700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9340071ea0 con 0x7f93400b96b0 2023-07-12T02:02:22.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.408+0000 7f9344945700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9340071a30 0x7f934014ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:22.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.408+0000 7f9344945700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9340071a30 0x7f934014ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50760/0 (socket says 172.21.15.60:50760) 2023-07-12T02:02:22.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.408+0000 7f9344945700 1 -- 172.21.15.60:0/262145301 learned_addr learned my addr 172.21.15.60:0/262145301 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:22.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.408+0000 7f9345947700 1 --2- 172.21.15.60:0/262145301 >> v2:172.21.15.79:3300/0 conn(0x7f93400b96b0 0x7f9340151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:22.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.408+0000 7f9344945700 1 -- 172.21.15.60:0/262145301 >> v2:172.21.15.79:3300/0 conn(0x7f93400b96b0 msgr2=0x7f9340151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:22.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.408+0000 7f9344945700 1 --2- 172.21.15.60:0/262145301 >> v2:172.21.15.79:3300/0 conn(0x7f93400b96b0 0x7f9340151eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:22.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.408+0000 7f9344945700 1 -- 172.21.15.60:0/262145301 >> v1:172.21.15.79:6789/0 conn(0x7f9340141780 legacy=0x7f93400ba010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:22.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.408+0000 7f9344945700 1 -- 172.21.15.60:0/262145301 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93400b9b40 con 0x7f9340071a30 2023-07-12T02:02:22.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.409+0000 7f9344945700 1 --2- 172.21.15.60:0/262145301 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9340071a30 0x7f934014ab20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f934006fe10 tx=0x7f9330009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8ec90ffa29806f1 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:22.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.409+0000 7f9337fff700 1 -- 172.21.15.60:0/262145301 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9330011830 con 0x7f9340071a30 2023-07-12T02:02:22.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.409+0000 7f9337fff700 1 -- 172.21.15.60:0/262145301 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9330011990 con 0x7f9340071a30 2023-07-12T02:02:22.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.409+0000 7f9337fff700 1 -- 172.21.15.60:0/262145301 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9330011d20 con 0x7f9340071a30 2023-07-12T02:02:22.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.409+0000 7f93473aa700 1 -- 172.21.15.60:0/262145301 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9340071a30 msgr2=0x7f934014ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:22.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.409+0000 7f93473aa700 1 --2- 172.21.15.60:0/262145301 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9340071a30 0x7f934014ab20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f934006fe10 tx=0x7f9330009bd0 comp rx=0 tx=0).stop 2023-07-12T02:02:22.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.409+0000 7f93473aa700 1 -- 172.21.15.60:0/262145301 shutdown_connections 2023-07-12T02:02:22.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.409+0000 7f93473aa700 1 --2- 172.21.15.60:0/262145301 >> v2:172.21.15.79:3300/0 conn(0x7f93400b96b0 0x7f9340151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:22.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.409+0000 7f93473aa700 1 --2- 172.21.15.60:0/262145301 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9340071a30 0x7f934014ab20 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:22.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.409+0000 7f93473aa700 1 -- 172.21.15.60:0/262145301 >> 172.21.15.60:0/262145301 conn(0x7f934006d0e0 msgr2=0x7f934006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:22.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.409+0000 7f93473aa700 1 -- 172.21.15.60:0/262145301 shutdown_connections 2023-07-12T02:02:22.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.409+0000 7f93473aa700 1 -- 172.21.15.60:0/262145301 wait complete. 2023-07-12T02:02:22.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.411+0000 7f93473aa700 1 Processor -- start 2023-07-12T02:02:22.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.411+0000 7f93473aa700 1 -- start start 2023-07-12T02:02:22.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.412+0000 7f93473aa700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9340071a30 0x7f93401492c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:22.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.412+0000 7f93473aa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93400b96b0 0x7f93401e0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:22.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.412+0000 7f93473aa700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9340141780 0x7f9340134b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:22.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.412+0000 7f93473aa700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9340135090 con 0x7f93400b96b0 2023-07-12T02:02:22.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.412+0000 7f93473aa700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9340149d80 con 0x7f9340141780 2023-07-12T02:02:22.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.412+0000 7f93473aa700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f934014a4f0 con 0x7f9340071a30 2023-07-12T02:02:22.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.412+0000 7f9344945700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93400b96b0 0x7f93401e0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:22.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.412+0000 7f9344945700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93400b96b0 0x7f93401e0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50770/0 (socket says 172.21.15.60:50770) 2023-07-12T02:02:22.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.412+0000 7f9344945700 1 -- 172.21.15.60:0/1907776111 learned_addr learned my addr 172.21.15.60:0/1907776111 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:22.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.412+0000 7f9345947700 1 --2- 172.21.15.60:0/1907776111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9340141780 0x7f9340134b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:22.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.412+0000 7f9345146700 1 --2- 172.21.15.60:0/1907776111 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9340071a30 0x7f93401492c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:22.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.412+0000 7f9344945700 1 -- 172.21.15.60:0/1907776111 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9340071a30 msgr2=0x7f93401492c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:22.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.412+0000 7f9344945700 1 --2- 172.21.15.60:0/1907776111 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9340071a30 0x7f93401492c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:22.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.412+0000 7f9344945700 1 -- 172.21.15.60:0/1907776111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9340141780 msgr2=0x7f9340134b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:22.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.412+0000 7f9344945700 1 --2- 172.21.15.60:0/1907776111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9340141780 0x7f9340134b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:22.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.412+0000 7f9344945700 1 -- 172.21.15.60:0/1907776111 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9330009550 con 0x7f93400b96b0 2023-07-12T02:02:22.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.412+0000 7f9344945700 1 --2- 172.21.15.60:0/1907776111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93400b96b0 0x7f93401e0c90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9330000c00 tx=0x7f9330004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:22.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.412+0000 7f9335ffb700 1 -- 172.21.15.60:0/1907776111 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9330004570 con 0x7f93400b96b0 2023-07-12T02:02:22.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.412+0000 7f9335ffb700 1 -- 172.21.15.60:0/1907776111 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f933001f070 con 0x7f93400b96b0 2023-07-12T02:02:22.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.412+0000 7f93473aa700 1 -- 172.21.15.60:0/1907776111 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9340138e20 con 0x7f93400b96b0 2023-07-12T02:02:22.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.413+0000 7f9335ffb700 1 -- 172.21.15.60:0/1907776111 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93300038e0 con 0x7f93400b96b0 2023-07-12T02:02:22.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.413+0000 7f93473aa700 1 -- 172.21.15.60:0/1907776111 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f934014a210 con 0x7f93400b96b0 2023-07-12T02:02:22.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.414+0000 7f93473aa700 1 -- 172.21.15.60:0/1907776111 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9340074360 con 0x7f93400b96b0 2023-07-12T02:02:22.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.414+0000 7f9335ffb700 1 -- 172.21.15.60:0/1907776111 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9330021030 con 0x7f93400b96b0 2023-07-12T02:02:22.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.414+0000 7f9335ffb700 1 --2- 172.21.15.60:0/1907776111 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f932406ace0 0x7f932406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:22.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.415+0000 7f9335ffb700 1 -- 172.21.15.60:0/1907776111 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f933008a830 con 0x7f93400b96b0 2023-07-12T02:02:22.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.415+0000 7f9345146700 1 --2- 172.21.15.60:0/1907776111 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f932406ace0 0x7f932406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:22.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.415+0000 7f9345146700 1 --2- 172.21.15.60:0/1907776111 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f932406ace0 0x7f932406d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f933c000f60 tx=0x7f933c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:22.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.419+0000 7f9335ffb700 1 -- 172.21.15.60:0/1907776111 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f9330055a90 con 0x7f93400b96b0 2023-07-12T02:02:22.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.612+0000 7f93473aa700 1 -- 172.21.15.60:0/1907776111 --> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9340070950 con 0x7f932406ace0 2023-07-12T02:02:22.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.620+0000 7f9335ffb700 1 -- 172.21.15.60:0/1907776111 <== mgr.4105 v2:172.21.15.79:6832/1173177519 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286808 (secure 0 0 0) 0x7f933c0013f0 con 0x7f932406ace0 2023-07-12T02:02:22.626 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:02:22.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.624+0000 7f93473aa700 1 -- 172.21.15.60:0/1907776111 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f932406ace0 msgr2=0x7f932406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:22.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.624+0000 7f93473aa700 1 --2- 172.21.15.60:0/1907776111 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f932406ace0 0x7f932406d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f933c000f60 tx=0x7f933c009040 comp rx=0 tx=0).stop 2023-07-12T02:02:22.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.624+0000 7f93473aa700 1 -- 172.21.15.60:0/1907776111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93400b96b0 msgr2=0x7f93401e0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:22.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.624+0000 7f93473aa700 1 --2- 172.21.15.60:0/1907776111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93400b96b0 0x7f93401e0c90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9330000c00 tx=0x7f9330004750 comp rx=0 tx=0).stop 2023-07-12T02:02:22.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.624+0000 7f93473aa700 1 -- 172.21.15.60:0/1907776111 shutdown_connections 2023-07-12T02:02:22.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.624+0000 7f93473aa700 1 --2- 172.21.15.60:0/1907776111 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f932406ace0 0x7f932406d190 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:22.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.624+0000 7f93473aa700 1 --2- 172.21.15.60:0/1907776111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9340141780 0x7f9340134b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:22.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.624+0000 7f93473aa700 1 --2- 172.21.15.60:0/1907776111 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9340071a30 0x7f93401492c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:22.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.624+0000 7f93473aa700 1 --2- 172.21.15.60:0/1907776111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93400b96b0 0x7f93401e0c90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:22.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.624+0000 7f93473aa700 1 -- 172.21.15.60:0/1907776111 >> 172.21.15.60:0/1907776111 conn(0x7f934006d0e0 msgr2=0x7f934013dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:22.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.624+0000 7f93473aa700 1 -- 172.21.15.60:0/1907776111 shutdown_connections 2023-07-12T02:02:22.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.624+0000 7f93473aa700 1 -- 172.21.15.60:0/1907776111 wait complete. 2023-07-12T02:02:22.630 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-07-12T02:02:22.639 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-07-12T02:02:21.803072+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219084,"kb_used_data":2900,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755636,"statfs":{"total":773094113280,"available":772869771264,"internally_reserved":0,"allocated":2969600,"data_stored":1813447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.493742"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.191540+0000","last_change":"2023-07-12T02:02:13.337541+0000","last_active":"2023-07-12T02:02:15.191540+0000","last_peered":"2023-07-12T02:02:15.191540+0000","last_clean":"2023-07-12T02:02:15.191540+0000","last_became_active":"2023-07-12T02:02:13.337208+0000","last_became_peered":"2023-07-12T02:02:13.337208+0000","last_unstale":"2023-07-12T02:02:15.191540+0000","last_undegraded":"2023-07-12T02:02:15.191540+0000","last_fullsized":"2023-07-12T02:02:15.191540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:20:47.394363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316831+0000","last_change":"2023-07-12T02:02:13.326771+0000","last_active":"2023-07-12T02:02:14.316831+0000","last_peered":"2023-07-12T02:02:14.316831+0000","last_clean":"2023-07-12T02:02:14.316831+0000","last_became_active":"2023-07-12T02:02:13.326496+0000","last_became_peered":"2023-07-12T02:02:13.326496+0000","last_unstale":"2023-07-12T02:02:14.316831+0000","last_undegraded":"2023-07-12T02:02:14.316831+0000","last_fullsized":"2023-07-12T02:02:14.316831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:15:32.479260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317741+0000","last_change":"2023-07-12T02:02:13.329834+0000","last_active":"2023-07-12T02:02:14.317741+0000","last_peered":"2023-07-12T02:02:14.317741+0000","last_clean":"2023-07-12T02:02:14.317741+0000","last_became_active":"2023-07-12T02:02:13.329474+0000","last_became_peered":"2023-07-12T02:02:13.329474+0000","last_unstale":"2023-07-12T02:02:14.317741+0000","last_undegraded":"2023-07-12T02:02:14.317741+0000","last_fullsized":"2023-07-12T02:02:14.317741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:21:36.117239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691723+0000","last_change":"2023-07-12T02:02:13.334760+0000","last_active":"2023-07-12T02:02:15.691723+0000","last_peered":"2023-07-12T02:02:15.691723+0000","last_clean":"2023-07-12T02:02:15.691723+0000","last_became_active":"2023-07-12T02:02:13.329155+0000","last_became_peered":"2023-07-12T02:02:13.329155+0000","last_unstale":"2023-07-12T02:02:15.691723+0000","last_undegraded":"2023-07-12T02:02:15.691723+0000","last_fullsized":"2023-07-12T02:02:15.691723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:51:50.388106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691861+0000","last_change":"2023-07-12T02:02:13.342289+0000","last_active":"2023-07-12T02:02:15.691861+0000","last_peered":"2023-07-12T02:02:15.691861+0000","last_clean":"2023-07-12T02:02:15.691861+0000","last_became_active":"2023-07-12T02:02:13.341024+0000","last_became_peered":"2023-07-12T02:02:13.341024+0000","last_unstale":"2023-07-12T02:02:15.691861+0000","last_undegraded":"2023-07-12T02:02:15.691861+0000","last_fullsized":"2023-07-12T02:02:15.691861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:17:31.378437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316438+0000","last_change":"2023-07-12T02:02:13.328776+0000","last_active":"2023-07-12T02:02:14.316438+0000","last_peered":"2023-07-12T02:02:14.316438+0000","last_clean":"2023-07-12T02:02:14.316438+0000","last_became_active":"2023-07-12T02:02:13.328433+0000","last_became_peered":"2023-07-12T02:02:13.328433+0000","last_unstale":"2023-07-12T02:02:14.316438+0000","last_undegraded":"2023-07-12T02:02:14.316438+0000","last_fullsized":"2023-07-12T02:02:14.316438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:41:14.864536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.315227+0000","last_change":"2023-07-12T02:02:13.333771+0000","last_active":"2023-07-12T02:02:14.315227+0000","last_peered":"2023-07-12T02:02:14.315227+0000","last_clean":"2023-07-12T02:02:14.315227+0000","last_became_active":"2023-07-12T02:02:13.332954+0000","last_became_peered":"2023-07-12T02:02:13.332954+0000","last_unstale":"2023-07-12T02:02:14.315227+0000","last_undegraded":"2023-07-12T02:02:14.315227+0000","last_fullsized":"2023-07-12T02:02:14.315227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:47:51.304545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316880+0000","last_change":"2023-07-12T02:02:13.321126+0000","last_active":"2023-07-12T02:02:14.316880+0000","last_peered":"2023-07-12T02:02:14.316880+0000","last_clean":"2023-07-12T02:02:14.316880+0000","last_became_active":"2023-07-12T02:02:13.320733+0000","last_became_peered":"2023-07-12T02:02:13.320733+0000","last_unstale":"2023-07-12T02:02:14.316880+0000","last_undegraded":"2023-07-12T02:02:14.316880+0000","last_fullsized":"2023-07-12T02:02:14.316880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:09:38.066919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691377+0000","last_change":"2023-07-12T02:02:13.341524+0000","last_active":"2023-07-12T02:02:15.691377+0000","last_peered":"2023-07-12T02:02:15.691377+0000","last_clean":"2023-07-12T02:02:15.691377+0000","last_became_active":"2023-07-12T02:02:13.341060+0000","last_became_peered":"2023-07-12T02:02:13.341060+0000","last_unstale":"2023-07-12T02:02:15.691377+0000","last_undegraded":"2023-07-12T02:02:15.691377+0000","last_fullsized":"2023-07-12T02:02:15.691377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:35:02.686768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317439+0000","last_change":"2023-07-12T02:02:13.335214+0000","last_active":"2023-07-12T02:02:14.317439+0000","last_peered":"2023-07-12T02:02:14.317439+0000","last_clean":"2023-07-12T02:02:14.317439+0000","last_became_active":"2023-07-12T02:02:13.334928+0000","last_became_peered":"2023-07-12T02:02:13.334928+0000","last_unstale":"2023-07-12T02:02:14.317439+0000","last_undegraded":"2023-07-12T02:02:14.317439+0000","last_fullsized":"2023-07-12T02:02:14.317439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:17:05.090789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317721+0000","last_change":"2023-07-12T02:02:13.327183+0000","last_active":"2023-07-12T02:02:14.317721+0000","last_peered":"2023-07-12T02:02:14.317721+0000","last_clean":"2023-07-12T02:02:14.317721+0000","last_became_active":"2023-07-12T02:02:13.326918+0000","last_became_peered":"2023-07-12T02:02:13.326918+0000","last_unstale":"2023-07-12T02:02:14.317721+0000","last_undegraded":"2023-07-12T02:02:14.317721+0000","last_fullsized":"2023-07-12T02:02:14.317721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:07:26.932388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.191555+0000","last_change":"2023-07-12T02:02:13.330866+0000","last_active":"2023-07-12T02:02:15.191555+0000","last_peered":"2023-07-12T02:02:15.191555+0000","last_clean":"2023-07-12T02:02:15.191555+0000","last_became_active":"2023-07-12T02:02:13.330331+0000","last_became_peered":"2023-07-12T02:02:13.330331+0000","last_unstale":"2023-07-12T02:02:15.191555+0000","last_undegraded":"2023-07-12T02:02:15.191555+0000","last_fullsized":"2023-07-12T02:02:15.191555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:07:56.951503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.191446+0000","last_change":"2023-07-12T02:02:13.337965+0000","last_active":"2023-07-12T02:02:15.191446+0000","last_peered":"2023-07-12T02:02:15.191446+0000","last_clean":"2023-07-12T02:02:15.191446+0000","last_became_active":"2023-07-12T02:02:13.337069+0000","last_became_peered":"2023-07-12T02:02:13.337069+0000","last_unstale":"2023-07-12T02:02:15.191446+0000","last_undegraded":"2023-07-12T02:02:15.191446+0000","last_fullsized":"2023-07-12T02:02:15.191446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:26:12.486521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316721+0000","last_change":"2023-07-12T02:02:13.333391+0000","last_active":"2023-07-12T02:02:14.316721+0000","last_peered":"2023-07-12T02:02:14.316721+0000","last_clean":"2023-07-12T02:02:14.316721+0000","last_became_active":"2023-07-12T02:02:13.333091+0000","last_became_peered":"2023-07-12T02:02:13.333091+0000","last_unstale":"2023-07-12T02:02:14.316721+0000","last_undegraded":"2023-07-12T02:02:14.316721+0000","last_fullsized":"2023-07-12T02:02:14.316721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:17:08.165931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.315629+0000","last_change":"2023-07-12T02:02:13.333879+0000","last_active":"2023-07-12T02:02:14.315629+0000","last_peered":"2023-07-12T02:02:14.315629+0000","last_clean":"2023-07-12T02:02:14.315629+0000","last_became_active":"2023-07-12T02:02:13.333334+0000","last_became_peered":"2023-07-12T02:02:13.333334+0000","last_unstale":"2023-07-12T02:02:14.315629+0000","last_undegraded":"2023-07-12T02:02:14.315629+0000","last_fullsized":"2023-07-12T02:02:14.315629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:52:47.727485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316830+0000","last_change":"2023-07-12T02:02:13.328684+0000","last_active":"2023-07-12T02:02:14.316830+0000","last_peered":"2023-07-12T02:02:14.316830+0000","last_clean":"2023-07-12T02:02:14.316830+0000","last_became_active":"2023-07-12T02:02:13.328364+0000","last_became_peered":"2023-07-12T02:02:13.328364+0000","last_unstale":"2023-07-12T02:02:14.316830+0000","last_undegraded":"2023-07-12T02:02:14.316830+0000","last_fullsized":"2023-07-12T02:02:14.316830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:22:15.093456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691489+0000","last_change":"2023-07-12T02:02:13.341527+0000","last_active":"2023-07-12T02:02:15.691489+0000","last_peered":"2023-07-12T02:02:15.691489+0000","last_clean":"2023-07-12T02:02:15.691489+0000","last_became_active":"2023-07-12T02:02:13.341127+0000","last_became_peered":"2023-07-12T02:02:13.341127+0000","last_unstale":"2023-07-12T02:02:15.691489+0000","last_undegraded":"2023-07-12T02:02:15.691489+0000","last_fullsized":"2023-07-12T02:02:15.691489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:38:03.475718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317709+0000","last_change":"2023-07-12T02:02:13.330871+0000","last_active":"2023-07-12T02:02:14.317709+0000","last_peered":"2023-07-12T02:02:14.317709+0000","last_clean":"2023-07-12T02:02:14.317709+0000","last_became_active":"2023-07-12T02:02:13.330590+0000","last_became_peered":"2023-07-12T02:02:13.330590+0000","last_unstale":"2023-07-12T02:02:14.317709+0000","last_undegraded":"2023-07-12T02:02:14.317709+0000","last_fullsized":"2023-07-12T02:02:14.317709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:11:43.867415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.191737+0000","last_change":"2023-07-12T02:02:13.326393+0000","last_active":"2023-07-12T02:02:15.191737+0000","last_peered":"2023-07-12T02:02:15.191737+0000","last_clean":"2023-07-12T02:02:15.191737+0000","last_became_active":"2023-07-12T02:02:13.326082+0000","last_became_peered":"2023-07-12T02:02:13.326082+0000","last_unstale":"2023-07-12T02:02:15.191737+0000","last_undegraded":"2023-07-12T02:02:15.191737+0000","last_fullsized":"2023-07-12T02:02:15.191737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:12:44.190253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317826+0000","last_change":"2023-07-12T02:02:13.322548+0000","last_active":"2023-07-12T02:02:14.317826+0000","last_peered":"2023-07-12T02:02:14.317826+0000","last_clean":"2023-07-12T02:02:14.317826+0000","last_became_active":"2023-07-12T02:02:13.322298+0000","last_became_peered":"2023-07-12T02:02:13.322298+0000","last_unstale":"2023-07-12T02:02:14.317826+0000","last_undegraded":"2023-07-12T02:02:14.317826+0000","last_fullsized":"2023-07-12T02:02:14.317826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:31:00.185527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.315759+0000","last_change":"2023-07-12T02:02:13.337864+0000","last_active":"2023-07-12T02:02:14.315759+0000","last_peered":"2023-07-12T02:02:14.315759+0000","last_clean":"2023-07-12T02:02:14.315759+0000","last_became_active":"2023-07-12T02:02:13.337675+0000","last_became_peered":"2023-07-12T02:02:13.337675+0000","last_unstale":"2023-07-12T02:02:14.315759+0000","last_undegraded":"2023-07-12T02:02:14.315759+0000","last_fullsized":"2023-07-12T02:02:14.315759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:31:00.185527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691909+0000","last_change":"2023-07-12T02:02:13.341938+0000","last_active":"2023-07-12T02:02:15.691909+0000","last_peered":"2023-07-12T02:02:15.691909+0000","last_clean":"2023-07-12T02:02:15.691909+0000","last_became_active":"2023-07-12T02:02:13.341364+0000","last_became_peered":"2023-07-12T02:02:13.341364+0000","last_unstale":"2023-07-12T02:02:15.691909+0000","last_undegraded":"2023-07-12T02:02:15.691909+0000","last_fullsized":"2023-07-12T02:02:15.691909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:47:51.304545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.668205+0000","last_change":"2023-07-12T02:02:13.337225+0000","last_active":"2023-07-12T02:02:15.668205+0000","last_peered":"2023-07-12T02:02:15.668205+0000","last_clean":"2023-07-12T02:02:15.668205+0000","last_became_active":"2023-07-12T02:02:13.336940+0000","last_became_peered":"2023-07-12T02:02:13.336940+0000","last_unstale":"2023-07-12T02:02:15.668205+0000","last_undegraded":"2023-07-12T02:02:15.668205+0000","last_fullsized":"2023-07-12T02:02:15.668205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:17:31.378437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.315161+0000","last_change":"2023-07-12T02:02:13.325230+0000","last_active":"2023-07-12T02:02:14.315161+0000","last_peered":"2023-07-12T02:02:14.315161+0000","last_clean":"2023-07-12T02:02:14.315161+0000","last_became_active":"2023-07-12T02:02:13.324929+0000","last_became_peered":"2023-07-12T02:02:13.324929+0000","last_unstale":"2023-07-12T02:02:14.315161+0000","last_undegraded":"2023-07-12T02:02:14.315161+0000","last_fullsized":"2023-07-12T02:02:14.315161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:25:19.868800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.692169+0000","last_change":"2023-07-12T02:02:13.327418+0000","last_active":"2023-07-12T02:02:15.692169+0000","last_peered":"2023-07-12T02:02:15.692169+0000","last_clean":"2023-07-12T02:02:15.692169+0000","last_became_active":"2023-07-12T02:02:13.327154+0000","last_became_peered":"2023-07-12T02:02:13.327154+0000","last_unstale":"2023-07-12T02:02:15.692169+0000","last_undegraded":"2023-07-12T02:02:15.692169+0000","last_fullsized":"2023-07-12T02:02:15.692169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:17:05.090789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.692234+0000","last_change":"2023-07-12T02:02:13.330432+0000","last_active":"2023-07-12T02:02:15.692234+0000","last_peered":"2023-07-12T02:02:15.692234+0000","last_clean":"2023-07-12T02:02:15.692234+0000","last_became_active":"2023-07-12T02:02:13.330105+0000","last_became_peered":"2023-07-12T02:02:13.330105+0000","last_unstale":"2023-07-12T02:02:15.692234+0000","last_undegraded":"2023-07-12T02:02:15.692234+0000","last_fullsized":"2023-07-12T02:02:15.692234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:40:06.976699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317496+0000","last_change":"2023-07-12T02:02:13.319765+0000","last_active":"2023-07-12T02:02:14.317496+0000","last_peered":"2023-07-12T02:02:14.317496+0000","last_clean":"2023-07-12T02:02:14.317496+0000","last_became_active":"2023-07-12T02:02:13.319286+0000","last_became_peered":"2023-07-12T02:02:13.319286+0000","last_unstale":"2023-07-12T02:02:14.317496+0000","last_undegraded":"2023-07-12T02:02:14.317496+0000","last_fullsized":"2023-07-12T02:02:14.317496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:16:46.331127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316716+0000","last_change":"2023-07-12T02:02:12.321483+0000","last_active":"2023-07-12T02:02:14.316716+0000","last_peered":"2023-07-12T02:02:14.316716+0000","last_clean":"2023-07-12T02:02:14.316716+0000","last_became_active":"2023-07-12T02:02:12.321175+0000","last_became_peered":"2023-07-12T02:02:12.321175+0000","last_unstale":"2023-07-12T02:02:14.316716+0000","last_undegraded":"2023-07-12T02:02:14.316716+0000","last_fullsized":"2023-07-12T02:02:14.316716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:47:50.297258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.668633+0000","last_change":"2023-07-12T02:02:13.330375+0000","last_active":"2023-07-12T02:02:15.668633+0000","last_peered":"2023-07-12T02:02:15.668633+0000","last_clean":"2023-07-12T02:02:15.668633+0000","last_became_active":"2023-07-12T02:02:13.330053+0000","last_became_peered":"2023-07-12T02:02:13.330053+0000","last_unstale":"2023-07-12T02:02:15.668633+0000","last_undegraded":"2023-07-12T02:02:15.668633+0000","last_fullsized":"2023-07-12T02:02:15.668633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:16:17.876200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691910+0000","last_change":"2023-07-12T02:02:12.329289+0000","last_active":"2023-07-12T02:02:15.691910+0000","last_peered":"2023-07-12T02:02:15.691910+0000","last_clean":"2023-07-12T02:02:15.691910+0000","last_became_active":"2023-07-12T02:02:12.328952+0000","last_became_peered":"2023-07-12T02:02:12.328952+0000","last_unstale":"2023-07-12T02:02:15.691910+0000","last_undegraded":"2023-07-12T02:02:15.691910+0000","last_fullsized":"2023-07-12T02:02:15.691910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:38:02.468430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691984+0000","last_change":"2023-07-12T02:02:13.328323+0000","last_active":"2023-07-12T02:02:15.691984+0000","last_peered":"2023-07-12T02:02:15.691984+0000","last_clean":"2023-07-12T02:02:15.691984+0000","last_became_active":"2023-07-12T02:02:13.328037+0000","last_became_peered":"2023-07-12T02:02:13.328037+0000","last_unstale":"2023-07-12T02:02:15.691984+0000","last_undegraded":"2023-07-12T02:02:15.691984+0000","last_fullsized":"2023-07-12T02:02:15.691984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:22:15.093456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.668381+0000","last_change":"2023-07-12T02:02:12.327049+0000","last_active":"2023-07-12T02:02:15.668381+0000","last_peered":"2023-07-12T02:02:15.668381+0000","last_clean":"2023-07-12T02:02:15.668381+0000","last_became_active":"2023-07-12T02:02:12.326705+0000","last_became_peered":"2023-07-12T02:02:12.326705+0000","last_unstale":"2023-07-12T02:02:15.668381+0000","last_undegraded":"2023-07-12T02:02:15.668381+0000","last_fullsized":"2023-07-12T02:02:15.668381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:14:42.639913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691892+0000","last_change":"2023-07-12T02:02:13.324681+0000","last_active":"2023-07-12T02:02:15.691892+0000","last_peered":"2023-07-12T02:02:15.691892+0000","last_clean":"2023-07-12T02:02:15.691892+0000","last_became_active":"2023-07-12T02:02:13.324399+0000","last_became_peered":"2023-07-12T02:02:13.324399+0000","last_unstale":"2023-07-12T02:02:15.691892+0000","last_undegraded":"2023-07-12T02:02:15.691892+0000","last_fullsized":"2023-07-12T02:02:15.691892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:43:24.727241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691505+0000","last_change":"2023-07-12T02:02:12.325851+0000","last_active":"2023-07-12T02:02:15.691505+0000","last_peered":"2023-07-12T02:02:15.691505+0000","last_clean":"2023-07-12T02:02:15.691505+0000","last_became_active":"2023-07-12T02:02:12.325017+0000","last_became_peered":"2023-07-12T02:02:12.325017+0000","last_unstale":"2023-07-12T02:02:15.691505+0000","last_undegraded":"2023-07-12T02:02:15.691505+0000","last_fullsized":"2023-07-12T02:02:15.691505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:43:23.719954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.668328+0000","last_change":"2023-07-12T02:02:13.334083+0000","last_active":"2023-07-12T02:02:15.668328+0000","last_peered":"2023-07-12T02:02:15.668328+0000","last_clean":"2023-07-12T02:02:15.668328+0000","last_became_active":"2023-07-12T02:02:13.328586+0000","last_became_peered":"2023-07-12T02:02:13.328586+0000","last_unstale":"2023-07-12T02:02:15.668328+0000","last_undegraded":"2023-07-12T02:02:15.668328+0000","last_fullsized":"2023-07-12T02:02:15.668328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:22:15.093456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316972+0000","last_change":"2023-07-12T02:02:12.320616+0000","last_active":"2023-07-12T02:02:14.316972+0000","last_peered":"2023-07-12T02:02:14.316972+0000","last_clean":"2023-07-12T02:02:14.316972+0000","last_became_active":"2023-07-12T02:02:12.320352+0000","last_became_peered":"2023-07-12T02:02:12.320352+0000","last_unstale":"2023-07-12T02:02:14.316972+0000","last_undegraded":"2023-07-12T02:02:14.316972+0000","last_fullsized":"2023-07-12T02:02:14.316972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:38:02.468430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.668472+0000","last_change":"2023-07-12T02:02:13.330996+0000","last_active":"2023-07-12T02:02:15.668472+0000","last_peered":"2023-07-12T02:02:15.668472+0000","last_clean":"2023-07-12T02:02:15.668472+0000","last_became_active":"2023-07-12T02:02:13.330717+0000","last_became_peered":"2023-07-12T02:02:13.330717+0000","last_unstale":"2023-07-12T02:02:15.668472+0000","last_undegraded":"2023-07-12T02:02:15.668472+0000","last_fullsized":"2023-07-12T02:02:15.668472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:46:15.278272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.315527+0000","last_change":"2023-07-12T02:02:12.329122+0000","last_active":"2023-07-12T02:02:14.315527+0000","last_peered":"2023-07-12T02:02:14.315527+0000","last_clean":"2023-07-12T02:02:14.315527+0000","last_became_active":"2023-07-12T02:02:12.328805+0000","last_became_peered":"2023-07-12T02:02:12.328805+0000","last_unstale":"2023-07-12T02:02:14.315527+0000","last_undegraded":"2023-07-12T02:02:14.315527+0000","last_fullsized":"2023-07-12T02:02:14.315527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:20:27.289712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691585+0000","last_change":"2023-07-12T02:02:13.326651+0000","last_active":"2023-07-12T02:02:15.691585+0000","last_peered":"2023-07-12T02:02:15.691585+0000","last_clean":"2023-07-12T02:02:15.691585+0000","last_became_active":"2023-07-12T02:02:13.326284+0000","last_became_peered":"2023-07-12T02:02:13.326284+0000","last_unstale":"2023-07-12T02:02:15.691585+0000","last_undegraded":"2023-07-12T02:02:15.691585+0000","last_fullsized":"2023-07-12T02:02:15.691585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:17:08.165931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317640+0000","last_change":"2023-07-12T02:02:12.320231+0000","last_active":"2023-07-12T02:02:14.317640+0000","last_peered":"2023-07-12T02:02:14.317640+0000","last_clean":"2023-07-12T02:02:14.317640+0000","last_became_active":"2023-07-12T02:02:12.319927+0000","last_became_peered":"2023-07-12T02:02:12.319927+0000","last_unstale":"2023-07-12T02:02:14.317640+0000","last_undegraded":"2023-07-12T02:02:14.317640+0000","last_fullsized":"2023-07-12T02:02:14.317640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:35:50.916494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317455+0000","last_change":"2023-07-12T02:02:13.322009+0000","last_active":"2023-07-12T02:02:14.317455+0000","last_peered":"2023-07-12T02:02:14.317455+0000","last_clean":"2023-07-12T02:02:14.317455+0000","last_became_active":"2023-07-12T02:02:13.321743+0000","last_became_peered":"2023-07-12T02:02:13.321743+0000","last_unstale":"2023-07-12T02:02:14.317455+0000","last_undegraded":"2023-07-12T02:02:14.317455+0000","last_fullsized":"2023-07-12T02:02:14.317455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:52:47.727485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.315586+0000","last_change":"2023-07-12T02:02:12.324867+0000","last_active":"2023-07-12T02:02:14.315586+0000","last_peered":"2023-07-12T02:02:14.315586+0000","last_clean":"2023-07-12T02:02:14.315586+0000","last_became_active":"2023-07-12T02:02:12.324548+0000","last_became_peered":"2023-07-12T02:02:12.324548+0000","last_unstale":"2023-07-12T02:02:14.315586+0000","last_undegraded":"2023-07-12T02:02:14.315586+0000","last_fullsized":"2023-07-12T02:02:14.315586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:16:16.868913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.668616+0000","last_change":"2023-07-12T02:02:13.331949+0000","last_active":"2023-07-12T02:02:15.668616+0000","last_peered":"2023-07-12T02:02:15.668616+0000","last_clean":"2023-07-12T02:02:15.668616+0000","last_became_active":"2023-07-12T02:02:13.331691+0000","last_became_peered":"2023-07-12T02:02:13.331691+0000","last_unstale":"2023-07-12T02:02:15.668616+0000","last_undegraded":"2023-07-12T02:02:15.668616+0000","last_fullsized":"2023-07-12T02:02:15.668616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:20:28.296999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.692068+0000","last_change":"2023-07-12T02:02:12.323570+0000","last_active":"2023-07-12T02:02:15.692068+0000","last_peered":"2023-07-12T02:02:15.692068+0000","last_clean":"2023-07-12T02:02:15.692068+0000","last_became_active":"2023-07-12T02:02:12.323259+0000","last_became_peered":"2023-07-12T02:02:12.323259+0000","last_unstale":"2023-07-12T02:02:15.692068+0000","last_undegraded":"2023-07-12T02:02:15.692068+0000","last_fullsized":"2023-07-12T02:02:15.692068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:57:41.776255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317309+0000","last_change":"2023-07-12T02:02:13.319909+0000","last_active":"2023-07-12T02:02:14.317309+0000","last_peered":"2023-07-12T02:02:14.317309+0000","last_clean":"2023-07-12T02:02:14.317309+0000","last_became_active":"2023-07-12T02:02:13.319598+0000","last_became_peered":"2023-07-12T02:02:13.319598+0000","last_unstale":"2023-07-12T02:02:14.317309+0000","last_undegraded":"2023-07-12T02:02:14.317309+0000","last_fullsized":"2023-07-12T02:02:14.317309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:41:14.864536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.315384+0000","last_change":"2023-07-12T02:02:12.324817+0000","last_active":"2023-07-12T02:02:14.315384+0000","last_peered":"2023-07-12T02:02:14.315384+0000","last_clean":"2023-07-12T02:02:14.315384+0000","last_became_active":"2023-07-12T02:02:12.324534+0000","last_became_peered":"2023-07-12T02:02:12.324534+0000","last_unstale":"2023-07-12T02:02:14.315384+0000","last_undegraded":"2023-07-12T02:02:14.315384+0000","last_fullsized":"2023-07-12T02:02:14.315384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:57:41.776255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691748+0000","last_change":"2023-07-12T02:02:13.341596+0000","last_active":"2023-07-12T02:02:15.691748+0000","last_peered":"2023-07-12T02:02:15.691748+0000","last_clean":"2023-07-12T02:02:15.691748+0000","last_became_active":"2023-07-12T02:02:13.341271+0000","last_became_peered":"2023-07-12T02:02:13.341271+0000","last_unstale":"2023-07-12T02:02:15.691748+0000","last_undegraded":"2023-07-12T02:02:15.691748+0000","last_fullsized":"2023-07-12T02:02:15.691748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:41:14.864536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691606+0000","last_change":"2023-07-12T02:02:12.321840+0000","last_active":"2023-07-12T02:02:15.691606+0000","last_peered":"2023-07-12T02:02:15.691606+0000","last_clean":"2023-07-12T02:02:15.691606+0000","last_became_active":"2023-07-12T02:02:12.321551+0000","last_became_peered":"2023-07-12T02:02:12.321551+0000","last_unstale":"2023-07-12T02:02:15.691606+0000","last_undegraded":"2023-07-12T02:02:15.691606+0000","last_fullsized":"2023-07-12T02:02:15.691606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:20:50.862038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.668968+0000","last_change":"2023-07-12T02:02:13.336049+0000","last_active":"2023-07-12T02:02:15.668968+0000","last_peered":"2023-07-12T02:02:15.668968+0000","last_clean":"2023-07-12T02:02:15.668968+0000","last_became_active":"2023-07-12T02:02:13.334580+0000","last_became_peered":"2023-07-12T02:02:13.334580+0000","last_unstale":"2023-07-12T02:02:15.668968+0000","last_undegraded":"2023-07-12T02:02:15.668968+0000","last_fullsized":"2023-07-12T02:02:15.668968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:11:43.867415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.315399+0000","last_change":"2023-07-12T02:02:12.321103+0000","last_active":"2023-07-12T02:02:14.315399+0000","last_peered":"2023-07-12T02:02:14.315399+0000","last_clean":"2023-07-12T02:02:14.315399+0000","last_became_active":"2023-07-12T02:02:12.320783+0000","last_became_peered":"2023-07-12T02:02:12.320783+0000","last_unstale":"2023-07-12T02:02:14.315399+0000","last_undegraded":"2023-07-12T02:02:14.315399+0000","last_fullsized":"2023-07-12T02:02:14.315399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:46:14.270985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316978+0000","last_change":"2023-07-12T02:02:13.319686+0000","last_active":"2023-07-12T02:02:14.316978+0000","last_peered":"2023-07-12T02:02:14.316978+0000","last_clean":"2023-07-12T02:02:14.316978+0000","last_became_active":"2023-07-12T02:02:13.319473+0000","last_became_peered":"2023-07-12T02:02:13.319473+0000","last_unstale":"2023-07-12T02:02:14.316978+0000","last_undegraded":"2023-07-12T02:02:14.316978+0000","last_fullsized":"2023-07-12T02:02:14.316978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:43:24.727241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.315771+0000","last_change":"2023-07-12T02:02:12.323782+0000","last_active":"2023-07-12T02:02:14.315771+0000","last_peered":"2023-07-12T02:02:14.315771+0000","last_clean":"2023-07-12T02:02:14.315771+0000","last_became_active":"2023-07-12T02:02:12.323508+0000","last_became_peered":"2023-07-12T02:02:12.323508+0000","last_unstale":"2023-07-12T02:02:14.315771+0000","last_undegraded":"2023-07-12T02:02:14.315771+0000","last_fullsized":"2023-07-12T02:02:14.315771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:35:50.916494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316527+0000","last_change":"2023-07-12T02:02:13.326752+0000","last_active":"2023-07-12T02:02:14.316527+0000","last_peered":"2023-07-12T02:02:14.316527+0000","last_clean":"2023-07-12T02:02:14.316527+0000","last_became_active":"2023-07-12T02:02:13.326494+0000","last_became_peered":"2023-07-12T02:02:13.326494+0000","last_unstale":"2023-07-12T02:02:14.316527+0000","last_undegraded":"2023-07-12T02:02:14.316527+0000","last_fullsized":"2023-07-12T02:02:14.316527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:17:31.378437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.315358+0000","last_change":"2023-07-12T02:02:12.323136+0000","last_active":"2023-07-12T02:02:14.315358+0000","last_peered":"2023-07-12T02:02:14.315358+0000","last_clean":"2023-07-12T02:02:14.315358+0000","last_became_active":"2023-07-12T02:02:12.322786+0000","last_became_peered":"2023-07-12T02:02:12.322786+0000","last_unstale":"2023-07-12T02:02:14.315358+0000","last_undegraded":"2023-07-12T02:02:14.315358+0000","last_fullsized":"2023-07-12T02:02:14.315358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:14:42.639913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691998+0000","last_change":"2023-07-12T02:02:13.328969+0000","last_active":"2023-07-12T02:02:15.691998+0000","last_peered":"2023-07-12T02:02:15.691998+0000","last_clean":"2023-07-12T02:02:15.691998+0000","last_became_active":"2023-07-12T02:02:13.328727+0000","last_became_peered":"2023-07-12T02:02:13.328727+0000","last_unstale":"2023-07-12T02:02:15.691998+0000","last_undegraded":"2023-07-12T02:02:15.691998+0000","last_fullsized":"2023-07-12T02:02:15.691998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:09:38.066919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316868+0000","last_change":"2023-07-12T02:02:12.329043+0000","last_active":"2023-07-12T02:02:14.316868+0000","last_peered":"2023-07-12T02:02:14.316868+0000","last_clean":"2023-07-12T02:02:14.316868+0000","last_became_active":"2023-07-12T02:02:12.328739+0000","last_became_peered":"2023-07-12T02:02:12.328739+0000","last_unstale":"2023-07-12T02:02:14.316868+0000","last_undegraded":"2023-07-12T02:02:14.316868+0000","last_fullsized":"2023-07-12T02:02:14.316868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:35:01.679481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691479+0000","last_change":"2023-07-12T02:02:13.341847+0000","last_active":"2023-07-12T02:02:15.691479+0000","last_peered":"2023-07-12T02:02:15.691479+0000","last_clean":"2023-07-12T02:02:15.691479+0000","last_became_active":"2023-07-12T02:02:13.341458+0000","last_became_peered":"2023-07-12T02:02:13.341458+0000","last_unstale":"2023-07-12T02:02:15.691479+0000","last_undegraded":"2023-07-12T02:02:15.691479+0000","last_fullsized":"2023-07-12T02:02:15.691479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:09:38.066919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.668658+0000","last_change":"2023-07-12T02:02:12.328920+0000","last_active":"2023-07-12T02:02:15.668658+0000","last_peered":"2023-07-12T02:02:15.668658+0000","last_clean":"2023-07-12T02:02:15.668658+0000","last_became_active":"2023-07-12T02:02:12.328621+0000","last_became_peered":"2023-07-12T02:02:12.328621+0000","last_unstale":"2023-07-12T02:02:15.668658+0000","last_undegraded":"2023-07-12T02:02:15.668658+0000","last_fullsized":"2023-07-12T02:02:15.668658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:52:46.720198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317790+0000","last_change":"2023-07-12T02:02:13.325579+0000","last_active":"2023-07-12T02:02:14.317790+0000","last_peered":"2023-07-12T02:02:14.317790+0000","last_clean":"2023-07-12T02:02:14.317790+0000","last_became_active":"2023-07-12T02:02:13.325322+0000","last_became_peered":"2023-07-12T02:02:13.325322+0000","last_unstale":"2023-07-12T02:02:14.317790+0000","last_undegraded":"2023-07-12T02:02:14.317790+0000","last_fullsized":"2023-07-12T02:02:14.317790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:44:33.522394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691901+0000","last_change":"2023-07-12T02:02:12.326368+0000","last_active":"2023-07-12T02:02:15.691901+0000","last_peered":"2023-07-12T02:02:15.691901+0000","last_clean":"2023-07-12T02:02:15.691901+0000","last_became_active":"2023-07-12T02:02:12.326046+0000","last_became_peered":"2023-07-12T02:02:12.326046+0000","last_unstale":"2023-07-12T02:02:15.691901+0000","last_undegraded":"2023-07-12T02:02:15.691901+0000","last_fullsized":"2023-07-12T02:02:15.691901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:35:01.679481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317887+0000","last_change":"2023-07-12T02:02:13.333650+0000","last_active":"2023-07-12T02:02:14.317887+0000","last_peered":"2023-07-12T02:02:14.317887+0000","last_clean":"2023-07-12T02:02:14.317887+0000","last_became_active":"2023-07-12T02:02:13.333379+0000","last_became_peered":"2023-07-12T02:02:13.333379+0000","last_unstale":"2023-07-12T02:02:14.317887+0000","last_undegraded":"2023-07-12T02:02:14.317887+0000","last_fullsized":"2023-07-12T02:02:14.317887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:40:15.684880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316971+0000","last_change":"2023-07-12T02:02:12.322163+0000","last_active":"2023-07-12T02:02:14.316971+0000","last_peered":"2023-07-12T02:02:14.316971+0000","last_clean":"2023-07-12T02:02:14.316971+0000","last_became_active":"2023-07-12T02:02:12.321873+0000","last_became_peered":"2023-07-12T02:02:12.321873+0000","last_unstale":"2023-07-12T02:02:14.316971+0000","last_undegraded":"2023-07-12T02:02:14.316971+0000","last_fullsized":"2023-07-12T02:02:14.316971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:57:41.776255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317708+0000","last_change":"2023-07-12T02:02:13.324741+0000","last_active":"2023-07-12T02:02:14.317708+0000","last_peered":"2023-07-12T02:02:14.317708+0000","last_clean":"2023-07-12T02:02:14.317708+0000","last_became_active":"2023-07-12T02:02:13.324436+0000","last_became_peered":"2023-07-12T02:02:13.324436+0000","last_unstale":"2023-07-12T02:02:14.317708+0000","last_undegraded":"2023-07-12T02:02:14.317708+0000","last_fullsized":"2023-07-12T02:02:14.317708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:30:11.751660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.668197+0000","last_change":"2023-07-12T02:02:12.328371+0000","last_active":"2023-07-12T02:02:15.668197+0000","last_peered":"2023-07-12T02:02:15.668197+0000","last_clean":"2023-07-12T02:02:15.668197+0000","last_became_active":"2023-07-12T02:02:12.328097+0000","last_became_peered":"2023-07-12T02:02:12.328097+0000","last_unstale":"2023-07-12T02:02:15.668197+0000","last_undegraded":"2023-07-12T02:02:15.668197+0000","last_fullsized":"2023-07-12T02:02:15.668197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:25:18.861513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.692343+0000","last_change":"2023-07-12T02:02:13.327528+0000","last_active":"2023-07-12T02:02:15.692343+0000","last_peered":"2023-07-12T02:02:15.692343+0000","last_clean":"2023-07-12T02:02:15.692343+0000","last_became_active":"2023-07-12T02:02:13.327211+0000","last_became_peered":"2023-07-12T02:02:13.327211+0000","last_unstale":"2023-07-12T02:02:15.692343+0000","last_undegraded":"2023-07-12T02:02:15.692343+0000","last_fullsized":"2023-07-12T02:02:15.692343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:17:31.378437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.668851+0000","last_change":"2023-07-12T02:02:12.326201+0000","last_active":"2023-07-12T02:02:15.668851+0000","last_peered":"2023-07-12T02:02:15.668851+0000","last_clean":"2023-07-12T02:02:15.668851+0000","last_became_active":"2023-07-12T02:02:12.325620+0000","last_became_peered":"2023-07-12T02:02:12.325620+0000","last_unstale":"2023-07-12T02:02:15.668851+0000","last_undegraded":"2023-07-12T02:02:15.668851+0000","last_fullsized":"2023-07-12T02:02:15.668851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:30:10.744373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317820+0000","last_change":"2023-07-12T02:02:07.598601+0000","last_active":"2023-07-12T02:02:14.317820+0000","last_peered":"2023-07-12T02:02:14.317820+0000","last_clean":"2023-07-12T02:02:14.317820+0000","last_became_active":"2023-07-12T02:02:07.598343+0000","last_became_peered":"2023-07-12T02:02:07.598343+0000","last_unstale":"2023-07-12T02:02:14.317820+0000","last_undegraded":"2023-07-12T02:02:14.317820+0000","last_fullsized":"2023-07-12T02:02:14.317820+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:27:59.906561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.668155+0000","last_change":"2023-07-12T02:02:13.323317+0000","last_active":"2023-07-12T02:02:15.668155+0000","last_peered":"2023-07-12T02:02:15.668155+0000","last_clean":"2023-07-12T02:02:15.668155+0000","last_became_active":"2023-07-12T02:02:13.323003+0000","last_became_peered":"2023-07-12T02:02:13.323003+0000","last_unstale":"2023-07-12T02:02:15.668155+0000","last_undegraded":"2023-07-12T02:02:15.668155+0000","last_fullsized":"2023-07-12T02:02:15.668155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:41:14.864536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.668081+0000","last_change":"2023-07-12T02:02:07.268647+0000","last_active":"2023-07-12T02:02:15.668081+0000","last_peered":"2023-07-12T02:02:15.668081+0000","last_clean":"2023-07-12T02:02:15.668081+0000","last_became_active":"2023-07-12T02:02:07.268304+0000","last_became_peered":"2023-07-12T02:02:07.268304+0000","last_unstale":"2023-07-12T02:02:15.668081+0000","last_undegraded":"2023-07-12T02:02:15.668081+0000","last_fullsized":"2023-07-12T02:02:15.668081+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:40:00.932400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.692054+0000","last_change":"2023-07-12T02:02:12.322468+0000","last_active":"2023-07-12T02:02:15.692054+0000","last_peered":"2023-07-12T02:02:15.692054+0000","last_clean":"2023-07-12T02:02:15.692054+0000","last_became_active":"2023-07-12T02:02:12.322170+0000","last_became_peered":"2023-07-12T02:02:12.322170+0000","last_unstale":"2023-07-12T02:02:15.692054+0000","last_undegraded":"2023-07-12T02:02:15.692054+0000","last_fullsized":"2023-07-12T02:02:15.692054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:14:42.639913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317131+0000","last_change":"2023-07-12T02:02:13.317131+0000","last_active":"2023-07-12T02:02:14.317131+0000","last_peered":"2023-07-12T02:02:14.317131+0000","last_clean":"2023-07-12T02:02:14.317131+0000","last_became_active":"2023-07-12T02:02:13.316528+0000","last_became_peered":"2023-07-12T02:02:13.316528+0000","last_unstale":"2023-07-12T02:02:14.317131+0000","last_undegraded":"2023-07-12T02:02:14.317131+0000","last_fullsized":"2023-07-12T02:02:14.317131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:46:15.278272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691739+0000","last_change":"2023-07-12T02:02:07.270653+0000","last_active":"2023-07-12T02:02:15.691739+0000","last_peered":"2023-07-12T02:02:15.691739+0000","last_clean":"2023-07-12T02:02:15.691739+0000","last_became_active":"2023-07-12T02:02:07.270293+0000","last_became_peered":"2023-07-12T02:02:07.270293+0000","last_unstale":"2023-07-12T02:02:15.691739+0000","last_undegraded":"2023-07-12T02:02:15.691739+0000","last_fullsized":"2023-07-12T02:02:15.691739+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:09:32.022620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":169,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.315265+0000","last_change":"2023-07-12T02:02:07.268364+0000","last_active":"2023-07-12T02:02:14.315265+0000","last_peered":"2023-07-12T02:02:14.315265+0000","last_clean":"2023-07-12T02:02:14.315265+0000","last_became_active":"2023-07-12T02:02:07.268074+0000","last_became_peered":"2023-07-12T02:02:07.268074+0000","last_unstale":"2023-07-12T02:02:14.315265+0000","last_undegraded":"2023-07-12T02:02:14.315265+0000","last_fullsized":"2023-07-12T02:02:14.315265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:22:09.049157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691249+0000","last_change":"2023-07-12T02:02:12.324904+0000","last_active":"2023-07-12T02:02:15.691249+0000","last_peered":"2023-07-12T02:02:15.691249+0000","last_clean":"2023-07-12T02:02:15.691249+0000","last_became_active":"2023-07-12T02:02:12.324574+0000","last_became_peered":"2023-07-12T02:02:12.324574+0000","last_unstale":"2023-07-12T02:02:15.691249+0000","last_undegraded":"2023-07-12T02:02:15.691249+0000","last_fullsized":"2023-07-12T02:02:15.691249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:15:31.471972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691896+0000","last_change":"2023-07-12T02:02:13.342641+0000","last_active":"2023-07-12T02:02:15.691896+0000","last_peered":"2023-07-12T02:02:15.691896+0000","last_clean":"2023-07-12T02:02:15.691896+0000","last_became_active":"2023-07-12T02:02:13.341464+0000","last_became_peered":"2023-07-12T02:02:13.341464+0000","last_unstale":"2023-07-12T02:02:15.691896+0000","last_undegraded":"2023-07-12T02:02:15.691896+0000","last_fullsized":"2023-07-12T02:02:15.691896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:25:19.868800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.314955+0000","last_change":"2023-07-12T02:02:07.599189+0000","last_active":"2023-07-12T02:02:14.314955+0000","last_peered":"2023-07-12T02:02:14.314955+0000","last_clean":"2023-07-12T02:02:14.314955+0000","last_became_active":"2023-07-12T02:02:07.598898+0000","last_became_peered":"2023-07-12T02:02:07.598898+0000","last_unstale":"2023-07-12T02:02:14.314955+0000","last_undegraded":"2023-07-12T02:02:14.314955+0000","last_fullsized":"2023-07-12T02:02:14.314955+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:16:40.286828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691543+0000","last_change":"2023-07-12T02:02:12.327140+0000","last_active":"2023-07-12T02:02:15.691543+0000","last_peered":"2023-07-12T02:02:15.691543+0000","last_clean":"2023-07-12T02:02:15.691543+0000","last_became_active":"2023-07-12T02:02:12.326857+0000","last_became_peered":"2023-07-12T02:02:12.326857+0000","last_unstale":"2023-07-12T02:02:15.691543+0000","last_undegraded":"2023-07-12T02:02:15.691543+0000","last_fullsized":"2023-07-12T02:02:15.691543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:37:29.287235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.692241+0000","last_change":"2023-07-12T02:02:13.317477+0000","last_active":"2023-07-12T02:02:15.692241+0000","last_peered":"2023-07-12T02:02:15.692241+0000","last_clean":"2023-07-12T02:02:15.692241+0000","last_became_active":"2023-07-12T02:02:13.317140+0000","last_became_peered":"2023-07-12T02:02:13.317140+0000","last_unstale":"2023-07-12T02:02:15.692241+0000","last_undegraded":"2023-07-12T02:02:15.692241+0000","last_fullsized":"2023-07-12T02:02:15.692241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:41:14.864536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.314948+0000","last_change":"2023-07-12T02:02:07.599193+0000","last_active":"2023-07-12T02:02:14.314948+0000","last_peered":"2023-07-12T02:02:14.314948+0000","last_clean":"2023-07-12T02:02:14.314948+0000","last_became_active":"2023-07-12T02:02:07.598910+0000","last_became_peered":"2023-07-12T02:02:07.598910+0000","last_unstale":"2023-07-12T02:02:14.314948+0000","last_undegraded":"2023-07-12T02:02:14.314948+0000","last_fullsized":"2023-07-12T02:02:14.314948+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:17:25.334138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.668331+0000","last_change":"2023-07-12T02:02:12.325450+0000","last_active":"2023-07-12T02:02:15.668331+0000","last_peered":"2023-07-12T02:02:15.668331+0000","last_clean":"2023-07-12T02:02:15.668331+0000","last_became_active":"2023-07-12T02:02:12.325156+0000","last_became_peered":"2023-07-12T02:02:12.325156+0000","last_unstale":"2023-07-12T02:02:15.668331+0000","last_undegraded":"2023-07-12T02:02:15.668331+0000","last_fullsized":"2023-07-12T02:02:15.668331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:47:50.297258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691914+0000","last_change":"2023-07-12T02:02:13.328081+0000","last_active":"2023-07-12T02:02:15.691914+0000","last_peered":"2023-07-12T02:02:15.691914+0000","last_clean":"2023-07-12T02:02:15.691914+0000","last_became_active":"2023-07-12T02:02:13.327699+0000","last_became_peered":"2023-07-12T02:02:13.327699+0000","last_unstale":"2023-07-12T02:02:15.691914+0000","last_undegraded":"2023-07-12T02:02:15.691914+0000","last_fullsized":"2023-07-12T02:02:15.691914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:15:32.479260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317109+0000","last_change":"2023-07-12T02:02:07.599477+0000","last_active":"2023-07-12T02:02:14.317109+0000","last_peered":"2023-07-12T02:02:14.317109+0000","last_clean":"2023-07-12T02:02:14.317109+0000","last_became_active":"2023-07-12T02:02:07.599111+0000","last_became_peered":"2023-07-12T02:02:07.599111+0000","last_unstale":"2023-07-12T02:02:14.317109+0000","last_undegraded":"2023-07-12T02:02:14.317109+0000","last_fullsized":"2023-07-12T02:02:14.317109+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:40:00.932400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317421+0000","last_change":"2023-07-12T02:02:12.324686+0000","last_active":"2023-07-12T02:02:14.317421+0000","last_peered":"2023-07-12T02:02:14.317421+0000","last_clean":"2023-07-12T02:02:14.317421+0000","last_became_active":"2023-07-12T02:02:12.324422+0000","last_became_peered":"2023-07-12T02:02:12.324422+0000","last_unstale":"2023-07-12T02:02:14.317421+0000","last_undegraded":"2023-07-12T02:02:14.317421+0000","last_fullsized":"2023-07-12T02:02:14.317421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:16:16.868913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.692052+0000","last_change":"2023-07-12T02:02:13.334295+0000","last_active":"2023-07-12T02:02:15.692052+0000","last_peered":"2023-07-12T02:02:15.692052+0000","last_clean":"2023-07-12T02:02:15.692052+0000","last_became_active":"2023-07-12T02:02:13.333688+0000","last_became_peered":"2023-07-12T02:02:13.333688+0000","last_unstale":"2023-07-12T02:02:15.692052+0000","last_undegraded":"2023-07-12T02:02:15.692052+0000","last_fullsized":"2023-07-12T02:02:15.692052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:43:24.727241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.692012+0000","last_change":"2023-07-12T02:02:07.599427+0000","last_active":"2023-07-12T02:02:15.692012+0000","last_peered":"2023-07-12T02:02:15.692012+0000","last_clean":"2023-07-12T02:02:15.692012+0000","last_became_active":"2023-07-12T02:02:07.599063+0000","last_became_peered":"2023-07-12T02:02:07.599063+0000","last_unstale":"2023-07-12T02:02:15.692012+0000","last_undegraded":"2023-07-12T02:02:15.692012+0000","last_fullsized":"2023-07-12T02:02:15.692012+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:37:57.431418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691566+0000","last_change":"2023-07-12T02:02:12.327460+0000","last_active":"2023-07-12T02:02:15.691566+0000","last_peered":"2023-07-12T02:02:15.691566+0000","last_clean":"2023-07-12T02:02:15.691566+0000","last_became_active":"2023-07-12T02:02:12.327176+0000","last_became_peered":"2023-07-12T02:02:12.327176+0000","last_unstale":"2023-07-12T02:02:15.691566+0000","last_undegraded":"2023-07-12T02:02:15.691566+0000","last_fullsized":"2023-07-12T02:02:15.691566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:35:01.679481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691867+0000","last_change":"2023-07-12T02:02:13.340465+0000","last_active":"2023-07-12T02:02:15.691867+0000","last_peered":"2023-07-12T02:02:15.691867+0000","last_clean":"2023-07-12T02:02:15.691867+0000","last_became_active":"2023-07-12T02:02:13.328675+0000","last_became_peered":"2023-07-12T02:02:13.328675+0000","last_unstale":"2023-07-12T02:02:15.691867+0000","last_undegraded":"2023-07-12T02:02:15.691867+0000","last_fullsized":"2023-07-12T02:02:15.691867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:16:46.331127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691845+0000","last_change":"2023-07-12T02:02:07.272059+0000","last_active":"2023-07-12T02:02:15.691845+0000","last_peered":"2023-07-12T02:02:15.691845+0000","last_clean":"2023-07-12T02:02:15.691845+0000","last_became_active":"2023-07-12T02:02:07.271770+0000","last_became_peered":"2023-07-12T02:02:07.271770+0000","last_unstale":"2023-07-12T02:02:15.691845+0000","last_undegraded":"2023-07-12T02:02:15.691845+0000","last_fullsized":"2023-07-12T02:02:15.691845+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:17:02.121632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317463+0000","last_change":"2023-07-12T02:02:12.328981+0000","last_active":"2023-07-12T02:02:14.317463+0000","last_peered":"2023-07-12T02:02:14.317463+0000","last_clean":"2023-07-12T02:02:14.317463+0000","last_became_active":"2023-07-12T02:02:12.328737+0000","last_became_peered":"2023-07-12T02:02:12.328737+0000","last_unstale":"2023-07-12T02:02:14.317463+0000","last_undegraded":"2023-07-12T02:02:14.317463+0000","last_fullsized":"2023-07-12T02:02:14.317463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:17:30.371150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691611+0000","last_change":"2023-07-12T02:02:13.321482+0000","last_active":"2023-07-12T02:02:15.691611+0000","last_peered":"2023-07-12T02:02:15.691611+0000","last_clean":"2023-07-12T02:02:15.691611+0000","last_became_active":"2023-07-12T02:02:13.321146+0000","last_became_peered":"2023-07-12T02:02:13.321146+0000","last_unstale":"2023-07-12T02:02:15.691611+0000","last_undegraded":"2023-07-12T02:02:15.691611+0000","last_fullsized":"2023-07-12T02:02:15.691611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:15:32.479260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691699+0000","last_change":"2023-07-12T02:02:12.324771+0000","last_active":"2023-07-12T02:02:15.691699+0000","last_peered":"2023-07-12T02:02:15.691699+0000","last_clean":"2023-07-12T02:02:15.691699+0000","last_became_active":"2023-07-12T02:02:12.324451+0000","last_became_peered":"2023-07-12T02:02:12.324451+0000","last_unstale":"2023-07-12T02:02:15.691699+0000","last_undegraded":"2023-07-12T02:02:15.691699+0000","last_fullsized":"2023-07-12T02:02:15.691699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:40:05.969412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.191698+0000","last_change":"2023-07-12T02:02:13.330617+0000","last_active":"2023-07-12T02:02:15.191698+0000","last_peered":"2023-07-12T02:02:15.191698+0000","last_clean":"2023-07-12T02:02:15.191698+0000","last_became_active":"2023-07-12T02:02:13.329921+0000","last_became_peered":"2023-07-12T02:02:13.329921+0000","last_unstale":"2023-07-12T02:02:15.191698+0000","last_undegraded":"2023-07-12T02:02:15.191698+0000","last_fullsized":"2023-07-12T02:02:15.191698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:08:44.750937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316667+0000","last_change":"2023-07-12T02:02:12.324065+0000","last_active":"2023-07-12T02:02:14.316667+0000","last_peered":"2023-07-12T02:02:14.316667+0000","last_clean":"2023-07-12T02:02:14.316667+0000","last_became_active":"2023-07-12T02:02:12.323792+0000","last_became_peered":"2023-07-12T02:02:12.323792+0000","last_unstale":"2023-07-12T02:02:14.316667+0000","last_undegraded":"2023-07-12T02:02:14.316667+0000","last_fullsized":"2023-07-12T02:02:14.316667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:37:29.287235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317154+0000","last_change":"2023-07-12T02:02:13.324540+0000","last_active":"2023-07-12T02:02:14.317154+0000","last_peered":"2023-07-12T02:02:14.317154+0000","last_clean":"2023-07-12T02:02:14.317154+0000","last_became_active":"2023-07-12T02:02:13.324245+0000","last_became_peered":"2023-07-12T02:02:13.324245+0000","last_unstale":"2023-07-12T02:02:14.317154+0000","last_undegraded":"2023-07-12T02:02:14.317154+0000","last_fullsized":"2023-07-12T02:02:14.317154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:20:28.296999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.317616+0000","last_change":"2023-07-12T02:02:12.323954+0000","last_active":"2023-07-12T02:02:14.317616+0000","last_peered":"2023-07-12T02:02:14.317616+0000","last_clean":"2023-07-12T02:02:14.317616+0000","last_became_active":"2023-07-12T02:02:12.323681+0000","last_became_peered":"2023-07-12T02:02:12.323681+0000","last_unstale":"2023-07-12T02:02:14.317616+0000","last_undegraded":"2023-07-12T02:02:14.317616+0000","last_fullsized":"2023-07-12T02:02:14.317616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:25:18.861513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316914+0000","last_change":"2023-07-12T02:02:13.325210+0000","last_active":"2023-07-12T02:02:14.316914+0000","last_peered":"2023-07-12T02:02:14.316914+0000","last_clean":"2023-07-12T02:02:14.316914+0000","last_became_active":"2023-07-12T02:02:13.324920+0000","last_became_peered":"2023-07-12T02:02:13.324920+0000","last_unstale":"2023-07-12T02:02:14.316914+0000","last_undegraded":"2023-07-12T02:02:14.316914+0000","last_fullsized":"2023-07-12T02:02:14.316914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:14:43.647200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.668728+0000","last_change":"2023-07-12T02:02:12.325289+0000","last_active":"2023-07-12T02:02:15.668728+0000","last_peered":"2023-07-12T02:02:15.668728+0000","last_clean":"2023-07-12T02:02:15.668728+0000","last_became_active":"2023-07-12T02:02:12.324997+0000","last_became_peered":"2023-07-12T02:02:12.324997+0000","last_unstale":"2023-07-12T02:02:15.668728+0000","last_undegraded":"2023-07-12T02:02:15.668728+0000","last_fullsized":"2023-07-12T02:02:15.668728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:35:50.916494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.668398+0000","last_change":"2023-07-12T02:02:13.333732+0000","last_active":"2023-07-12T02:02:15.668398+0000","last_peered":"2023-07-12T02:02:15.668398+0000","last_clean":"2023-07-12T02:02:15.668398+0000","last_became_active":"2023-07-12T02:02:13.332925+0000","last_became_peered":"2023-07-12T02:02:13.332925+0000","last_unstale":"2023-07-12T02:02:15.668398+0000","last_undegraded":"2023-07-12T02:02:15.668398+0000","last_fullsized":"2023-07-12T02:02:15.668398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:57:42.783542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691644+0000","last_change":"2023-07-12T02:02:12.326847+0000","last_active":"2023-07-12T02:02:15.691644+0000","last_peered":"2023-07-12T02:02:15.691644+0000","last_clean":"2023-07-12T02:02:15.691644+0000","last_became_active":"2023-07-12T02:02:12.326564+0000","last_became_peered":"2023-07-12T02:02:12.326564+0000","last_unstale":"2023-07-12T02:02:15.691644+0000","last_undegraded":"2023-07-12T02:02:15.691644+0000","last_fullsized":"2023-07-12T02:02:15.691644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:11.294417+0000","last_clean_scrub_stamp":"2023-07-12T02:02:11.294417+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:17:04.083502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316667+0000","last_change":"2023-07-12T02:02:13.324603+0000","last_active":"2023-07-12T02:02:14.316667+0000","last_peered":"2023-07-12T02:02:14.316667+0000","last_clean":"2023-07-12T02:02:14.316667+0000","last_became_active":"2023-07-12T02:02:13.324373+0000","last_became_peered":"2023-07-12T02:02:13.324373+0000","last_unstale":"2023-07-12T02:02:14.316667+0000","last_undegraded":"2023-07-12T02:02:14.316667+0000","last_fullsized":"2023-07-12T02:02:14.316667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:25:19.868800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691820+0000","last_change":"2023-07-12T02:02:13.335337+0000","last_active":"2023-07-12T02:02:15.691820+0000","last_peered":"2023-07-12T02:02:15.691820+0000","last_clean":"2023-07-12T02:02:15.691820+0000","last_became_active":"2023-07-12T02:02:13.335059+0000","last_became_peered":"2023-07-12T02:02:13.335059+0000","last_unstale":"2023-07-12T02:02:15.691820+0000","last_undegraded":"2023-07-12T02:02:15.691820+0000","last_fullsized":"2023-07-12T02:02:15.691820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:37:30.294522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.668217+0000","last_change":"2023-07-12T02:02:13.338052+0000","last_active":"2023-07-12T02:02:15.668217+0000","last_peered":"2023-07-12T02:02:15.668217+0000","last_clean":"2023-07-12T02:02:15.668217+0000","last_became_active":"2023-07-12T02:02:13.337744+0000","last_became_peered":"2023-07-12T02:02:13.337744+0000","last_unstale":"2023-07-12T02:02:15.668217+0000","last_undegraded":"2023-07-12T02:02:15.668217+0000","last_fullsized":"2023-07-12T02:02:15.668217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:16:46.331127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:14.316568+0000","last_change":"2023-07-12T02:02:13.323841+0000","last_active":"2023-07-12T02:02:14.316568+0000","last_peered":"2023-07-12T02:02:14.316568+0000","last_clean":"2023-07-12T02:02:14.316568+0000","last_became_active":"2023-07-12T02:02:13.323558+0000","last_became_peered":"2023-07-12T02:02:13.323558+0000","last_unstale":"2023-07-12T02:02:14.316568+0000","last_undegraded":"2023-07-12T02:02:14.316568+0000","last_fullsized":"2023-07-12T02:02:14.316568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:16:46.331127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.668695+0000","last_change":"2023-07-12T02:02:13.333951+0000","last_active":"2023-07-12T02:02:15.668695+0000","last_peered":"2023-07-12T02:02:15.668695+0000","last_clean":"2023-07-12T02:02:15.668695+0000","last_became_active":"2023-07-12T02:02:13.332574+0000","last_became_peered":"2023-07-12T02:02:13.332574+0000","last_unstale":"2023-07-12T02:02:15.668695+0000","last_undegraded":"2023-07-12T02:02:15.668695+0000","last_fullsized":"2023-07-12T02:02:15.668695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:31:00.185527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-12T02:02:15.691427+0000","last_change":"2023-07-12T02:02:13.320239+0000","last_active":"2023-07-12T02:02:15.691427+0000","last_peered":"2023-07-12T02:02:15.691427+0000","last_clean":"2023-07-12T02:02:15.691427+0000","last_became_active":"2023-07-12T02:02:13.319332+0000","last_became_peered":"2023-07-12T02:02:13.319332+0000","last_unstale":"2023-07-12T02:02:15.691427+0000","last_undegraded":"2023-07-12T02:02:15.691427+0000","last_fullsized":"2023-07-12T02:02:15.691427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:12.301704+0000","last_clean_scrub_stamp":"2023-07-12T02:02:12.301704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:51:50.388106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":835584,"data_stored":670286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":79099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":806912,"data_stored":668506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2969999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5549999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.484}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.621}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.429}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.389}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":78720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":78138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":79189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":79758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.2889999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.1920000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.153}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.3700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":79751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-12T02:02:22.645 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-12T02:02:22.645 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-07-12T02:02:22.645 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-07-12T02:02:22.645 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-07-12T02:02:22.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.800+0000 7fc43ba67700 1 Processor -- start 2023-07-12T02:02:22.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.801+0000 7fc43ba67700 1 -- start start 2023-07-12T02:02:22.804 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.801+0000 7fc43ba67700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc434147dc0 0x7fc4340721e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:22.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.801+0000 7fc43ba67700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc434069f30 0x7fc434071130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:22.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.801+0000 7fc43ba67700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc43406a380 0x7fc434071670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:22.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.801+0000 7fc43ba67700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc434070950 con 0x7fc434069f30 2023-07-12T02:02:22.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.801+0000 7fc43ba67700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc43406f680 con 0x7fc43406a380 2023-07-12T02:02:22.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.801+0000 7fc43ba67700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43406f920 con 0x7fc434147dc0 2023-07-12T02:02:22.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.802+0000 7fc439002700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc434069f30 0x7fc434071130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:22.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.802+0000 7fc439002700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc434069f30 0x7fc434071130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50784/0 (socket says 172.21.15.60:50784) 2023-07-12T02:02:22.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.802+0000 7fc439002700 1 -- 172.21.15.60:0/1375322070 learned_addr learned my addr 172.21.15.60:0/1375322070 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:22.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.802+0000 7fc43a004700 1 --2- 172.21.15.60:0/1375322070 >> v2:172.21.15.79:3300/0 conn(0x7fc43406a380 0x7fc434071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:22.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.802+0000 7fc439803700 1 --2- 172.21.15.60:0/1375322070 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc434147dc0 0x7fc4340721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:22.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.802+0000 7fc439002700 1 -- 172.21.15.60:0/1375322070 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc434147dc0 msgr2=0x7fc4340721e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:22.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.802+0000 7fc439002700 1 --2- 172.21.15.60:0/1375322070 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc434147dc0 0x7fc4340721e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:22.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.802+0000 7fc439002700 1 -- 172.21.15.60:0/1375322070 >> v2:172.21.15.79:3300/0 conn(0x7fc43406a380 msgr2=0x7fc434071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:22.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.802+0000 7fc439002700 1 --2- 172.21.15.60:0/1375322070 >> v2:172.21.15.79:3300/0 conn(0x7fc43406a380 0x7fc434071670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:22.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.802+0000 7fc439002700 1 -- 172.21.15.60:0/1375322070 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4340b9660 con 0x7fc434069f30 2023-07-12T02:02:22.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.802+0000 7fc439803700 1 --2- 172.21.15.60:0/1375322070 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc434147dc0 0x7fc4340721e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:22.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.802+0000 7fc439002700 1 --2- 172.21.15.60:0/1375322070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc434069f30 0x7fc434071130 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc4340667e0 tx=0x7fc424009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1463b53aea8fea9f server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:22.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.802+0000 7fc438801700 1 -- 172.21.15.60:0/1375322070 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc424011830 con 0x7fc434069f30 2023-07-12T02:02:22.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.802+0000 7fc438801700 1 -- 172.21.15.60:0/1375322070 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc424011990 con 0x7fc434069f30 2023-07-12T02:02:22.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.802+0000 7fc438801700 1 -- 172.21.15.60:0/1375322070 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc424011d20 con 0x7fc434069f30 2023-07-12T02:02:22.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.803+0000 7fc43ba67700 1 -- 172.21.15.60:0/1375322070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc434069f30 msgr2=0x7fc434071130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:22.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.803+0000 7fc43ba67700 1 --2- 172.21.15.60:0/1375322070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc434069f30 0x7fc434071130 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc4340667e0 tx=0x7fc424009bd0 comp rx=0 tx=0).stop 2023-07-12T02:02:22.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.803+0000 7fc43ba67700 1 -- 172.21.15.60:0/1375322070 shutdown_connections 2023-07-12T02:02:22.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.803+0000 7fc43ba67700 1 --2- 172.21.15.60:0/1375322070 >> v2:172.21.15.79:3300/0 conn(0x7fc43406a380 0x7fc434071670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:22.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.803+0000 7fc43ba67700 1 --2- 172.21.15.60:0/1375322070 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc434147dc0 0x7fc4340721e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:22.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.803+0000 7fc43ba67700 1 --2- 172.21.15.60:0/1375322070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc434069f30 0x7fc434071130 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:22.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.803+0000 7fc43ba67700 1 -- 172.21.15.60:0/1375322070 >> 172.21.15.60:0/1375322070 conn(0x7fc43406d0e0 msgr2=0x7fc43406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:22.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.803+0000 7fc43ba67700 1 -- 172.21.15.60:0/1375322070 shutdown_connections 2023-07-12T02:02:22.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.803+0000 7fc43ba67700 1 -- 172.21.15.60:0/1375322070 wait complete. 2023-07-12T02:02:22.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.804+0000 7fc43ba67700 1 Processor -- start 2023-07-12T02:02:22.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.804+0000 7fc43ba67700 1 -- start start 2023-07-12T02:02:22.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.805+0000 7fc43ba67700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc434069f30 0x7fc43414e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:22.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.805+0000 7fc43ba67700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc43406a380 0x7fc434140b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:22.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.805+0000 7fc43ba67700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc434147dc0 0x7fc43413f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:22.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.805+0000 7fc43ba67700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4341e34a0 con 0x7fc434069f30 2023-07-12T02:02:22.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.805+0000 7fc43ba67700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4341e3ce0 con 0x7fc434147dc0 2023-07-12T02:02:22.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.805+0000 7fc43ba67700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4341e3690 con 0x7fc43406a380 2023-07-12T02:02:22.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.805+0000 7fc439803700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc434069f30 0x7fc43414e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:22.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.805+0000 7fc439803700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc434069f30 0x7fc43414e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50790/0 (socket says 172.21.15.60:50790) 2023-07-12T02:02:22.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.805+0000 7fc439803700 1 -- 172.21.15.60:0/635307273 learned_addr learned my addr 172.21.15.60:0/635307273 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:22.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.805+0000 7fc439002700 1 --2- 172.21.15.60:0/635307273 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc43406a380 0x7fc434140b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:22.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.805+0000 7fc43a004700 1 --2- 172.21.15.60:0/635307273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc434147dc0 0x7fc43413f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:22.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.805+0000 7fc439803700 1 -- 172.21.15.60:0/635307273 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc43406a380 msgr2=0x7fc434140b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:22.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.805+0000 7fc439803700 1 --2- 172.21.15.60:0/635307273 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc43406a380 0x7fc434140b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:22.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.806+0000 7fc439803700 1 -- 172.21.15.60:0/635307273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc434147dc0 msgr2=0x7fc43413f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:22.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.806+0000 7fc439803700 1 --2- 172.21.15.60:0/635307273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc434147dc0 0x7fc43413f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:22.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.806+0000 7fc439803700 1 -- 172.21.15.60:0/635307273 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc424009550 con 0x7fc434069f30 2023-07-12T02:02:22.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.806+0000 7fc439803700 1 --2- 172.21.15.60:0/635307273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc434069f30 0x7fc43414e2e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc43000e810 tx=0x7fc43000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:22.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.806+0000 7fc42a7fc700 1 -- 172.21.15.60:0/635307273 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43000c020 con 0x7fc434069f30 2023-07-12T02:02:22.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.806+0000 7fc42a7fc700 1 -- 172.21.15.60:0/635307273 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc430004250 con 0x7fc434069f30 2023-07-12T02:02:22.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.806+0000 7fc43ba67700 1 -- 172.21.15.60:0/635307273 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4341e3970 con 0x7fc434069f30 2023-07-12T02:02:22.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.806+0000 7fc42a7fc700 1 -- 172.21.15.60:0/635307273 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4300036a0 con 0x7fc434069f30 2023-07-12T02:02:22.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.806+0000 7fc43ba67700 1 -- 172.21.15.60:0/635307273 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc43414b7f0 con 0x7fc434069f30 2023-07-12T02:02:22.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.807+0000 7fc43ba67700 1 -- 172.21.15.60:0/635307273 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc434074360 con 0x7fc434069f30 2023-07-12T02:02:22.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.807+0000 7fc42a7fc700 1 -- 172.21.15.60:0/635307273 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc430003800 con 0x7fc434069f30 2023-07-12T02:02:22.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.808+0000 7fc42a7fc700 1 --2- 172.21.15.60:0/635307273 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc41806ace0 0x7fc41806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:22.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.808+0000 7fc42a7fc700 1 -- 172.21.15.60:0/635307273 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc430088da0 con 0x7fc434069f30 2023-07-12T02:02:22.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.808+0000 7fc439002700 1 --2- 172.21.15.60:0/635307273 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc41806ace0 0x7fc41806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:22.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.808+0000 7fc439002700 1 --2- 172.21.15.60:0/635307273 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc41806ace0 0x7fc41806d190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc424009c10 tx=0x7fc424008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:22.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:22.812+0000 7fc42a7fc700 1 -- 172.21.15.60:0/635307273 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fc430053ee0 con 0x7fc434069f30 2023-07-12T02:02:23.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.049+0000 7fc43ba67700 1 -- 172.21.15.60:0/635307273 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc4340b81c0 con 0x7fc434069f30 2023-07-12T02:02:23.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.050+0000 7fc42a7fc700 1 -- 172.21.15.60:0/635307273 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fc430057500 con 0x7fc434069f30 2023-07-12T02:02:23.053 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:02:23.053 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-07-12T02:02:23.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.052+0000 7fc43ba67700 1 -- 172.21.15.60:0/635307273 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc41806ace0 msgr2=0x7fc41806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:23.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.052+0000 7fc43ba67700 1 --2- 172.21.15.60:0/635307273 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc41806ace0 0x7fc41806d190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc424009c10 tx=0x7fc424008030 comp rx=0 tx=0).stop 2023-07-12T02:02:23.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.052+0000 7fc43ba67700 1 -- 172.21.15.60:0/635307273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc434069f30 msgr2=0x7fc43414e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:23.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.052+0000 7fc43ba67700 1 --2- 172.21.15.60:0/635307273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc434069f30 0x7fc43414e2e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc43000e810 tx=0x7fc43000eb20 comp rx=0 tx=0).stop 2023-07-12T02:02:23.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.052+0000 7fc43ba67700 1 -- 172.21.15.60:0/635307273 shutdown_connections 2023-07-12T02:02:23.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.052+0000 7fc43ba67700 1 --2- 172.21.15.60:0/635307273 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc41806ace0 0x7fc41806d190 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:23.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.052+0000 7fc43ba67700 1 --2- 172.21.15.60:0/635307273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc434069f30 0x7fc43414e2e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:23.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.052+0000 7fc43ba67700 1 --2- 172.21.15.60:0/635307273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc434147dc0 0x7fc43413f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:23.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.052+0000 7fc43ba67700 1 --2- 172.21.15.60:0/635307273 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc43406a380 0x7fc434140b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:23.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.052+0000 7fc43ba67700 1 -- 172.21.15.60:0/635307273 >> 172.21.15.60:0/635307273 conn(0x7fc43406d0e0 msgr2=0x7fc4341466e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:23.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.052+0000 7fc43ba67700 1 -- 172.21.15.60:0/635307273 shutdown_connections 2023-07-12T02:02:23.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.052+0000 7fc43ba67700 1 -- 172.21.15.60:0/635307273 wait complete. 2023-07-12T02:02:23.067 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-07-12T02:02:23.067 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:02:23.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.189+0000 7ff5a6993700 1 Processor -- start 2023-07-12T02:02:23.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.189+0000 7ff5a6993700 1 -- start start 2023-07-12T02:02:23.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.190+0000 7ff5a6993700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff5a006b120 0x7ff5a0140ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:23.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.190+0000 7ff5a6993700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff5a0071b20 0x7ff5a0151460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:23.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.190+0000 7ff5a6993700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a006fb30 con 0x7ff5a00b9340 2023-07-12T02:02:23.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.190+0000 7ff5a6993700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5a006f4e0 con 0x7ff5a006b120 2023-07-12T02:02:23.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.190+0000 7ff5a6993700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5a006f7c0 con 0x7ff5a0071b20 2023-07-12T02:02:23.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.190+0000 7ff59ffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff5a006b120 0x7ff5a0140ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:23.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.190+0000 7ff59ffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff5a006b120 0x7ff5a0140ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50794/0 (socket says 172.21.15.60:50794) 2023-07-12T02:02:23.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.190+0000 7ff59ffff700 1 -- 172.21.15.60:0/1146153574 learned_addr learned my addr 172.21.15.60:0/1146153574 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:23.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.191+0000 7ff5a4f30700 1 --2- 172.21.15.60:0/1146153574 >> v2:172.21.15.79:3300/0 conn(0x7ff5a0071b20 0x7ff5a0151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:23.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.191+0000 7ff59ffff700 1 -- 172.21.15.60:0/1146153574 >> v2:172.21.15.79:3300/0 conn(0x7ff5a0071b20 msgr2=0x7ff5a0151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:23.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.191+0000 7ff59ffff700 1 --2- 172.21.15.60:0/1146153574 >> v2:172.21.15.79:3300/0 conn(0x7ff5a0071b20 0x7ff5a0151460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:23.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.191+0000 7ff59ffff700 1 -- 172.21.15.60:0/1146153574 >> v1:172.21.15.79:6789/0 conn(0x7ff5a00b9340 legacy=0x7ff5a0071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:23.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.191+0000 7ff59ffff700 1 -- 172.21.15.60:0/1146153574 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a006edc0 con 0x7ff5a006b120 2023-07-12T02:02:23.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.191+0000 7ff59ffff700 1 --2- 172.21.15.60:0/1146153574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5a006b120 0x7ff5a0140ad0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0147b50 tx=0x7ff590009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a027a53f9507f453 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:23.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.191+0000 7ff59effd700 1 -- 172.21.15.60:0/1146153574 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff590004230 con 0x7ff5a006b120 2023-07-12T02:02:23.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.191+0000 7ff59effd700 1 -- 172.21.15.60:0/1146153574 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff590004390 con 0x7ff5a006b120 2023-07-12T02:02:23.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.191+0000 7ff59effd700 1 -- 172.21.15.60:0/1146153574 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5900036a0 con 0x7ff5a006b120 2023-07-12T02:02:23.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.192+0000 7ff5a6993700 1 -- 172.21.15.60:0/1146153574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5a006b120 msgr2=0x7ff5a0140ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:23.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.192+0000 7ff5a6993700 1 --2- 172.21.15.60:0/1146153574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5a006b120 0x7ff5a0140ad0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0147b50 tx=0x7ff590009bd0 comp rx=0 tx=0).stop 2023-07-12T02:02:23.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.192+0000 7ff5a6993700 1 -- 172.21.15.60:0/1146153574 shutdown_connections 2023-07-12T02:02:23.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.192+0000 7ff5a6993700 1 --2- 172.21.15.60:0/1146153574 >> v2:172.21.15.79:3300/0 conn(0x7ff5a0071b20 0x7ff5a0151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:23.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.192+0000 7ff5a6993700 1 --2- 172.21.15.60:0/1146153574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5a006b120 0x7ff5a0140ad0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:23.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.192+0000 7ff5a6993700 1 -- 172.21.15.60:0/1146153574 >> 172.21.15.60:0/1146153574 conn(0x7ff5a00bd980 msgr2=0x7ff5a00b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:23.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.192+0000 7ff5a6993700 1 -- 172.21.15.60:0/1146153574 shutdown_connections 2023-07-12T02:02:23.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.192+0000 7ff5a6993700 1 -- 172.21.15.60:0/1146153574 wait complete. 2023-07-12T02:02:23.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.193+0000 7ff5a6993700 1 Processor -- start 2023-07-12T02:02:23.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.193+0000 7ff5a6993700 1 -- start start 2023-07-12T02:02:23.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.194+0000 7ff5a6993700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff5a006b120 0x7ff5a0147110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:23.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.194+0000 7ff5a6993700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5a0071b20 0x7ff5a013d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:23.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.194+0000 7ff5a6993700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5a00b9340 0x7ff5a013c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:23.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.194+0000 7ff5a6993700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a0139c30 con 0x7ff5a00b9340 2023-07-12T02:02:23.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.194+0000 7ff5a6993700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a01444e0 con 0x7ff5a0071b20 2023-07-12T02:02:23.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.194+0000 7ff5a6993700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a013d110 con 0x7ff5a006b120 2023-07-12T02:02:23.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.194+0000 7ff5a4f30700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5a00b9340 0x7ff5a013c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:23.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.194+0000 7ff5a4f30700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5a00b9340 0x7ff5a013c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50798/0 (socket says 172.21.15.60:50798) 2023-07-12T02:02:23.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.194+0000 7ff5a4f30700 1 -- 172.21.15.60:0/24063926 learned_addr learned my addr 172.21.15.60:0/24063926 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:23.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.194+0000 7ff59ffff700 1 --2- 172.21.15.60:0/24063926 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff5a006b120 0x7ff5a0147110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:23.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.194+0000 7ff59f7fe700 1 --2- 172.21.15.60:0/24063926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5a0071b20 0x7ff5a013d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:23.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.195+0000 7ff5a4f30700 1 -- 172.21.15.60:0/24063926 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff5a006b120 msgr2=0x7ff5a0147110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:23.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.195+0000 7ff5a4f30700 1 --2- 172.21.15.60:0/24063926 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff5a006b120 0x7ff5a0147110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:23.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.195+0000 7ff5a4f30700 1 -- 172.21.15.60:0/24063926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5a0071b20 msgr2=0x7ff5a013d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:23.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.195+0000 7ff5a4f30700 1 --2- 172.21.15.60:0/24063926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5a0071b20 0x7ff5a013d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:23.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.195+0000 7ff5a4f30700 1 -- 172.21.15.60:0/24063926 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff590009550 con 0x7ff5a00b9340 2023-07-12T02:02:23.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.195+0000 7ff5a4f30700 1 --2- 172.21.15.60:0/24063926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5a00b9340 0x7ff5a013c390 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff598007ed0 tx=0x7ff5980105d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:23.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.195+0000 7ff59cff9700 1 -- 172.21.15.60:0/24063926 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff598013470 con 0x7ff5a00b9340 2023-07-12T02:02:23.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.195+0000 7ff59cff9700 1 -- 172.21.15.60:0/24063926 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5980135f0 con 0x7ff5a00b9340 2023-07-12T02:02:23.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.195+0000 7ff5a6993700 1 -- 172.21.15.60:0/24063926 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a006f2b0 con 0x7ff5a00b9340 2023-07-12T02:02:23.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.195+0000 7ff59cff9700 1 -- 172.21.15.60:0/24063926 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5980139a0 con 0x7ff5a00b9340 2023-07-12T02:02:23.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.195+0000 7ff5a6993700 1 -- 172.21.15.60:0/24063926 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a0142900 con 0x7ff5a00b9340 2023-07-12T02:02:23.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.196+0000 7ff5a6993700 1 -- 172.21.15.60:0/24063926 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a013bd30 con 0x7ff5a00b9340 2023-07-12T02:02:23.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.196+0000 7ff59cff9700 1 -- 172.21.15.60:0/24063926 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff598013b00 con 0x7ff5a00b9340 2023-07-12T02:02:23.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.197+0000 7ff59cff9700 1 --2- 172.21.15.60:0/24063926 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ff58c06ace0 0x7ff58c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:23.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.197+0000 7ff59cff9700 1 -- 172.21.15.60:0/24063926 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff59808c290 con 0x7ff5a00b9340 2023-07-12T02:02:23.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.197+0000 7ff59ffff700 1 --2- 172.21.15.60:0/24063926 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ff58c06ace0 0x7ff58c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:23.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.198+0000 7ff59ffff700 1 --2- 172.21.15.60:0/24063926 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ff58c06ace0 0x7ff58c06d190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff590009130 tx=0x7ff590008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:23.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.202+0000 7ff59cff9700 1 -- 172.21.15.60:0/24063926 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7ff5980573d0 con 0x7ff5a00b9340 2023-07-12T02:02:23.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.399+0000 7ff5a6993700 1 -- 172.21.15.60:0/24063926 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5a0074360 con 0x7ff5a00b9340 2023-07-12T02:02:23.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.400+0000 7ff59cff9700 1 -- 172.21.15.60:0/24063926 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18173 (secure 0 0 0) 0x7ff59805a9f0 con 0x7ff5a00b9340 2023-07-12T02:02:23.404 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:02:23.404 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":21,"fsid":"97e7c909-e567-472e-a5aa-72fde15171f2","created":"2023-07-12T02:01:53.987086+0000","modified":"2023-07-12T02:02:14.307912+0000","last_up_change":"2023-07-12T02:02:04.031780+0000","last_in_change":"2023-07-12T02:01:56.538621+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-12T02:02:05.375042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-12T02:02:05.857441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:02:10.574633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-12T02:02:11.699872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ed8b71c2-3895-4952-a118-16ede0b4a98c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6801","nonce":2818935979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6803","nonce":2818935979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6807","nonce":2818935979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6805","nonce":2818935979}]},"public_addr":"172.21.15.60:6801/2818935979","cluster_addr":"172.21.15.60:6803/2818935979","heartbeat_back_addr":"172.21.15.60:6807/2818935979","heartbeat_front_addr":"172.21.15.60:6805/2818935979","state":["exists","up"]},{"osd":1,"uuid":"7cf4d354-78e0-43ce-8c09-4a7d2a0b57a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6817","nonce":1678864191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6819","nonce":1678864191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6823","nonce":1678864191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6821","nonce":1678864191}]},"public_addr":"172.21.15.60:6817/1678864191","cluster_addr":"172.21.15.60:6819/1678864191","heartbeat_back_addr":"172.21.15.60:6823/1678864191","heartbeat_front_addr":"172.21.15.60:6821/1678864191","state":["exists","up"]},{"osd":2,"uuid":"02c958b8-9599-4470-92cb-8f7018ec0189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6809","nonce":1459480680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6811","nonce":1459480680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6815","nonce":1459480680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6813","nonce":1459480680}]},"public_addr":"172.21.15.60:6809/1459480680","cluster_addr":"172.21.15.60:6811/1459480680","heartbeat_back_addr":"172.21.15.60:6815/1459480680","heartbeat_front_addr":"172.21.15.60:6813/1459480680","state":["exists","up"]},{"osd":3,"uuid":"bc300432-a228-4257-be5c-e42dd5f2015f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6825","nonce":3295100060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6827","nonce":3295100060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6831","nonce":3295100060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6829","nonce":3295100060}]},"public_addr":"172.21.15.60:6825/3295100060","cluster_addr":"172.21.15.60:6827/3295100060","heartbeat_back_addr":"172.21.15.60:6831/3295100060","heartbeat_front_addr":"172.21.15.60:6829/3295100060","state":["exists","up"]},{"osd":4,"uuid":"ad9f7dc4-7126-466d-a656-2844880c6060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6809","nonce":4127109138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6811","nonce":4127109138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6815","nonce":4127109138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6813","nonce":4127109138}]},"public_addr":"172.21.15.79:6809/4127109138","cluster_addr":"172.21.15.79:6811/4127109138","heartbeat_back_addr":"172.21.15.79:6815/4127109138","heartbeat_front_addr":"172.21.15.79:6813/4127109138","state":["exists","up"]},{"osd":5,"uuid":"e88d16ca-0b01-4ab9-8aa8-c4aff7f210f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6801","nonce":421449406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6803","nonce":421449406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6807","nonce":421449406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6805","nonce":421449406}]},"public_addr":"172.21.15.79:6801/421449406","cluster_addr":"172.21.15.79:6803/421449406","heartbeat_back_addr":"172.21.15.79:6807/421449406","heartbeat_front_addr":"172.21.15.79:6805/421449406","state":["exists","up"]},{"osd":6,"uuid":"6898cb84-56d1-48a9-bd45-97e4668e2fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6825","nonce":4144355139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6827","nonce":4144355139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6831","nonce":4144355139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6829","nonce":4144355139}]},"public_addr":"172.21.15.79:6825/4144355139","cluster_addr":"172.21.15.79:6827/4144355139","heartbeat_back_addr":"172.21.15.79:6831/4144355139","heartbeat_front_addr":"172.21.15.79:6829/4144355139","state":["exists","up"]},{"osd":7,"uuid":"65c10882-371e-4762-b384-9c3a48f332ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6817","nonce":2845223299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6819","nonce":2845223299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6823","nonce":2845223299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6821","nonce":2845223299}]},"public_addr":"172.21.15.79:6817/2845223299","cluster_addr":"172.21.15.79:6819/2845223299","heartbeat_back_addr":"172.21.15.79:6823/2845223299","heartbeat_front_addr":"172.21.15.79:6821/2845223299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.634716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.758349+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.728366+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.777395+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707262+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.649705+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.693021+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:02:23.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.403+0000 7ff5a6993700 1 -- 172.21.15.60:0/24063926 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ff58c06ace0 msgr2=0x7ff58c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:23.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.403+0000 7ff5a6993700 1 --2- 172.21.15.60:0/24063926 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ff58c06ace0 0x7ff58c06d190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff590009130 tx=0x7ff590008030 comp rx=0 tx=0).stop 2023-07-12T02:02:23.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.403+0000 7ff5a6993700 1 -- 172.21.15.60:0/24063926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5a00b9340 msgr2=0x7ff5a013c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:23.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.403+0000 7ff5a6993700 1 --2- 172.21.15.60:0/24063926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5a00b9340 0x7ff5a013c390 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff598007ed0 tx=0x7ff5980105d0 comp rx=0 tx=0).stop 2023-07-12T02:02:23.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.403+0000 7ff5a6993700 1 -- 172.21.15.60:0/24063926 shutdown_connections 2023-07-12T02:02:23.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.403+0000 7ff5a6993700 1 --2- 172.21.15.60:0/24063926 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ff58c06ace0 0x7ff58c06d190 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:23.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.403+0000 7ff5a6993700 1 --2- 172.21.15.60:0/24063926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5a00b9340 0x7ff5a013c390 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:23.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.403+0000 7ff5a6993700 1 --2- 172.21.15.60:0/24063926 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff5a006b120 0x7ff5a0147110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:23.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.403+0000 7ff5a6993700 1 --2- 172.21.15.60:0/24063926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5a0071b20 0x7ff5a013d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:23.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.403+0000 7ff5a6993700 1 -- 172.21.15.60:0/24063926 >> 172.21.15.60:0/24063926 conn(0x7ff5a00bd980 msgr2=0x7ff5a013f040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:23.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.403+0000 7ff5a6993700 1 -- 172.21.15.60:0/24063926 shutdown_connections 2023-07-12T02:02:23.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.403+0000 7ff5a6993700 1 -- 172.21.15.60:0/24063926 wait complete. 2023-07-12T02:02:23.418 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-12T02:02:05.375042+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-12T02:02:05.857441+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-12T02:02:10.574633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-12T02:02:11.699872+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-12T02:02:23.419 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-12T02:02:23.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.544+0000 7f7408487700 1 Processor -- start 2023-07-12T02:02:23.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.544+0000 7f7408487700 1 -- start start 2023-07-12T02:02:23.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.545+0000 7f7408487700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f74001449d0 0x7f740014db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:23.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.545+0000 7f7408487700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f74000b8d90 0x7f740006ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:23.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.545+0000 7f7408487700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74000b8620 con 0x7f74000bc810 2023-07-12T02:02:23.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.545+0000 7f7408487700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74000b97a0 con 0x7f74001449d0 2023-07-12T02:02:23.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.545+0000 7f7408487700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7400144da0 con 0x7f74000b8d90 2023-07-12T02:02:23.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.545+0000 7f7406223700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f74001449d0 0x7f740014db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:23.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.545+0000 7f7406223700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f74001449d0 0x7f740014db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50812/0 (socket says 172.21.15.60:50812) 2023-07-12T02:02:23.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.545+0000 7f7406223700 1 -- 172.21.15.60:0/1649491130 learned_addr learned my addr 172.21.15.60:0/1649491130 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:23.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.545+0000 7f7406a24700 1 --2- 172.21.15.60:0/1649491130 >> v2:172.21.15.79:3300/0 conn(0x7f74000b8d90 0x7f740006ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:23.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.545+0000 7f7406223700 1 -- 172.21.15.60:0/1649491130 >> v2:172.21.15.79:3300/0 conn(0x7f74000b8d90 msgr2=0x7f740006ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:23.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.545+0000 7f7406223700 1 --2- 172.21.15.60:0/1649491130 >> v2:172.21.15.79:3300/0 conn(0x7f74000b8d90 0x7f740006ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:23.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.545+0000 7f7406223700 1 -- 172.21.15.60:0/1649491130 >> v1:172.21.15.79:6789/0 conn(0x7f74000bc810 legacy=0x7f74000ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:23.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.545+0000 7f7406223700 1 -- 172.21.15.60:0/1649491130 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74000b8900 con 0x7f74001449d0 2023-07-12T02:02:23.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.546+0000 7f7406223700 1 --2- 172.21.15.60:0/1649491130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74001449d0 0x7f740014db50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f74000be710 tx=0x7f73f0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fca6515523b61882 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:23.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.546+0000 7f7405221700 1 -- 172.21.15.60:0/1649491130 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f000b870 con 0x7f74001449d0 2023-07-12T02:02:23.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.546+0000 7f7405221700 1 -- 172.21.15.60:0/1649491130 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f000b9d0 con 0x7f74001449d0 2023-07-12T02:02:23.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.546+0000 7f7405221700 1 -- 172.21.15.60:0/1649491130 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f000bd60 con 0x7f74001449d0 2023-07-12T02:02:23.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.546+0000 7f7408487700 1 -- 172.21.15.60:0/1649491130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74001449d0 msgr2=0x7f740014db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:23.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.546+0000 7f7408487700 1 --2- 172.21.15.60:0/1649491130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74001449d0 0x7f740014db50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f74000be710 tx=0x7f73f0009bd0 comp rx=0 tx=0).stop 2023-07-12T02:02:23.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.546+0000 7f7408487700 1 -- 172.21.15.60:0/1649491130 shutdown_connections 2023-07-12T02:02:23.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.546+0000 7f7408487700 1 --2- 172.21.15.60:0/1649491130 >> v2:172.21.15.79:3300/0 conn(0x7f74000b8d90 0x7f740006ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:23.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.546+0000 7f7408487700 1 --2- 172.21.15.60:0/1649491130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74001449d0 0x7f740014db50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:23.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.546+0000 7f7408487700 1 -- 172.21.15.60:0/1649491130 >> 172.21.15.60:0/1649491130 conn(0x7f74000c0860 msgr2=0x7f74000c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:23.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.546+0000 7f7408487700 1 -- 172.21.15.60:0/1649491130 shutdown_connections 2023-07-12T02:02:23.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.546+0000 7f7408487700 1 -- 172.21.15.60:0/1649491130 wait complete. 2023-07-12T02:02:23.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.547+0000 7f7408487700 1 Processor -- start 2023-07-12T02:02:23.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.547+0000 7f7408487700 1 -- start start 2023-07-12T02:02:23.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.548+0000 7f7408487700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74000b8d90 0x7f74000b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:23.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.548+0000 7f7408487700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74000bc810 0x7f740014bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:23.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.548+0000 7f7408487700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74001449d0 0x7f740014c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:23.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.548+0000 7f7408487700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74000b64b0 con 0x7f74001449d0 2023-07-12T02:02:23.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.548+0000 7f7408487700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740014d4e0 con 0x7f74000bc810 2023-07-12T02:02:23.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.548+0000 7f7408487700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f740014da60 con 0x7f74000b8d90 2023-07-12T02:02:23.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.548+0000 7f7406a24700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74001449d0 0x7f740014c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:23.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.548+0000 7f7406a24700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74001449d0 0x7f740014c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50828/0 (socket says 172.21.15.60:50828) 2023-07-12T02:02:23.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.548+0000 7f7406a24700 1 -- 172.21.15.60:0/3022410599 learned_addr learned my addr 172.21.15.60:0/3022410599 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:23.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.548+0000 7f7406223700 1 --2- 172.21.15.60:0/3022410599 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74000b8d90 0x7f74000b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:23.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.548+0000 7f7405a22700 1 --2- 172.21.15.60:0/3022410599 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74000bc810 0x7f740014bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:23.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.548+0000 7f7406a24700 1 -- 172.21.15.60:0/3022410599 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74000b8d90 msgr2=0x7f74000b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:23.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.548+0000 7f7406a24700 1 --2- 172.21.15.60:0/3022410599 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74000b8d90 0x7f74000b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:23.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.549+0000 7f7406a24700 1 -- 172.21.15.60:0/3022410599 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74000bc810 msgr2=0x7f740014bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:23.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.549+0000 7f7406a24700 1 --2- 172.21.15.60:0/3022410599 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74000bc810 0x7f740014bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:23.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.549+0000 7f7406a24700 1 -- 172.21.15.60:0/3022410599 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f0009550 con 0x7f74001449d0 2023-07-12T02:02:23.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.549+0000 7f7406a24700 1 --2- 172.21.15.60:0/3022410599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74001449d0 0x7f740014c220 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f73f8007e40 tx=0x7f73f800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:23.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.549+0000 7f73f6ffd700 1 -- 172.21.15.60:0/3022410599 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f800ed30 con 0x7f74001449d0 2023-07-12T02:02:23.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.549+0000 7f73f6ffd700 1 -- 172.21.15.60:0/3022410599 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f8014420 con 0x7f74001449d0 2023-07-12T02:02:23.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.549+0000 7f7408487700 1 -- 172.21.15.60:0/3022410599 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f740014d780 con 0x7f74001449d0 2023-07-12T02:02:23.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.549+0000 7f73f6ffd700 1 -- 172.21.15.60:0/3022410599 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f80147d0 con 0x7f74001449d0 2023-07-12T02:02:23.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.549+0000 7f7408487700 1 -- 172.21.15.60:0/3022410599 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74000b6ae0 con 0x7f74001449d0 2023-07-12T02:02:23.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.550+0000 7f7408487700 1 -- 172.21.15.60:0/3022410599 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f740014ba00 con 0x7f74001449d0 2023-07-12T02:02:23.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.550+0000 7f73f6ffd700 1 -- 172.21.15.60:0/3022410599 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f73f8014930 con 0x7f74001449d0 2023-07-12T02:02:23.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.551+0000 7f73f6ffd700 1 --2- 172.21.15.60:0/3022410599 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f73e406ace0 0x7f73e406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:23.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.551+0000 7f73f6ffd700 1 -- 172.21.15.60:0/3022410599 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f73f8089ae0 con 0x7f74001449d0 2023-07-12T02:02:23.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.551+0000 7f7406223700 1 --2- 172.21.15.60:0/3022410599 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f73e406ace0 0x7f73e406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:23.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.551+0000 7f7406223700 1 --2- 172.21.15.60:0/3022410599 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f73e406ace0 0x7f73e406d190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f73f0014040 tx=0x7f73f0008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:23.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.555+0000 7f73f6ffd700 1 -- 172.21.15.60:0/3022410599 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f740014ba00 con 0x7f74001449d0 2023-07-12T02:02:23.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.751+0000 7f7408487700 1 -- 172.21.15.60:0/3022410599 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f740014ba00 con 0x7f74001449d0 2023-07-12T02:02:23.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.751+0000 7f73f6ffd700 1 -- 172.21.15.60:0/3022410599 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f740014ba00 con 0x7f74001449d0 2023-07-12T02:02:23.754 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2023-07-12T02:02:23.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.753+0000 7f7408487700 1 -- 172.21.15.60:0/3022410599 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f73e406ace0 msgr2=0x7f73e406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:23.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.753+0000 7f7408487700 1 --2- 172.21.15.60:0/3022410599 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f73e406ace0 0x7f73e406d190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f73f0014040 tx=0x7f73f0008030 comp rx=0 tx=0).stop 2023-07-12T02:02:23.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.753+0000 7f7408487700 1 -- 172.21.15.60:0/3022410599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74001449d0 msgr2=0x7f740014c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:23.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.753+0000 7f7408487700 1 --2- 172.21.15.60:0/3022410599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74001449d0 0x7f740014c220 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f73f8007e40 tx=0x7f73f800e3c0 comp rx=0 tx=0).stop 2023-07-12T02:02:23.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.753+0000 7f7408487700 1 -- 172.21.15.60:0/3022410599 shutdown_connections 2023-07-12T02:02:23.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.753+0000 7f7408487700 1 --2- 172.21.15.60:0/3022410599 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f73e406ace0 0x7f73e406d190 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:23.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.753+0000 7f7408487700 1 --2- 172.21.15.60:0/3022410599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74001449d0 0x7f740014c220 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:23.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.753+0000 7f7408487700 1 --2- 172.21.15.60:0/3022410599 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f74000b8d90 0x7f74000b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:23.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.753+0000 7f7408487700 1 --2- 172.21.15.60:0/3022410599 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74000bc810 0x7f740014bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:23.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.753+0000 7f7408487700 1 -- 172.21.15.60:0/3022410599 >> 172.21.15.60:0/3022410599 conn(0x7f74000c0860 msgr2=0x7f74000be740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:23.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.753+0000 7f7408487700 1 -- 172.21.15.60:0/3022410599 shutdown_connections 2023-07-12T02:02:23.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.753+0000 7f7408487700 1 -- 172.21.15.60:0/3022410599 wait complete. 2023-07-12T02:02:23.769 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-12T02:02:23.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.894+0000 7fea84952700 1 Processor -- start 2023-07-12T02:02:23.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.895+0000 7fea84952700 1 -- start start 2023-07-12T02:02:23.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.896+0000 7fea84952700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fea8006b120 0x7fea800b8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:23.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.896+0000 7fea84952700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fea801444c0 0x7fea801448e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:23.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.896+0000 7fea84952700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea80070410 con 0x7fea8014aa40 2023-07-12T02:02:23.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.896+0000 7fea84952700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea800b9590 con 0x7fea801444c0 2023-07-12T02:02:23.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.896+0000 7fea84952700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea8006ef60 con 0x7fea8006b120 2023-07-12T02:02:23.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.896+0000 7fea7ed9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fea801444c0 0x7fea801448e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:23.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.896+0000 7fea77fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fea8014aa40 0x7fea8014ae90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46170/0 (socket says 172.21.15.60:46170) 2023-07-12T02:02:23.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.896+0000 7fea77fff700 1 -- 172.21.15.60:0/639687436 learned_addr learned my addr 172.21.15.60:0/639687436 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:23.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.896+0000 7fea7e59c700 1 --2- 172.21.15.60:0/639687436 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fea8006b120 0x7fea800b8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:23.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.896+0000 7fea7ed9d700 1 -- 172.21.15.60:0/639687436 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fea8006b120 msgr2=0x7fea800b8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:23.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.896+0000 7fea7ed9d700 1 --2- 172.21.15.60:0/639687436 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fea8006b120 0x7fea800b8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:23.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.896+0000 7fea7ed9d700 1 -- 172.21.15.60:0/639687436 >> v1:172.21.15.60:6789/0 conn(0x7fea8014aa40 legacy=0x7fea8014ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:23.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.896+0000 7fea7ed9d700 1 -- 172.21.15.60:0/639687436 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea8006f240 con 0x7fea801444c0 2023-07-12T02:02:23.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.896+0000 7fea7dd9b700 1 -- 172.21.15.60:0/639687436 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 850126278 0 0) 0x7fea80070410 con 0x7fea8014aa40 2023-07-12T02:02:23.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.896+0000 7fea7ed9d700 1 --2- 172.21.15.60:0/639687436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea801444c0 0x7fea801448e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fea78009d90 tx=0x7fea7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ab7d4824ae398e0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:23.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.896+0000 7fea7dd9b700 1 -- 172.21.15.60:0/639687436 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7800e070 con 0x7fea801444c0 2023-07-12T02:02:23.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.896+0000 7fea7dd9b700 1 -- 172.21.15.60:0/639687436 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea7800bbd0 con 0x7fea801444c0 2023-07-12T02:02:23.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.896+0000 7fea7dd9b700 1 -- 172.21.15.60:0/639687436 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea78012430 con 0x7fea801444c0 2023-07-12T02:02:23.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.897+0000 7fea84952700 1 -- 172.21.15.60:0/639687436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea801444c0 msgr2=0x7fea801448e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:23.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.897+0000 7fea84952700 1 --2- 172.21.15.60:0/639687436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea801444c0 0x7fea801448e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fea78009d90 tx=0x7fea7800b330 comp rx=0 tx=0).stop 2023-07-12T02:02:23.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.897+0000 7fea84952700 1 -- 172.21.15.60:0/639687436 shutdown_connections 2023-07-12T02:02:23.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.897+0000 7fea84952700 1 --2- 172.21.15.60:0/639687436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea801444c0 0x7fea801448e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:23.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.897+0000 7fea84952700 1 --2- 172.21.15.60:0/639687436 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fea8006b120 0x7fea800b8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:23.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.897+0000 7fea84952700 1 -- 172.21.15.60:0/639687436 >> 172.21.15.60:0/639687436 conn(0x7fea800bd980 msgr2=0x7fea800b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:23.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.897+0000 7fea84952700 1 -- 172.21.15.60:0/639687436 shutdown_connections 2023-07-12T02:02:23.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.897+0000 7fea84952700 1 -- 172.21.15.60:0/639687436 wait complete. 2023-07-12T02:02:23.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.898+0000 7fea84952700 1 Processor -- start 2023-07-12T02:02:23.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.899+0000 7fea84952700 1 -- start start 2023-07-12T02:02:23.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.899+0000 7fea84952700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fea8006b120 0x7fea8013f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:23.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.899+0000 7fea84952700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea801444c0 0x7fea801452f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:23.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.899+0000 7fea84952700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea8014aa40 0x7fea801df990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:23.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.899+0000 7fea84952700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea8013fd50 con 0x7fea8014aa40 2023-07-12T02:02:23.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.899+0000 7fea84952700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea80145830 con 0x7fea801444c0 2023-07-12T02:02:23.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.899+0000 7fea84952700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea801df4b0 con 0x7fea8006b120 2023-07-12T02:02:23.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.900+0000 7fea7ed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea8014aa40 0x7fea801df990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:23.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.900+0000 7fea7ed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea8014aa40 0x7fea801df990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50850/0 (socket says 172.21.15.60:50850) 2023-07-12T02:02:23.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.900+0000 7fea7ed9d700 1 -- 172.21.15.60:0/869447595 learned_addr learned my addr 172.21.15.60:0/869447595 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:23.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.900+0000 7fea77fff700 1 --2- 172.21.15.60:0/869447595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea801444c0 0x7fea801452f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:23.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.900+0000 7fea7e59c700 1 --2- 172.21.15.60:0/869447595 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fea8006b120 0x7fea8013f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:23.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.900+0000 7fea7ed9d700 1 -- 172.21.15.60:0/869447595 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fea8006b120 msgr2=0x7fea8013f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:23.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.900+0000 7fea7ed9d700 1 --2- 172.21.15.60:0/869447595 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fea8006b120 0x7fea8013f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:23.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.900+0000 7fea7ed9d700 1 -- 172.21.15.60:0/869447595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea801444c0 msgr2=0x7fea801452f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:23.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.900+0000 7fea7ed9d700 1 --2- 172.21.15.60:0/869447595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea801444c0 0x7fea801452f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:23.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.900+0000 7fea7ed9d700 1 -- 172.21.15.60:0/869447595 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea78009a70 con 0x7fea8014aa40 2023-07-12T02:02:23.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.900+0000 7fea77fff700 1 --2- 172.21.15.60:0/869447595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea801444c0 0x7fea801452f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:23.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.900+0000 7fea7ed9d700 1 --2- 172.21.15.60:0/869447595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea8014aa40 0x7fea801df990 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fea8006d830 tx=0x7fea78004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:23.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.900+0000 7fea76ffd700 1 -- 172.21.15.60:0/869447595 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea78012430 con 0x7fea8014aa40 2023-07-12T02:02:23.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.900+0000 7fea76ffd700 1 -- 172.21.15.60:0/869447595 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea78020070 con 0x7fea8014aa40 2023-07-12T02:02:23.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.900+0000 7fea84952700 1 -- 172.21.15.60:0/869447595 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea801e3280 con 0x7fea8014aa40 2023-07-12T02:02:23.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.900+0000 7fea76ffd700 1 -- 172.21.15.60:0/869447595 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea78004280 con 0x7fea8014aa40 2023-07-12T02:02:23.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.900+0000 7fea84952700 1 -- 172.21.15.60:0/869447595 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea801e3610 con 0x7fea8014aa40 2023-07-12T02:02:23.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.901+0000 7fea84952700 1 -- 172.21.15.60:0/869447595 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea8006da40 con 0x7fea8014aa40 2023-07-12T02:02:23.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.902+0000 7fea76ffd700 1 -- 172.21.15.60:0/869447595 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fea780043e0 con 0x7fea8014aa40 2023-07-12T02:02:23.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.902+0000 7fea76ffd700 1 --2- 172.21.15.60:0/869447595 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fea6006ad10 0x7fea6006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:23.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.902+0000 7fea76ffd700 1 -- 172.21.15.60:0/869447595 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fea78022070 con 0x7fea8014aa40 2023-07-12T02:02:23.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.902+0000 7fea7e59c700 1 --2- 172.21.15.60:0/869447595 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fea6006ad10 0x7fea6006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:23.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.903+0000 7fea7e59c700 1 --2- 172.21.15.60:0/869447595 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fea6006ad10 0x7fea6006d1c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fea70006b20 tx=0x7fea70008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:23.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:23.907+0000 7fea76ffd700 1 -- 172.21.15.60:0/869447595 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fea78056640 con 0x7fea8014aa40 2023-07-12T02:02:24.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.103+0000 7fea84952700 1 -- 172.21.15.60:0/869447595 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fea801df670 con 0x7fea8014aa40 2023-07-12T02:02:24.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.103+0000 7fea76ffd700 1 -- 172.21.15.60:0/869447595 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fea78059c60 con 0x7fea8014aa40 2023-07-12T02:02:24.106 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-07-12T02:02:24.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.105+0000 7fea84952700 1 -- 172.21.15.60:0/869447595 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fea6006ad10 msgr2=0x7fea6006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:24.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.105+0000 7fea84952700 1 --2- 172.21.15.60:0/869447595 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fea6006ad10 0x7fea6006d1c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fea70006b20 tx=0x7fea70008040 comp rx=0 tx=0).stop 2023-07-12T02:02:24.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.105+0000 7fea84952700 1 -- 172.21.15.60:0/869447595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea8014aa40 msgr2=0x7fea801df990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:24.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.105+0000 7fea84952700 1 --2- 172.21.15.60:0/869447595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea8014aa40 0x7fea801df990 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fea8006d830 tx=0x7fea78004ad0 comp rx=0 tx=0).stop 2023-07-12T02:02:24.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.105+0000 7fea84952700 1 -- 172.21.15.60:0/869447595 shutdown_connections 2023-07-12T02:02:24.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.105+0000 7fea84952700 1 --2- 172.21.15.60:0/869447595 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fea6006ad10 0x7fea6006d1c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:24.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.105+0000 7fea84952700 1 --2- 172.21.15.60:0/869447595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea8014aa40 0x7fea801df990 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:24.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.105+0000 7fea84952700 1 --2- 172.21.15.60:0/869447595 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fea8006b120 0x7fea8013f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:24.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.105+0000 7fea84952700 1 --2- 172.21.15.60:0/869447595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea801444c0 0x7fea801452f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:24.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.105+0000 7fea84952700 1 -- 172.21.15.60:0/869447595 >> 172.21.15.60:0/869447595 conn(0x7fea800bd980 msgr2=0x7fea8006a680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:24.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.105+0000 7fea84952700 1 -- 172.21.15.60:0/869447595 shutdown_connections 2023-07-12T02:02:24.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.105+0000 7fea84952700 1 -- 172.21.15.60:0/869447595 wait complete. 2023-07-12T02:02:24.120 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-12T02:02:24.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.245+0000 7fbec2dc8700 1 Processor -- start 2023-07-12T02:02:24.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.245+0000 7fbec2dc8700 1 -- start start 2023-07-12T02:02:24.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.246+0000 7fbec2dc8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbebc1449d0 0x7fbebc14db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:24.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.246+0000 7fbec2dc8700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbebc0bc810 0x7fbebc0ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:24.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.246+0000 7fbec2dc8700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbebc0b8d90 0x7fbebc06ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:24.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.246+0000 7fbec2dc8700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbebc0b97a0 con 0x7fbebc0bc810 2023-07-12T02:02:24.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.246+0000 7fbec2dc8700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbebc144da0 con 0x7fbebc1449d0 2023-07-12T02:02:24.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.246+0000 7fbec2dc8700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc0b8620 con 0x7fbebc0b8d90 2023-07-12T02:02:24.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.246+0000 7fbebbfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbebc0bc810 0x7fbebc0ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:24.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.246+0000 7fbebbfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbebc0bc810 0x7fbebc0ba530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50858/0 (socket says 172.21.15.60:50858) 2023-07-12T02:02:24.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.246+0000 7fbebbfff700 1 -- 172.21.15.60:0/3439035930 learned_addr learned my addr 172.21.15.60:0/3439035930 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:24.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.246+0000 7fbec0b64700 1 --2- 172.21.15.60:0/3439035930 >> v2:172.21.15.79:3300/0 conn(0x7fbebc1449d0 0x7fbebc14db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:24.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.246+0000 7fbec1365700 1 --2- 172.21.15.60:0/3439035930 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbebc0b8d90 0x7fbebc06ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:24.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.246+0000 7fbebbfff700 1 -- 172.21.15.60:0/3439035930 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbebc0b8d90 msgr2=0x7fbebc06ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:24.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.246+0000 7fbebbfff700 1 --2- 172.21.15.60:0/3439035930 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbebc0b8d90 0x7fbebc06ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:24.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.246+0000 7fbebbfff700 1 -- 172.21.15.60:0/3439035930 >> v2:172.21.15.79:3300/0 conn(0x7fbebc1449d0 msgr2=0x7fbebc14db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:24.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.246+0000 7fbebbfff700 1 --2- 172.21.15.60:0/3439035930 >> v2:172.21.15.79:3300/0 conn(0x7fbebc1449d0 0x7fbebc14db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:24.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.246+0000 7fbebbfff700 1 -- 172.21.15.60:0/3439035930 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbebc0b8900 con 0x7fbebc0bc810 2023-07-12T02:02:24.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.246+0000 7fbec0b64700 1 --2- 172.21.15.60:0/3439035930 >> v2:172.21.15.79:3300/0 conn(0x7fbebc1449d0 0x7fbebc14db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:02:24.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.247+0000 7fbebbfff700 1 --2- 172.21.15.60:0/3439035930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbebc0bc810 0x7fbebc0ba530 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbebc06cbe0 tx=0x7fbea8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca99b396b7574d4f server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:24.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.247+0000 7fbebb7fe700 1 -- 172.21.15.60:0/3439035930 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea800b870 con 0x7fbebc0bc810 2023-07-12T02:02:24.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.247+0000 7fbebb7fe700 1 -- 172.21.15.60:0/3439035930 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea800b9d0 con 0x7fbebc0bc810 2023-07-12T02:02:24.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.247+0000 7fbebb7fe700 1 -- 172.21.15.60:0/3439035930 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea800bd60 con 0x7fbebc0bc810 2023-07-12T02:02:24.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.247+0000 7fbec2dc8700 1 -- 172.21.15.60:0/3439035930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbebc0bc810 msgr2=0x7fbebc0ba530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:24.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.247+0000 7fbec2dc8700 1 --2- 172.21.15.60:0/3439035930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbebc0bc810 0x7fbebc0ba530 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbebc06cbe0 tx=0x7fbea8009bd0 comp rx=0 tx=0).stop 2023-07-12T02:02:24.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.247+0000 7fbec2dc8700 1 -- 172.21.15.60:0/3439035930 shutdown_connections 2023-07-12T02:02:24.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.247+0000 7fbec2dc8700 1 --2- 172.21.15.60:0/3439035930 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbebc0b8d90 0x7fbebc06ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:24.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.247+0000 7fbec2dc8700 1 --2- 172.21.15.60:0/3439035930 >> v2:172.21.15.79:3300/0 conn(0x7fbebc1449d0 0x7fbebc14db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:24.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.247+0000 7fbec2dc8700 1 --2- 172.21.15.60:0/3439035930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbebc0bc810 0x7fbebc0ba530 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:24.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.247+0000 7fbec2dc8700 1 -- 172.21.15.60:0/3439035930 >> 172.21.15.60:0/3439035930 conn(0x7fbebc0c0860 msgr2=0x7fbebc0c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:24.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.247+0000 7fbec2dc8700 1 -- 172.21.15.60:0/3439035930 shutdown_connections 2023-07-12T02:02:24.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.247+0000 7fbec2dc8700 1 -- 172.21.15.60:0/3439035930 wait complete. 2023-07-12T02:02:24.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.249+0000 7fbec2dc8700 1 Processor -- start 2023-07-12T02:02:24.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.249+0000 7fbec2dc8700 1 -- start start 2023-07-12T02:02:24.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.249+0000 7fbec2dc8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbebc0b8d90 0x7fbebc14ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:24.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.249+0000 7fbec2dc8700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbebc0bc810 0x7fbebc145930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:24.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.249+0000 7fbec2dc8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbebc1449d0 0x7fbebc0b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:24.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.249+0000 7fbec2dc8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc145e70 con 0x7fbebc0b8d90 2023-07-12T02:02:24.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.249+0000 7fbec2dc8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc146990 con 0x7fbebc1449d0 2023-07-12T02:02:24.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.249+0000 7fbec2dc8700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc1477f0 con 0x7fbebc0bc810 2023-07-12T02:02:24.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.249+0000 7fbec0b64700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbebc0b8d90 0x7fbebc14ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:24.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.249+0000 7fbec0b64700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbebc0b8d90 0x7fbebc14ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50872/0 (socket says 172.21.15.60:50872) 2023-07-12T02:02:24.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.249+0000 7fbec0b64700 1 -- 172.21.15.60:0/1371616020 learned_addr learned my addr 172.21.15.60:0/1371616020 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:24.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.250+0000 7fbec1365700 1 --2- 172.21.15.60:0/1371616020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbebc1449d0 0x7fbebc0b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:24.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.250+0000 7fbebbfff700 1 --2- 172.21.15.60:0/1371616020 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbebc0bc810 0x7fbebc145930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:24.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.250+0000 7fbec0b64700 1 -- 172.21.15.60:0/1371616020 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbebc0bc810 msgr2=0x7fbebc145930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:24.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.250+0000 7fbec0b64700 1 --2- 172.21.15.60:0/1371616020 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbebc0bc810 0x7fbebc145930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:24.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.250+0000 7fbec0b64700 1 -- 172.21.15.60:0/1371616020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbebc1449d0 msgr2=0x7fbebc0b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:24.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.250+0000 7fbec0b64700 1 --2- 172.21.15.60:0/1371616020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbebc1449d0 0x7fbebc0b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:24.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.250+0000 7fbec0b64700 1 -- 172.21.15.60:0/1371616020 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea8009550 con 0x7fbebc0b8d90 2023-07-12T02:02:24.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.250+0000 7fbec0b64700 1 --2- 172.21.15.60:0/1371616020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbebc0b8d90 0x7fbebc14ae20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbeb000c7f0 tx=0x7fbeb000cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:24.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.250+0000 7fbeb97fa700 1 -- 172.21.15.60:0/1371616020 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb0011800 con 0x7fbebc0b8d90 2023-07-12T02:02:24.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.250+0000 7fbeb97fa700 1 -- 172.21.15.60:0/1371616020 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeb0011960 con 0x7fbebc0b8d90 2023-07-12T02:02:24.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.250+0000 7fbec2dc8700 1 -- 172.21.15.60:0/1371616020 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbebc147a90 con 0x7fbebc0b8d90 2023-07-12T02:02:24.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.250+0000 7fbeb97fa700 1 -- 172.21.15.60:0/1371616020 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb0011cf0 con 0x7fbebc0b8d90 2023-07-12T02:02:24.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.250+0000 7fbec2dc8700 1 -- 172.21.15.60:0/1371616020 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbebc0b2830 con 0x7fbebc0b8d90 2023-07-12T02:02:24.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.251+0000 7fbec2dc8700 1 -- 172.21.15.60:0/1371616020 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbebc0b2ba0 con 0x7fbebc0b8d90 2023-07-12T02:02:24.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.252+0000 7fbeb97fa700 1 -- 172.21.15.60:0/1371616020 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbeb0018360 con 0x7fbebc0b8d90 2023-07-12T02:02:24.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.252+0000 7fbeb97fa700 1 --2- 172.21.15.60:0/1371616020 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fbea006ace0 0x7fbea006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:24.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.252+0000 7fbeb97fa700 1 -- 172.21.15.60:0/1371616020 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbeb0089280 con 0x7fbebc0b8d90 2023-07-12T02:02:24.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.252+0000 7fbebbfff700 1 --2- 172.21.15.60:0/1371616020 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fbea006ace0 0x7fbea006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:24.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.253+0000 7fbebbfff700 1 --2- 172.21.15.60:0/1371616020 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fbea006ace0 0x7fbea006d190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbea8000c00 tx=0x7fbea8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:24.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.257+0000 7fbeb97fa700 1 -- 172.21.15.60:0/1371616020 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fbeb0054330 con 0x7fbebc0b8d90 2023-07-12T02:02:24.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.452+0000 7fbec2dc8700 1 -- 172.21.15.60:0/1371616020 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbebc0b2690 con 0x7fbebc0b8d90 2023-07-12T02:02:24.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.453+0000 7fbeb97fa700 1 -- 172.21.15.60:0/1371616020 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbebc0b2690 con 0x7fbebc0b8d90 2023-07-12T02:02:24.456 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-07-12T02:02:24.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.455+0000 7fbec2dc8700 1 -- 172.21.15.60:0/1371616020 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fbea006ace0 msgr2=0x7fbea006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:24.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.455+0000 7fbec2dc8700 1 --2- 172.21.15.60:0/1371616020 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fbea006ace0 0x7fbea006d190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbea8000c00 tx=0x7fbea8008030 comp rx=0 tx=0).stop 2023-07-12T02:02:24.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.455+0000 7fbec2dc8700 1 -- 172.21.15.60:0/1371616020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbebc0b8d90 msgr2=0x7fbebc14ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:24.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.455+0000 7fbec2dc8700 1 --2- 172.21.15.60:0/1371616020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbebc0b8d90 0x7fbebc14ae20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbeb000c7f0 tx=0x7fbeb000cb00 comp rx=0 tx=0).stop 2023-07-12T02:02:24.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.455+0000 7fbec2dc8700 1 -- 172.21.15.60:0/1371616020 shutdown_connections 2023-07-12T02:02:24.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.455+0000 7fbec2dc8700 1 --2- 172.21.15.60:0/1371616020 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fbea006ace0 0x7fbea006d190 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:24.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.455+0000 7fbec2dc8700 1 --2- 172.21.15.60:0/1371616020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbebc0b8d90 0x7fbebc14ae20 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:24.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.455+0000 7fbec2dc8700 1 --2- 172.21.15.60:0/1371616020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbebc1449d0 0x7fbebc0b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:24.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.455+0000 7fbec2dc8700 1 --2- 172.21.15.60:0/1371616020 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbebc0bc810 0x7fbebc145930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:24.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.455+0000 7fbec2dc8700 1 -- 172.21.15.60:0/1371616020 >> 172.21.15.60:0/1371616020 conn(0x7fbebc0c0860 msgr2=0x7fbebc142da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:24.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.455+0000 7fbec2dc8700 1 -- 172.21.15.60:0/1371616020 shutdown_connections 2023-07-12T02:02:24.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.455+0000 7fbec2dc8700 1 -- 172.21.15.60:0/1371616020 wait complete. 2023-07-12T02:02:24.470 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-12T02:02:24.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.595+0000 7f0c6bc5d700 1 Processor -- start 2023-07-12T02:02:24.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.595+0000 7f0c6bc5d700 1 -- start start 2023-07-12T02:02:24.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.596+0000 7f0c6bc5d700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c64144820 0x7f0c640b65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:24.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.596+0000 7f0c6bc5d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0c6414af10 0x7f0c640b6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:24.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.596+0000 7f0c6bc5d700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c640b5f00 con 0x7f0c640b5a10 2023-07-12T02:02:24.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.596+0000 7f0c6bc5d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c640b61e0 con 0x7f0c6414af10 2023-07-12T02:02:24.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.596+0000 7f0c6bc5d700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c640c17d0 con 0x7f0c64144820 2023-07-12T02:02:24.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.596+0000 7f0c6a1fa700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0c6414af10 0x7f0c640b6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:24.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.596+0000 7f0c6a1fa700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0c6414af10 0x7f0c640b6b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50874/0 (socket says 172.21.15.60:50874) 2023-07-12T02:02:24.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.596+0000 7f0c6a1fa700 1 -- 172.21.15.60:0/3271079587 learned_addr learned my addr 172.21.15.60:0/3271079587 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:24.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.596+0000 7f0c699f9700 1 --2- 172.21.15.60:0/3271079587 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c64144820 0x7f0c640b65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:24.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.596+0000 7f0c6a1fa700 1 -- 172.21.15.60:0/3271079587 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c64144820 msgr2=0x7f0c640b65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:24.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.596+0000 7f0c6a1fa700 1 --2- 172.21.15.60:0/3271079587 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c64144820 0x7f0c640b65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:24.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.596+0000 7f0c6a1fa700 1 -- 172.21.15.60:0/3271079587 >> v1:172.21.15.79:6789/0 conn(0x7f0c640b5a10 legacy=0x7f0c6414a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:24.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.596+0000 7f0c6a1fa700 1 -- 172.21.15.60:0/3271079587 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c640b7160 con 0x7f0c6414af10 2023-07-12T02:02:24.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.596+0000 7f0c6a1fa700 1 --2- 172.21.15.60:0/3271079587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c6414af10 0x7f0c640b6b10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c009e50 tx=0x7f0c5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63a172c46a672718 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:24.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.596+0000 7f0c689f7700 1 -- 172.21.15.60:0/3271079587 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c00e070 con 0x7f0c6414af10 2023-07-12T02:02:24.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.596+0000 7f0c689f7700 1 -- 172.21.15.60:0/3271079587 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c5c00b910 con 0x7f0c6414af10 2023-07-12T02:02:24.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.596+0000 7f0c689f7700 1 -- 172.21.15.60:0/3271079587 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c00bcc0 con 0x7f0c6414af10 2023-07-12T02:02:24.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.597+0000 7f0c6bc5d700 1 -- 172.21.15.60:0/3271079587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c6414af10 msgr2=0x7f0c640b6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:24.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.597+0000 7f0c6bc5d700 1 --2- 172.21.15.60:0/3271079587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c6414af10 0x7f0c640b6b10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c009e50 tx=0x7f0c5c00b330 comp rx=0 tx=0).stop 2023-07-12T02:02:24.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.597+0000 7f0c6bc5d700 1 -- 172.21.15.60:0/3271079587 shutdown_connections 2023-07-12T02:02:24.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.597+0000 7f0c6bc5d700 1 --2- 172.21.15.60:0/3271079587 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c64144820 0x7f0c640b65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:24.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.597+0000 7f0c6bc5d700 1 --2- 172.21.15.60:0/3271079587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c6414af10 0x7f0c640b6b10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:24.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.597+0000 7f0c6bc5d700 1 -- 172.21.15.60:0/3271079587 >> 172.21.15.60:0/3271079587 conn(0x7f0c640c08f0 msgr2=0x7f0c640c0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:24.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.597+0000 7f0c6bc5d700 1 -- 172.21.15.60:0/3271079587 shutdown_connections 2023-07-12T02:02:24.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.597+0000 7f0c6bc5d700 1 -- 172.21.15.60:0/3271079587 wait complete. 2023-07-12T02:02:24.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.598+0000 7f0c6bc5d700 1 Processor -- start 2023-07-12T02:02:24.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.598+0000 7f0c6bc5d700 1 -- start start 2023-07-12T02:02:24.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.599+0000 7f0c6bc5d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c640b5a10 0x7f0c640b9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:24.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.599+0000 7f0c6bc5d700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c64144820 0x7f0c641e3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:24.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.599+0000 7f0c6bc5d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c6414af10 0x7f0c64139640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:24.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.599+0000 7f0c6bc5d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c64145ec0 con 0x7f0c6414af10 2023-07-12T02:02:24.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.599+0000 7f0c6bc5d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c641e3390 con 0x7f0c640b5a10 2023-07-12T02:02:24.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.599+0000 7f0c6bc5d700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c64144ed0 con 0x7f0c64144820 2023-07-12T02:02:24.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.599+0000 7f0c6a1fa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c6414af10 0x7f0c64139640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:24.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.599+0000 7f0c6a1fa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c6414af10 0x7f0c64139640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50886/0 (socket says 172.21.15.60:50886) 2023-07-12T02:02:24.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.599+0000 7f0c6a1fa700 1 -- 172.21.15.60:0/3708917492 learned_addr learned my addr 172.21.15.60:0/3708917492 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:24.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.599+0000 7f0c691f8700 1 --2- 172.21.15.60:0/3708917492 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c64144820 0x7f0c641e3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:24.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.599+0000 7f0c699f9700 1 --2- 172.21.15.60:0/3708917492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c640b5a10 0x7f0c640b9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:24.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.599+0000 7f0c6a1fa700 1 -- 172.21.15.60:0/3708917492 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c64144820 msgr2=0x7f0c641e3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:24.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.599+0000 7f0c6a1fa700 1 --2- 172.21.15.60:0/3708917492 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c64144820 0x7f0c641e3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:24.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.599+0000 7f0c6a1fa700 1 -- 172.21.15.60:0/3708917492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c640b5a10 msgr2=0x7f0c640b9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:24.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.599+0000 7f0c6a1fa700 1 --2- 172.21.15.60:0/3708917492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c640b5a10 0x7f0c640b9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:24.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.599+0000 7f0c6a1fa700 1 -- 172.21.15.60:0/3708917492 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c5c009b30 con 0x7f0c6414af10 2023-07-12T02:02:24.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.599+0000 7f0c6a1fa700 1 --2- 172.21.15.60:0/3708917492 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c6414af10 0x7f0c64139640 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0c64073f10 tx=0x7f0c5c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:24.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.599+0000 7f0c5a7fc700 1 -- 172.21.15.60:0/3708917492 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c004780 con 0x7f0c6414af10 2023-07-12T02:02:24.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.600+0000 7f0c5a7fc700 1 -- 172.21.15.60:0/3708917492 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c5c004900 con 0x7f0c6414af10 2023-07-12T02:02:24.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.600+0000 7f0c5a7fc700 1 -- 172.21.15.60:0/3708917492 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c01c650 con 0x7f0c6414af10 2023-07-12T02:02:24.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.600+0000 7f0c6bc5d700 1 -- 172.21.15.60:0/3708917492 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c64146b00 con 0x7f0c6414af10 2023-07-12T02:02:24.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.600+0000 7f0c6bc5d700 1 -- 172.21.15.60:0/3708917492 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c641e35e0 con 0x7f0c6414af10 2023-07-12T02:02:24.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.601+0000 7f0c6bc5d700 1 -- 172.21.15.60:0/3708917492 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c641e3800 con 0x7f0c6414af10 2023-07-12T02:02:24.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.601+0000 7f0c5a7fc700 1 -- 172.21.15.60:0/3708917492 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0c5c01c7b0 con 0x7f0c6414af10 2023-07-12T02:02:24.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.601+0000 7f0c5a7fc700 1 --2- 172.21.15.60:0/3708917492 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f0c4806ace0 0x7f0c4806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:24.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.601+0000 7f0c5a7fc700 1 -- 172.21.15.60:0/3708917492 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0c5c08ab20 con 0x7f0c6414af10 2023-07-12T02:02:24.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.602+0000 7f0c699f9700 1 --2- 172.21.15.60:0/3708917492 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f0c4806ace0 0x7f0c4806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:24.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.602+0000 7f0c699f9700 1 --2- 172.21.15.60:0/3708917492 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f0c4806ace0 0x7f0c4806d190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0c60009be0 tx=0x7f0c60009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:24.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.606+0000 7f0c5a7fc700 1 -- 172.21.15.60:0/3708917492 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f0c5c055c60 con 0x7f0c6414af10 2023-07-12T02:02:24.804 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.802+0000 7f0c6bc5d700 1 -- 172.21.15.60:0/3708917492 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0c64074360 con 0x7f0c6414af10 2023-07-12T02:02:24.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.802+0000 7f0c5a7fc700 1 -- 172.21.15.60:0/3708917492 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0c5c059280 con 0x7f0c6414af10 2023-07-12T02:02:24.805 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-07-12T02:02:24.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.804+0000 7f0c6bc5d700 1 -- 172.21.15.60:0/3708917492 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f0c4806ace0 msgr2=0x7f0c4806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:24.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.804+0000 7f0c6bc5d700 1 --2- 172.21.15.60:0/3708917492 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f0c4806ace0 0x7f0c4806d190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0c60009be0 tx=0x7f0c60009210 comp rx=0 tx=0).stop 2023-07-12T02:02:24.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.804+0000 7f0c6bc5d700 1 -- 172.21.15.60:0/3708917492 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c6414af10 msgr2=0x7f0c64139640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:24.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.804+0000 7f0c6bc5d700 1 --2- 172.21.15.60:0/3708917492 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c6414af10 0x7f0c64139640 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0c64073f10 tx=0x7f0c5c004ad0 comp rx=0 tx=0).stop 2023-07-12T02:02:24.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.804+0000 7f0c6bc5d700 1 -- 172.21.15.60:0/3708917492 shutdown_connections 2023-07-12T02:02:24.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.804+0000 7f0c6bc5d700 1 --2- 172.21.15.60:0/3708917492 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f0c4806ace0 0x7f0c4806d190 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:24.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.804+0000 7f0c6bc5d700 1 --2- 172.21.15.60:0/3708917492 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c6414af10 0x7f0c64139640 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:24.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.804+0000 7f0c6bc5d700 1 --2- 172.21.15.60:0/3708917492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c640b5a10 0x7f0c640b9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:24.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.804+0000 7f0c6bc5d700 1 --2- 172.21.15.60:0/3708917492 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0c64144820 0x7f0c641e3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:24.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.804+0000 7f0c6bc5d700 1 -- 172.21.15.60:0/3708917492 >> 172.21.15.60:0/3708917492 conn(0x7f0c640c08f0 msgr2=0x7f0c640b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:24.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.804+0000 7f0c6bc5d700 1 -- 172.21.15.60:0/3708917492 shutdown_connections 2023-07-12T02:02:24.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.804+0000 7f0c6bc5d700 1 -- 172.21.15.60:0/3708917492 wait complete. 2023-07-12T02:02:24.819 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-12T02:02:24.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.942+0000 7f37e63f4700 1 Processor -- start 2023-07-12T02:02:24.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.942+0000 7f37e63f4700 1 -- start start 2023-07-12T02:02:24.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.943+0000 7f37e63f4700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f37e0141780 0x7f37e00ba010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:24.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.943+0000 7f37e63f4700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37e00b96b0 0x7f37e0151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:24.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.943+0000 7f37e63f4700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37e0070e70 con 0x7f37e0071a30 2023-07-12T02:02:24.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.943+0000 7f37e63f4700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37e0071ea0 con 0x7f37e0141780 2023-07-12T02:02:24.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.943+0000 7f37e63f4700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37e00b9b40 con 0x7f37e00b96b0 2023-07-12T02:02:24.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.943+0000 7f37dffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f37e0141780 0x7f37e00ba010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:24.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.943+0000 7f37df7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f37e0071a30 0x7f37e014ab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46178/0 (socket says 172.21.15.60:46178) 2023-07-12T02:02:24.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.943+0000 7f37df7fe700 1 -- 172.21.15.60:0/2110854673 learned_addr learned my addr 172.21.15.60:0/2110854673 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:24.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.943+0000 7f37e4991700 1 --2- 172.21.15.60:0/2110854673 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37e00b96b0 0x7f37e0151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:24.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.943+0000 7f37dffff700 1 -- 172.21.15.60:0/2110854673 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37e00b96b0 msgr2=0x7f37e0151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:24.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.943+0000 7f37dffff700 1 --2- 172.21.15.60:0/2110854673 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37e00b96b0 0x7f37e0151eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:24.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.943+0000 7f37dffff700 1 -- 172.21.15.60:0/2110854673 >> v1:172.21.15.60:6789/0 conn(0x7f37e0071a30 legacy=0x7f37e014ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:24.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.943+0000 7f37dffff700 1 -- 172.21.15.60:0/2110854673 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e0070670 con 0x7f37e0141780 2023-07-12T02:02:24.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.943+0000 7f37e4991700 1 --2- 172.21.15.60:0/2110854673 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37e00b96b0 0x7f37e0151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:24.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.944+0000 7f37dffff700 1 --2- 172.21.15.60:0/2110854673 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37e0141780 0x7f37e00ba010 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f37d000bae0 tx=0x7f37d000bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec3217b2689ef583 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:24.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.944+0000 7f37deffd700 1 -- 172.21.15.60:0/2110854673 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d000dd30 con 0x7f37e0141780 2023-07-12T02:02:24.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.944+0000 7f37deffd700 1 -- 172.21.15.60:0/2110854673 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d000de90 con 0x7f37e0141780 2023-07-12T02:02:24.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.944+0000 7f37deffd700 1 -- 172.21.15.60:0/2110854673 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d0010690 con 0x7f37e0141780 2023-07-12T02:02:24.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.944+0000 7f37e63f4700 1 -- 172.21.15.60:0/2110854673 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37e0141780 msgr2=0x7f37e00ba010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:24.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.944+0000 7f37e63f4700 1 --2- 172.21.15.60:0/2110854673 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37e0141780 0x7f37e00ba010 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f37d000bae0 tx=0x7f37d000bdf0 comp rx=0 tx=0).stop 2023-07-12T02:02:24.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.944+0000 7f37e63f4700 1 -- 172.21.15.60:0/2110854673 shutdown_connections 2023-07-12T02:02:24.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.944+0000 7f37e63f4700 1 --2- 172.21.15.60:0/2110854673 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37e00b96b0 0x7f37e0151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:24.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.944+0000 7f37e63f4700 1 --2- 172.21.15.60:0/2110854673 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37e0141780 0x7f37e00ba010 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:24.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.944+0000 7f37e63f4700 1 -- 172.21.15.60:0/2110854673 >> 172.21.15.60:0/2110854673 conn(0x7f37e006d0e0 msgr2=0x7f37e006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:24.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.944+0000 7f37e63f4700 1 -- 172.21.15.60:0/2110854673 shutdown_connections 2023-07-12T02:02:24.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.944+0000 7f37e63f4700 1 -- 172.21.15.60:0/2110854673 wait complete. 2023-07-12T02:02:24.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.946+0000 7f37e63f4700 1 Processor -- start 2023-07-12T02:02:24.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.946+0000 7f37e63f4700 1 -- start start 2023-07-12T02:02:24.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.947+0000 7f37e63f4700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37e0071a30 0x7f37e01d32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:24.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.947+0000 7f37e63f4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37e00b96b0 0x7f37e0142e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:24.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.947+0000 7f37e63f4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37e0141780 0x7f37e00b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:24.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.947+0000 7f37e63f4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e01d3810 con 0x7f37e00b96b0 2023-07-12T02:02:24.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.947+0000 7f37e63f4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e01d0940 con 0x7f37e0141780 2023-07-12T02:02:24.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.947+0000 7f37e63f4700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37e01d1c50 con 0x7f37e0071a30 2023-07-12T02:02:24.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.947+0000 7f37df7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37e00b96b0 0x7f37e0142e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:24.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.947+0000 7f37df7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37e00b96b0 0x7f37e0142e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50896/0 (socket says 172.21.15.60:50896) 2023-07-12T02:02:24.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.947+0000 7f37df7fe700 1 -- 172.21.15.60:0/2072271637 learned_addr learned my addr 172.21.15.60:0/2072271637 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:24.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.947+0000 7f37dffff700 1 --2- 172.21.15.60:0/2072271637 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37e0071a30 0x7f37e01d32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:24.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.947+0000 7f37e4991700 1 --2- 172.21.15.60:0/2072271637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37e0141780 0x7f37e00b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:24.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.947+0000 7f37df7fe700 1 -- 172.21.15.60:0/2072271637 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37e0071a30 msgr2=0x7f37e01d32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:24.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.947+0000 7f37df7fe700 1 --2- 172.21.15.60:0/2072271637 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37e0071a30 0x7f37e01d32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:24.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.947+0000 7f37df7fe700 1 -- 172.21.15.60:0/2072271637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37e0141780 msgr2=0x7f37e00b4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:24.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.947+0000 7f37df7fe700 1 --2- 172.21.15.60:0/2072271637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37e0141780 0x7f37e00b4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:24.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.947+0000 7f37df7fe700 1 -- 172.21.15.60:0/2072271637 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d000b740 con 0x7f37e00b96b0 2023-07-12T02:02:24.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.947+0000 7f37df7fe700 1 --2- 172.21.15.60:0/2072271637 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37e00b96b0 0x7f37e0142e40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f37d400c4d0 tx=0x7f37d400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:24.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.947+0000 7f37dcff9700 1 -- 172.21.15.60:0/2072271637 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d4005d70 con 0x7f37e00b96b0 2023-07-12T02:02:24.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.947+0000 7f37dcff9700 1 -- 172.21.15.60:0/2072271637 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d40070d0 con 0x7f37e00b96b0 2023-07-12T02:02:24.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.947+0000 7f37e63f4700 1 -- 172.21.15.60:0/2072271637 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37e01d2660 con 0x7f37e00b96b0 2023-07-12T02:02:24.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.948+0000 7f37dcff9700 1 -- 172.21.15.60:0/2072271637 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d4007440 con 0x7f37e00b96b0 2023-07-12T02:02:24.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.948+0000 7f37e63f4700 1 -- 172.21.15.60:0/2072271637 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37e01d2a40 con 0x7f37e00b96b0 2023-07-12T02:02:24.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.948+0000 7f37e63f4700 1 -- 172.21.15.60:0/2072271637 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37e01d0ab0 con 0x7f37e00b96b0 2023-07-12T02:02:24.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.949+0000 7f37dcff9700 1 -- 172.21.15.60:0/2072271637 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f37d40075a0 con 0x7f37e00b96b0 2023-07-12T02:02:24.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.949+0000 7f37dcff9700 1 --2- 172.21.15.60:0/2072271637 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f37cc06ace0 0x7f37cc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:24.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.949+0000 7f37dcff9700 1 -- 172.21.15.60:0/2072271637 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f37d4088900 con 0x7f37e00b96b0 2023-07-12T02:02:24.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.950+0000 7f37dffff700 1 --2- 172.21.15.60:0/2072271637 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f37cc06ace0 0x7f37cc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:24.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.950+0000 7f37dffff700 1 --2- 172.21.15.60:0/2072271637 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f37cc06ace0 0x7f37cc06d190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f37d000be30 tx=0x7f37d0013000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:24.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:24.954+0000 7f37dcff9700 1 -- 172.21.15.60:0/2072271637 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f37e01d0ab0 con 0x7f37e00b96b0 2023-07-12T02:02:25.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.199+0000 7f37e63f4700 1 -- 172.21.15.60:0/2072271637 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f37e01d24c0 con 0x7f37e00b96b0 2023-07-12T02:02:25.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.199+0000 7f37dcff9700 1 -- 172.21.15.60:0/2072271637 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3906 (secure 0 0 0) 0x7f37e01d24c0 con 0x7f37e00b96b0 2023-07-12T02:02:25.203 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:02:25.203 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2687011977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2687011977},{"type":"v1","addr":"172.21.15.60:6835","nonce":2687011977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/1153134400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1153134400},{"type":"v1","addr":"172.21.15.79:6835","nonce":1153134400}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-12T02:02:12.733570+0000","modified":"2023-07-12T02:02:15.754293+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6833/825430907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":825430907},{"type":"v1","addr":"172.21.15.60:6833","nonce":825430907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-12T02:02:25.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.201+0000 7f37e63f4700 1 -- 172.21.15.60:0/2072271637 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f37cc06ace0 msgr2=0x7f37cc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:25.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.201+0000 7f37e63f4700 1 --2- 172.21.15.60:0/2072271637 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f37cc06ace0 0x7f37cc06d190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f37d000be30 tx=0x7f37d0013000 comp rx=0 tx=0).stop 2023-07-12T02:02:25.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.201+0000 7f37e63f4700 1 -- 172.21.15.60:0/2072271637 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37e00b96b0 msgr2=0x7f37e0142e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:25.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.201+0000 7f37e63f4700 1 --2- 172.21.15.60:0/2072271637 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37e00b96b0 0x7f37e0142e40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f37d400c4d0 tx=0x7f37d400c890 comp rx=0 tx=0).stop 2023-07-12T02:02:25.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.201+0000 7f37e63f4700 1 -- 172.21.15.60:0/2072271637 shutdown_connections 2023-07-12T02:02:25.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.201+0000 7f37e63f4700 1 --2- 172.21.15.60:0/2072271637 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f37cc06ace0 0x7f37cc06d190 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:25.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.201+0000 7f37e63f4700 1 --2- 172.21.15.60:0/2072271637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37e0141780 0x7f37e00b4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:25.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.201+0000 7f37e63f4700 1 --2- 172.21.15.60:0/2072271637 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f37e0071a30 0x7f37e01d32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:25.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.202+0000 7f37e63f4700 1 --2- 172.21.15.60:0/2072271637 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37e00b96b0 0x7f37e0142e40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:25.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.202+0000 7f37e63f4700 1 -- 172.21.15.60:0/2072271637 >> 172.21.15.60:0/2072271637 conn(0x7f37e006d0e0 msgr2=0x7f37e013f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:25.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.202+0000 7f37e63f4700 1 -- 172.21.15.60:0/2072271637 shutdown_connections 2023-07-12T02:02:25.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.202+0000 7f37e63f4700 1 -- 172.21.15.60:0/2072271637 wait complete. 2023-07-12T02:02:25.206 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 7 2023-07-12T02:02:25.217 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:02:25.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.339+0000 7fa6a0229700 1 Processor -- start 2023-07-12T02:02:25.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.339+0000 7fa6a0229700 1 -- start start 2023-07-12T02:02:25.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.339+0000 7fa6a0229700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa6981449d0 0x7fa69814db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:25.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.340+0000 7fa6a0229700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa6980bc810 0x7fa6980ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:25.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.340+0000 7fa6a0229700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6980b8620 con 0x7fa6980b8d90 2023-07-12T02:02:25.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.340+0000 7fa6a0229700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6980b97a0 con 0x7fa6980bc810 2023-07-12T02:02:25.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.340+0000 7fa6a0229700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa698144da0 con 0x7fa6981449d0 2023-07-12T02:02:25.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.340+0000 7fa69d7c4700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa6980bc810 0x7fa6980ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:25.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.340+0000 7fa69e7c6700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa6980b8d90 0x7fa69806ade0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46182/0 (socket says 172.21.15.60:46182) 2023-07-12T02:02:25.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.340+0000 7fa69e7c6700 1 -- 172.21.15.60:0/15259218 learned_addr learned my addr 172.21.15.60:0/15259218 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:25.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.340+0000 7fa69dfc5700 1 --2- 172.21.15.60:0/15259218 >> v2:172.21.15.79:3300/0 conn(0x7fa6981449d0 0x7fa69814db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:25.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.340+0000 7fa69d7c4700 1 -- 172.21.15.60:0/15259218 >> v2:172.21.15.79:3300/0 conn(0x7fa6981449d0 msgr2=0x7fa69814db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:25.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.340+0000 7fa69d7c4700 1 --2- 172.21.15.60:0/15259218 >> v2:172.21.15.79:3300/0 conn(0x7fa6981449d0 0x7fa69814db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:25.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.340+0000 7fa69d7c4700 1 -- 172.21.15.60:0/15259218 >> v1:172.21.15.60:6789/0 conn(0x7fa6980b8d90 legacy=0x7fa69806ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:25.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.340+0000 7fa69d7c4700 1 -- 172.21.15.60:0/15259218 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6980b8900 con 0x7fa6980bc810 2023-07-12T02:02:25.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.340+0000 7fa69cfc3700 1 -- 172.21.15.60:0/15259218 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3790581099 0 0) 0x7fa6980b8620 con 0x7fa6980b8d90 2023-07-12T02:02:25.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.340+0000 7fa69d7c4700 1 --2- 172.21.15.60:0/15259218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6980bc810 0x7fa6980ba530 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa69806cbe0 tx=0x7fa688009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34016b0fc232db45 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:25.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.340+0000 7fa69cfc3700 1 -- 172.21.15.60:0/15259218 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa688011830 con 0x7fa6980bc810 2023-07-12T02:02:25.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.340+0000 7fa69cfc3700 1 -- 172.21.15.60:0/15259218 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa688011990 con 0x7fa6980bc810 2023-07-12T02:02:25.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.340+0000 7fa69cfc3700 1 -- 172.21.15.60:0/15259218 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa688011d20 con 0x7fa6980bc810 2023-07-12T02:02:25.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.341+0000 7fa6a0229700 1 -- 172.21.15.60:0/15259218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6980bc810 msgr2=0x7fa6980ba530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:25.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.341+0000 7fa6a0229700 1 --2- 172.21.15.60:0/15259218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6980bc810 0x7fa6980ba530 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa69806cbe0 tx=0x7fa688009b20 comp rx=0 tx=0).stop 2023-07-12T02:02:25.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.341+0000 7fa6a0229700 1 -- 172.21.15.60:0/15259218 shutdown_connections 2023-07-12T02:02:25.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.341+0000 7fa6a0229700 1 --2- 172.21.15.60:0/15259218 >> v2:172.21.15.79:3300/0 conn(0x7fa6981449d0 0x7fa69814db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:25.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.341+0000 7fa6a0229700 1 --2- 172.21.15.60:0/15259218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6980bc810 0x7fa6980ba530 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:25.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.341+0000 7fa6a0229700 1 -- 172.21.15.60:0/15259218 >> 172.21.15.60:0/15259218 conn(0x7fa6980c0860 msgr2=0x7fa6980c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:25.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.341+0000 7fa6a0229700 1 -- 172.21.15.60:0/15259218 shutdown_connections 2023-07-12T02:02:25.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.341+0000 7fa6a0229700 1 -- 172.21.15.60:0/15259218 wait complete. 2023-07-12T02:02:25.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.342+0000 7fa6a0229700 1 Processor -- start 2023-07-12T02:02:25.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.342+0000 7fa6a0229700 1 -- start start 2023-07-12T02:02:25.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.343+0000 7fa6a0229700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6980b8d90 0x7fa69814d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:25.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.343+0000 7fa6a0229700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6980bc810 0x7fa6980b28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:25.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.343+0000 7fa6a0229700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa6981449d0 0x7fa6980b2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:25.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.343+0000 7fa6a0229700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa69814da30 con 0x7fa6980bc810 2023-07-12T02:02:25.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.343+0000 7fa6a0229700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa69814b480 con 0x7fa6980b8d90 2023-07-12T02:02:25.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.343+0000 7fa6a0229700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6981454a0 con 0x7fa6981449d0 2023-07-12T02:02:25.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.343+0000 7fa69d7c4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6980bc810 0x7fa6980b28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:25.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.343+0000 7fa69d7c4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6980bc810 0x7fa6980b28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50910/0 (socket says 172.21.15.60:50910) 2023-07-12T02:02:25.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.343+0000 7fa69d7c4700 1 -- 172.21.15.60:0/1765497013 learned_addr learned my addr 172.21.15.60:0/1765497013 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:25.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.343+0000 7fa69dfc5700 1 --2- 172.21.15.60:0/1765497013 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6980b8d90 0x7fa69814d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:25.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.343+0000 7fa69e7c6700 1 --2- 172.21.15.60:0/1765497013 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa6981449d0 0x7fa6980b2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:25.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.343+0000 7fa69d7c4700 1 -- 172.21.15.60:0/1765497013 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa6981449d0 msgr2=0x7fa6980b2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:25.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.343+0000 7fa69d7c4700 1 --2- 172.21.15.60:0/1765497013 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa6981449d0 0x7fa6980b2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:25.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.343+0000 7fa69d7c4700 1 -- 172.21.15.60:0/1765497013 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6980b8d90 msgr2=0x7fa69814d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:25.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.343+0000 7fa69d7c4700 1 --2- 172.21.15.60:0/1765497013 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6980b8d90 0x7fa69814d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:25.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.343+0000 7fa69d7c4700 1 -- 172.21.15.60:0/1765497013 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6880094a0 con 0x7fa6980bc810 2023-07-12T02:02:25.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.343+0000 7fa69dfc5700 1 --2- 172.21.15.60:0/1765497013 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6980b8d90 0x7fa69814d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:25.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.343+0000 7fa69d7c4700 1 --2- 172.21.15.60:0/1765497013 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6980bc810 0x7fa6980b28c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa6880090b0 tx=0x7fa688004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:25.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.343+0000 7fa68e7fc700 1 -- 172.21.15.60:0/1765497013 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6880038a0 con 0x7fa6980bc810 2023-07-12T02:02:25.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.343+0000 7fa68e7fc700 1 -- 172.21.15.60:0/1765497013 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68801f070 con 0x7fa6980bc810 2023-07-12T02:02:25.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.343+0000 7fa6a0229700 1 -- 172.21.15.60:0/1765497013 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa698145780 con 0x7fa6980bc810 2023-07-12T02:02:25.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.343+0000 7fa68e7fc700 1 -- 172.21.15.60:0/1765497013 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa688003c20 con 0x7fa6980bc810 2023-07-12T02:02:25.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.344+0000 7fa6a0229700 1 -- 172.21.15.60:0/1765497013 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6980b2450 con 0x7fa6980bc810 2023-07-12T02:02:25.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.344+0000 7fa6a0229700 1 -- 172.21.15.60:0/1765497013 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6980b25e0 con 0x7fa6980bc810 2023-07-12T02:02:25.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.345+0000 7fa68e7fc700 1 -- 172.21.15.60:0/1765497013 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa68801a430 con 0x7fa6980bc810 2023-07-12T02:02:25.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.345+0000 7fa68e7fc700 1 --2- 172.21.15.60:0/1765497013 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fa67c06ace0 0x7fa67c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:25.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.345+0000 7fa68e7fc700 1 -- 172.21.15.60:0/1765497013 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa688021070 con 0x7fa6980bc810 2023-07-12T02:02:25.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.345+0000 7fa69dfc5700 1 --2- 172.21.15.60:0/1765497013 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fa67c06ace0 0x7fa67c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:25.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.346+0000 7fa69dfc5700 1 --2- 172.21.15.60:0/1765497013 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fa67c06ace0 0x7fa67c06d190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa69400ba70 tx=0x7fa694008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:25.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.350+0000 7fa68e7fc700 1 -- 172.21.15.60:0/1765497013 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fa6980b25e0 con 0x7fa6980bc810 2023-07-12T02:02:25.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.547+0000 7fa6a0229700 1 -- 172.21.15.60:0/1765497013 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6980b25e0 con 0x7fa6980bc810 2023-07-12T02:02:25.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.548+0000 7fa68e7fc700 1 -- 172.21.15.60:0/1765497013 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18173 (secure 0 0 0) 0x7fa6980b25e0 con 0x7fa6980bc810 2023-07-12T02:02:25.552 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:02:25.552 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":21,"fsid":"97e7c909-e567-472e-a5aa-72fde15171f2","created":"2023-07-12T02:01:53.987086+0000","modified":"2023-07-12T02:02:14.307912+0000","last_up_change":"2023-07-12T02:02:04.031780+0000","last_in_change":"2023-07-12T02:01:56.538621+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-12T02:02:05.375042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-12T02:02:05.857441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:02:10.574633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-12T02:02:11.699872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ed8b71c2-3895-4952-a118-16ede0b4a98c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6801","nonce":2818935979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6803","nonce":2818935979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6807","nonce":2818935979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6805","nonce":2818935979}]},"public_addr":"172.21.15.60:6801/2818935979","cluster_addr":"172.21.15.60:6803/2818935979","heartbeat_back_addr":"172.21.15.60:6807/2818935979","heartbeat_front_addr":"172.21.15.60:6805/2818935979","state":["exists","up"]},{"osd":1,"uuid":"7cf4d354-78e0-43ce-8c09-4a7d2a0b57a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6817","nonce":1678864191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6819","nonce":1678864191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6823","nonce":1678864191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6821","nonce":1678864191}]},"public_addr":"172.21.15.60:6817/1678864191","cluster_addr":"172.21.15.60:6819/1678864191","heartbeat_back_addr":"172.21.15.60:6823/1678864191","heartbeat_front_addr":"172.21.15.60:6821/1678864191","state":["exists","up"]},{"osd":2,"uuid":"02c958b8-9599-4470-92cb-8f7018ec0189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6809","nonce":1459480680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6811","nonce":1459480680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6815","nonce":1459480680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6813","nonce":1459480680}]},"public_addr":"172.21.15.60:6809/1459480680","cluster_addr":"172.21.15.60:6811/1459480680","heartbeat_back_addr":"172.21.15.60:6815/1459480680","heartbeat_front_addr":"172.21.15.60:6813/1459480680","state":["exists","up"]},{"osd":3,"uuid":"bc300432-a228-4257-be5c-e42dd5f2015f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6825","nonce":3295100060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6827","nonce":3295100060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6831","nonce":3295100060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6829","nonce":3295100060}]},"public_addr":"172.21.15.60:6825/3295100060","cluster_addr":"172.21.15.60:6827/3295100060","heartbeat_back_addr":"172.21.15.60:6831/3295100060","heartbeat_front_addr":"172.21.15.60:6829/3295100060","state":["exists","up"]},{"osd":4,"uuid":"ad9f7dc4-7126-466d-a656-2844880c6060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6809","nonce":4127109138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6811","nonce":4127109138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6815","nonce":4127109138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6813","nonce":4127109138}]},"public_addr":"172.21.15.79:6809/4127109138","cluster_addr":"172.21.15.79:6811/4127109138","heartbeat_back_addr":"172.21.15.79:6815/4127109138","heartbeat_front_addr":"172.21.15.79:6813/4127109138","state":["exists","up"]},{"osd":5,"uuid":"e88d16ca-0b01-4ab9-8aa8-c4aff7f210f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6801","nonce":421449406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6803","nonce":421449406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6807","nonce":421449406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6805","nonce":421449406}]},"public_addr":"172.21.15.79:6801/421449406","cluster_addr":"172.21.15.79:6803/421449406","heartbeat_back_addr":"172.21.15.79:6807/421449406","heartbeat_front_addr":"172.21.15.79:6805/421449406","state":["exists","up"]},{"osd":6,"uuid":"6898cb84-56d1-48a9-bd45-97e4668e2fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6825","nonce":4144355139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6827","nonce":4144355139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6831","nonce":4144355139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6829","nonce":4144355139}]},"public_addr":"172.21.15.79:6825/4144355139","cluster_addr":"172.21.15.79:6827/4144355139","heartbeat_back_addr":"172.21.15.79:6831/4144355139","heartbeat_front_addr":"172.21.15.79:6829/4144355139","state":["exists","up"]},{"osd":7,"uuid":"65c10882-371e-4762-b384-9c3a48f332ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6817","nonce":2845223299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6819","nonce":2845223299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6823","nonce":2845223299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6821","nonce":2845223299}]},"public_addr":"172.21.15.79:6817/2845223299","cluster_addr":"172.21.15.79:6819/2845223299","heartbeat_back_addr":"172.21.15.79:6823/2845223299","heartbeat_front_addr":"172.21.15.79:6821/2845223299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.634716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.758349+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.728366+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.777395+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707262+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.649705+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.693021+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:02:25.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.551+0000 7fa6a0229700 1 -- 172.21.15.60:0/1765497013 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fa67c06ace0 msgr2=0x7fa67c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:25.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.551+0000 7fa6a0229700 1 --2- 172.21.15.60:0/1765497013 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fa67c06ace0 0x7fa67c06d190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa69400ba70 tx=0x7fa694008040 comp rx=0 tx=0).stop 2023-07-12T02:02:25.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.551+0000 7fa6a0229700 1 -- 172.21.15.60:0/1765497013 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6980bc810 msgr2=0x7fa6980b28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:25.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.551+0000 7fa6a0229700 1 --2- 172.21.15.60:0/1765497013 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6980bc810 0x7fa6980b28c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa6880090b0 tx=0x7fa688004750 comp rx=0 tx=0).stop 2023-07-12T02:02:25.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.551+0000 7fa6a0229700 1 -- 172.21.15.60:0/1765497013 shutdown_connections 2023-07-12T02:02:25.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.551+0000 7fa6a0229700 1 --2- 172.21.15.60:0/1765497013 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fa67c06ace0 0x7fa67c06d190 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:25.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.551+0000 7fa6a0229700 1 --2- 172.21.15.60:0/1765497013 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa6981449d0 0x7fa6980b2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:25.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.551+0000 7fa6a0229700 1 --2- 172.21.15.60:0/1765497013 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6980b8d90 0x7fa69814d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:25.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.551+0000 7fa6a0229700 1 --2- 172.21.15.60:0/1765497013 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6980bc810 0x7fa6980b28c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:25.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.551+0000 7fa6a0229700 1 -- 172.21.15.60:0/1765497013 >> 172.21.15.60:0/1765497013 conn(0x7fa6980c0860 msgr2=0x7fa6980baeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:25.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.551+0000 7fa6a0229700 1 -- 172.21.15.60:0/1765497013 shutdown_connections 2023-07-12T02:02:25.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.551+0000 7fa6a0229700 1 -- 172.21.15.60:0/1765497013 wait complete. 2023-07-12T02:02:25.566 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-12T02:02:05.375042+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-12T02:02:05.857441+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-12T02:02:10.574633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-12T02:02:11.699872+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-12T02:02:25.567 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-12T02:02:25.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.691+0000 7f3a3de2d700 1 Processor -- start 2023-07-12T02:02:25.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.691+0000 7f3a3de2d700 1 -- start start 2023-07-12T02:02:25.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.692+0000 7f3a3de2d700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a38070da0 0x7f3a3806c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:25.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.692+0000 7f3a3de2d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3a3806cd00 0x7f3a381551e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:25.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.692+0000 7f3a3de2d700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a38070130 con 0x7f3a38071910 2023-07-12T02:02:25.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.692+0000 7f3a3de2d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a38071540 con 0x7f3a3806cd00 2023-07-12T02:02:25.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.692+0000 7f3a3de2d700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a38071260 con 0x7f3a38070da0 2023-07-12T02:02:25.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.692+0000 7f3a37fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3a3806cd00 0x7f3a381551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:25.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.692+0000 7f3a37fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3a3806cd00 0x7f3a381551e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50912/0 (socket says 172.21.15.60:50912) 2023-07-12T02:02:25.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.692+0000 7f3a37fff700 1 -- 172.21.15.60:0/3283492737 learned_addr learned my addr 172.21.15.60:0/3283492737 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:25.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.692+0000 7f3a36ffd700 1 --2- 172.21.15.60:0/3283492737 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a38070da0 0x7f3a3806c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:25.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.693+0000 7f3a37fff700 1 -- 172.21.15.60:0/3283492737 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a38070da0 msgr2=0x7f3a3806c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:25.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.693+0000 7f3a37fff700 1 --2- 172.21.15.60:0/3283492737 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a38070da0 0x7f3a3806c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:25.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.693+0000 7f3a37fff700 1 -- 172.21.15.60:0/3283492737 >> v1:172.21.15.79:6789/0 conn(0x7f3a38071910 legacy=0x7f3a3814b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:25.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.693+0000 7f3a37fff700 1 -- 172.21.15.60:0/3283492737 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a3814aa60 con 0x7f3a3806cd00 2023-07-12T02:02:25.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.693+0000 7f3a37fff700 1 --2- 172.21.15.60:0/3283492737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a3806cd00 0x7f3a381551e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3a30009e50 tx=0x7f3a3000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e739e941791db0c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:25.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.693+0000 7f3a367fc700 1 -- 172.21.15.60:0/3283492737 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3000e070 con 0x7f3a3806cd00 2023-07-12T02:02:25.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.693+0000 7f3a367fc700 1 -- 172.21.15.60:0/3283492737 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3000b910 con 0x7f3a3806cd00 2023-07-12T02:02:25.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.693+0000 7f3a367fc700 1 -- 172.21.15.60:0/3283492737 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3000bcc0 con 0x7f3a3806cd00 2023-07-12T02:02:25.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.693+0000 7f3a3de2d700 1 -- 172.21.15.60:0/3283492737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a3806cd00 msgr2=0x7f3a381551e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:25.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.693+0000 7f3a3de2d700 1 --2- 172.21.15.60:0/3283492737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a3806cd00 0x7f3a381551e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3a30009e50 tx=0x7f3a3000b330 comp rx=0 tx=0).stop 2023-07-12T02:02:25.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.693+0000 7f3a3de2d700 1 -- 172.21.15.60:0/3283492737 shutdown_connections 2023-07-12T02:02:25.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.693+0000 7f3a3de2d700 1 --2- 172.21.15.60:0/3283492737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a3806cd00 0x7f3a381551e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:25.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.693+0000 7f3a3de2d700 1 --2- 172.21.15.60:0/3283492737 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a38070da0 0x7f3a3806c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:25.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.693+0000 7f3a3de2d700 1 -- 172.21.15.60:0/3283492737 >> 172.21.15.60:0/3283492737 conn(0x7f3a380be670 msgr2=0x7f3a380bea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:25.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.694+0000 7f3a3de2d700 1 -- 172.21.15.60:0/3283492737 shutdown_connections 2023-07-12T02:02:25.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.694+0000 7f3a3de2d700 1 -- 172.21.15.60:0/3283492737 wait complete. 2023-07-12T02:02:25.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.695+0000 7f3a3de2d700 1 Processor -- start 2023-07-12T02:02:25.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.695+0000 7f3a3de2d700 1 -- start start 2023-07-12T02:02:25.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.695+0000 7f3a3de2d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a3806cd00 0x7f3a38140250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:25.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.695+0000 7f3a3de2d700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a38070da0 0x7f3a38140de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:25.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.695+0000 7f3a3de2d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a38071910 0x7f3a3813c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:25.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.695+0000 7f3a3de2d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a38140790 con 0x7f3a38071910 2023-07-12T02:02:25.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.695+0000 7f3a3de2d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3813f770 con 0x7f3a3806cd00 2023-07-12T02:02:25.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.695+0000 7f3a3de2d700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3813fa50 con 0x7f3a38070da0 2023-07-12T02:02:25.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.695+0000 7f3a37fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a38071910 0x7f3a3813c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:25.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.695+0000 7f3a37fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a38071910 0x7f3a3813c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50926/0 (socket says 172.21.15.60:50926) 2023-07-12T02:02:25.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.696+0000 7f3a37fff700 1 -- 172.21.15.60:0/2430643693 learned_addr learned my addr 172.21.15.60:0/2430643693 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:25.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.696+0000 7f3a377fe700 1 --2- 172.21.15.60:0/2430643693 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a3806cd00 0x7f3a38140250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:25.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.696+0000 7f3a36ffd700 1 --2- 172.21.15.60:0/2430643693 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a38070da0 0x7f3a38140de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:25.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.696+0000 7f3a37fff700 1 -- 172.21.15.60:0/2430643693 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a38070da0 msgr2=0x7f3a38140de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:25.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.696+0000 7f3a37fff700 1 --2- 172.21.15.60:0/2430643693 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a38070da0 0x7f3a38140de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:25.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.696+0000 7f3a37fff700 1 -- 172.21.15.60:0/2430643693 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a3806cd00 msgr2=0x7f3a38140250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:25.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.696+0000 7f3a37fff700 1 --2- 172.21.15.60:0/2430643693 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a3806cd00 0x7f3a38140250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:25.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.696+0000 7f3a37fff700 1 -- 172.21.15.60:0/2430643693 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a30009b30 con 0x7f3a38071910 2023-07-12T02:02:25.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.696+0000 7f3a36ffd700 1 --2- 172.21.15.60:0/2430643693 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a38070da0 0x7f3a38140de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:25.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.696+0000 7f3a37fff700 1 --2- 172.21.15.60:0/2430643693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a38071910 0x7f3a3813c7d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3a30012000 tx=0x7f3a30004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:25.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.696+0000 7f3a2ffff700 1 -- 172.21.15.60:0/2430643693 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a300048b0 con 0x7f3a38071910 2023-07-12T02:02:25.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.696+0000 7f3a2ffff700 1 -- 172.21.15.60:0/2430643693 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a300092e0 con 0x7f3a38071910 2023-07-12T02:02:25.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.696+0000 7f3a3de2d700 1 -- 172.21.15.60:0/2430643693 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a3813fd30 con 0x7f3a38071910 2023-07-12T02:02:25.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.696+0000 7f3a2ffff700 1 -- 172.21.15.60:0/2430643693 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3001c660 con 0x7f3a38071910 2023-07-12T02:02:25.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.696+0000 7f3a3de2d700 1 -- 172.21.15.60:0/2430643693 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a3813ea00 con 0x7f3a38071910 2023-07-12T02:02:25.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.697+0000 7f3a3de2d700 1 -- 172.21.15.60:0/2430643693 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a3813ff20 con 0x7f3a38071910 2023-07-12T02:02:25.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.698+0000 7f3a2ffff700 1 -- 172.21.15.60:0/2430643693 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3a3001c7c0 con 0x7f3a38071910 2023-07-12T02:02:25.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.698+0000 7f3a2ffff700 1 --2- 172.21.15.60:0/2430643693 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f3a1806ace0 0x7f3a1806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:25.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.698+0000 7f3a2ffff700 1 -- 172.21.15.60:0/2430643693 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3a3008ad30 con 0x7f3a38071910 2023-07-12T02:02:25.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.698+0000 7f3a377fe700 1 --2- 172.21.15.60:0/2430643693 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f3a1806ace0 0x7f3a1806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:25.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.699+0000 7f3a377fe700 1 --2- 172.21.15.60:0/2430643693 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f3a1806ace0 0x7f3a1806d190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3a28007fd0 tx=0x7f3a28009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:25.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.702+0000 7f3a2ffff700 1 -- 172.21.15.60:0/2430643693 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f3a30055de0 con 0x7f3a38071910 2023-07-12T02:02:25.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.894+0000 7f3a3de2d700 1 -- 172.21.15.60:0/2430643693 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3a38074360 con 0x7f3a38071910 2023-07-12T02:02:25.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.895+0000 7f3a2ffff700 1 -- 172.21.15.60:0/2430643693 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3a30059400 con 0x7f3a38071910 2023-07-12T02:02:25.898 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2023-07-12T02:02:25.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.897+0000 7f3a3de2d700 1 -- 172.21.15.60:0/2430643693 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f3a1806ace0 msgr2=0x7f3a1806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:25.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.897+0000 7f3a3de2d700 1 --2- 172.21.15.60:0/2430643693 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f3a1806ace0 0x7f3a1806d190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3a28007fd0 tx=0x7f3a28009040 comp rx=0 tx=0).stop 2023-07-12T02:02:25.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.897+0000 7f3a3de2d700 1 -- 172.21.15.60:0/2430643693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a38071910 msgr2=0x7f3a3813c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:25.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.897+0000 7f3a3de2d700 1 --2- 172.21.15.60:0/2430643693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a38071910 0x7f3a3813c7d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3a30012000 tx=0x7f3a30004ad0 comp rx=0 tx=0).stop 2023-07-12T02:02:25.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.897+0000 7f3a3de2d700 1 -- 172.21.15.60:0/2430643693 shutdown_connections 2023-07-12T02:02:25.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.897+0000 7f3a3de2d700 1 --2- 172.21.15.60:0/2430643693 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f3a1806ace0 0x7f3a1806d190 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:25.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.897+0000 7f3a3de2d700 1 --2- 172.21.15.60:0/2430643693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a38071910 0x7f3a3813c7d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:25.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.897+0000 7f3a3de2d700 1 --2- 172.21.15.60:0/2430643693 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a3806cd00 0x7f3a38140250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:25.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.897+0000 7f3a3de2d700 1 --2- 172.21.15.60:0/2430643693 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3a38070da0 0x7f3a38140de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:25.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.897+0000 7f3a3de2d700 1 -- 172.21.15.60:0/2430643693 >> 172.21.15.60:0/2430643693 conn(0x7f3a380be670 msgr2=0x7f3a380b8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:25.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.897+0000 7f3a3de2d700 1 -- 172.21.15.60:0/2430643693 shutdown_connections 2023-07-12T02:02:25.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:25.897+0000 7f3a3de2d700 1 -- 172.21.15.60:0/2430643693 wait complete. 2023-07-12T02:02:25.912 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-12T02:02:26.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.037+0000 7f1199c5b700 1 Processor -- start 2023-07-12T02:02:26.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.037+0000 7f1199c5b700 1 -- start start 2023-07-12T02:02:26.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.038+0000 7f1199c5b700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f11940bc810 0x7f11940ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:26.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.038+0000 7f1199c5b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f11940b8d90 0x7f119406ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:26.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.038+0000 7f1199c5b700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11940b8620 con 0x7f11941449d0 2023-07-12T02:02:26.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.038+0000 7f1199c5b700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11940b97a0 con 0x7f11940b8d90 2023-07-12T02:02:26.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.038+0000 7f1199c5b700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1194144da0 con 0x7f11940bc810 2023-07-12T02:02:26.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.038+0000 7f1192ffd700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f11940bc810 0x7f11940ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:26.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.038+0000 7f1193fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f11940b8d90 0x7f119406ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:26.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.038+0000 7f11937fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f11941449d0 0x7f119414db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.60:58100/0 (socket says 172.21.15.60:58100) 2023-07-12T02:02:26.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.038+0000 7f11937fe700 1 -- 172.21.15.60:0/390903510 learned_addr learned my addr 172.21.15.60:0/390903510 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:26.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.038+0000 7f11927fc700 1 -- 172.21.15.60:0/390903510 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1281496877 0 0) 0x7f11940b8620 con 0x7f11941449d0 2023-07-12T02:02:26.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.038+0000 7f11927fc700 1 -- 172.21.15.60:0/390903510 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f117c0035b0 con 0x7f11941449d0 2023-07-12T02:02:26.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.039+0000 7f1192ffd700 1 -- 172.21.15.60:0/390903510 >> v2:172.21.15.79:3300/0 conn(0x7f11940b8d90 msgr2=0x7f119406ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:26.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.039+0000 7f1192ffd700 1 --2- 172.21.15.60:0/390903510 >> v2:172.21.15.79:3300/0 conn(0x7f11940b8d90 0x7f119406ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:26.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.039+0000 7f1192ffd700 1 -- 172.21.15.60:0/390903510 >> v1:172.21.15.79:6789/0 conn(0x7f11941449d0 legacy=0x7f119414db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:26.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.039+0000 7f1192ffd700 1 -- 172.21.15.60:0/390903510 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11940b8900 con 0x7f11940bc810 2023-07-12T02:02:26.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.039+0000 7f1193fff700 1 --2- 172.21.15.60:0/390903510 >> v2:172.21.15.79:3300/0 conn(0x7f11940b8d90 0x7f119406ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:02:26.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.039+0000 7f1192ffd700 1 --2- 172.21.15.60:0/390903510 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f11940bc810 0x7f11940ba530 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1188009840 tx=0x7f1188009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=568c8911eec53494 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:26.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.039+0000 7f11927fc700 1 -- 172.21.15.60:0/390903510 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1188011830 con 0x7f11940bc810 2023-07-12T02:02:26.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.039+0000 7f11927fc700 1 -- 172.21.15.60:0/390903510 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1188011990 con 0x7f11940bc810 2023-07-12T02:02:26.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.039+0000 7f11927fc700 1 -- 172.21.15.60:0/390903510 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1188011d20 con 0x7f11940bc810 2023-07-12T02:02:26.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.039+0000 7f1199c5b700 1 -- 172.21.15.60:0/390903510 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f11940bc810 msgr2=0x7f11940ba530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:26.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.039+0000 7f1199c5b700 1 --2- 172.21.15.60:0/390903510 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f11940bc810 0x7f11940ba530 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1188009840 tx=0x7f1188009b50 comp rx=0 tx=0).stop 2023-07-12T02:02:26.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.040+0000 7f1199c5b700 1 -- 172.21.15.60:0/390903510 shutdown_connections 2023-07-12T02:02:26.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.040+0000 7f1199c5b700 1 --2- 172.21.15.60:0/390903510 >> v2:172.21.15.79:3300/0 conn(0x7f11940b8d90 0x7f119406ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:26.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.040+0000 7f1199c5b700 1 --2- 172.21.15.60:0/390903510 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f11940bc810 0x7f11940ba530 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:26.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.040+0000 7f1199c5b700 1 -- 172.21.15.60:0/390903510 >> 172.21.15.60:0/390903510 conn(0x7f11940c0860 msgr2=0x7f11940c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:26.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.040+0000 7f1199c5b700 1 -- 172.21.15.60:0/390903510 shutdown_connections 2023-07-12T02:02:26.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.040+0000 7f1199c5b700 1 -- 172.21.15.60:0/390903510 wait complete. 2023-07-12T02:02:26.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.041+0000 7f1199c5b700 1 Processor -- start 2023-07-12T02:02:26.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.041+0000 7f1199c5b700 1 -- start start 2023-07-12T02:02:26.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.041+0000 7f1199c5b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11940b8d90 0x7f1194147330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:26.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.041+0000 7f1199c5b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11940bc810 0x7f11940b4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:26.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.041+0000 7f1199c5b700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f11941449d0 0x7f11941d3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:26.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.041+0000 7f1199c5b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1194147870 con 0x7f11940b8d90 2023-07-12T02:02:26.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.041+0000 7f1199c5b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11941d43b0 con 0x7f11940bc810 2023-07-12T02:02:26.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.041+0000 7f1199c5b700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1194143fe0 con 0x7f11941449d0 2023-07-12T02:02:26.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.042+0000 7f11937fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11940b8d90 0x7f1194147330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:26.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.042+0000 7f11937fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11940b8d90 0x7f1194147330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50928/0 (socket says 172.21.15.60:50928) 2023-07-12T02:02:26.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.042+0000 7f11937fe700 1 -- 172.21.15.60:0/2811186777 learned_addr learned my addr 172.21.15.60:0/2811186777 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:26.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.042+0000 7f1192ffd700 1 --2- 172.21.15.60:0/2811186777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11940bc810 0x7f11940b4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:26.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.042+0000 7f1193fff700 1 --2- 172.21.15.60:0/2811186777 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f11941449d0 0x7f11941d3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:26.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.042+0000 7f11937fe700 1 -- 172.21.15.60:0/2811186777 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f11941449d0 msgr2=0x7f11941d3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:26.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.042+0000 7f11937fe700 1 --2- 172.21.15.60:0/2811186777 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f11941449d0 0x7f11941d3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:26.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.042+0000 7f11937fe700 1 -- 172.21.15.60:0/2811186777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11940bc810 msgr2=0x7f11940b4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:26.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.042+0000 7f11937fe700 1 --2- 172.21.15.60:0/2811186777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11940bc810 0x7f11940b4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:26.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.042+0000 7f11937fe700 1 -- 172.21.15.60:0/2811186777 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f118c009a70 con 0x7f11940b8d90 2023-07-12T02:02:26.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.042+0000 7f11937fe700 1 --2- 172.21.15.60:0/2811186777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11940b8d90 0x7f1194147330 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1184001eb0 tx=0x7f118400c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:26.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.042+0000 7f117bfff700 1 -- 172.21.15.60:0/2811186777 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118400cea0 con 0x7f11940b8d90 2023-07-12T02:02:26.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.042+0000 7f117bfff700 1 -- 172.21.15.60:0/2811186777 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1184005d70 con 0x7f11940b8d90 2023-07-12T02:02:26.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.042+0000 7f1199c5b700 1 -- 172.21.15.60:0/2811186777 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11880094a0 con 0x7f11940b8d90 2023-07-12T02:02:26.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.042+0000 7f117bfff700 1 -- 172.21.15.60:0/2811186777 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11840072f0 con 0x7f11940b8d90 2023-07-12T02:02:26.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.042+0000 7f1199c5b700 1 -- 172.21.15.60:0/2811186777 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11940b67f0 con 0x7f11940b8d90 2023-07-12T02:02:26.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.043+0000 7f1199c5b700 1 -- 172.21.15.60:0/2811186777 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1194074360 con 0x7f11940b8d90 2023-07-12T02:02:26.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.044+0000 7f117bfff700 1 -- 172.21.15.60:0/2811186777 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1184007450 con 0x7f11940b8d90 2023-07-12T02:02:26.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.044+0000 7f117bfff700 1 --2- 172.21.15.60:0/2811186777 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f118006ace0 0x7f118006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:26.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.044+0000 7f117bfff700 1 -- 172.21.15.60:0/2811186777 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f11840887e0 con 0x7f11940b8d90 2023-07-12T02:02:26.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.044+0000 7f1192ffd700 1 --2- 172.21.15.60:0/2811186777 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f118006ace0 0x7f118006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:26.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.045+0000 7f1192ffd700 1 --2- 172.21.15.60:0/2811186777 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f118006ace0 0x7f118006d190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1188000c00 tx=0x7f1188008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:26.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.048+0000 7f117bfff700 1 -- 172.21.15.60:0/2811186777 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f1184053920 con 0x7f11940b8d90 2023-07-12T02:02:26.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.244+0000 7f1199c5b700 1 -- 172.21.15.60:0/2811186777 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f11940bc330 con 0x7f11940b8d90 2023-07-12T02:02:26.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.244+0000 7f117bfff700 1 -- 172.21.15.60:0/2811186777 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1184056f40 con 0x7f11940b8d90 2023-07-12T02:02:26.247 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-07-12T02:02:26.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.246+0000 7f1199c5b700 1 -- 172.21.15.60:0/2811186777 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f118006ace0 msgr2=0x7f118006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:26.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.246+0000 7f1199c5b700 1 --2- 172.21.15.60:0/2811186777 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f118006ace0 0x7f118006d190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1188000c00 tx=0x7f1188008030 comp rx=0 tx=0).stop 2023-07-12T02:02:26.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.246+0000 7f1199c5b700 1 -- 172.21.15.60:0/2811186777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11940b8d90 msgr2=0x7f1194147330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:26.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.246+0000 7f1199c5b700 1 --2- 172.21.15.60:0/2811186777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11940b8d90 0x7f1194147330 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1184001eb0 tx=0x7f118400c7b0 comp rx=0 tx=0).stop 2023-07-12T02:02:26.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.246+0000 7f1199c5b700 1 -- 172.21.15.60:0/2811186777 shutdown_connections 2023-07-12T02:02:26.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.246+0000 7f1199c5b700 1 --2- 172.21.15.60:0/2811186777 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f118006ace0 0x7f118006d190 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:26.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.246+0000 7f1199c5b700 1 --2- 172.21.15.60:0/2811186777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11940b8d90 0x7f1194147330 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:26.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.246+0000 7f1199c5b700 1 --2- 172.21.15.60:0/2811186777 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f11941449d0 0x7f11941d3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:26.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.246+0000 7f1199c5b700 1 --2- 172.21.15.60:0/2811186777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11940bc810 0x7f11940b4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:26.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.246+0000 7f1199c5b700 1 -- 172.21.15.60:0/2811186777 >> 172.21.15.60:0/2811186777 conn(0x7f11940c0860 msgr2=0x7f11940baeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:26.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.246+0000 7f1199c5b700 1 -- 172.21.15.60:0/2811186777 shutdown_connections 2023-07-12T02:02:26.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.246+0000 7f1199c5b700 1 -- 172.21.15.60:0/2811186777 wait complete. 2023-07-12T02:02:26.261 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-12T02:02:26.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.386+0000 7fc0adc8a700 1 Processor -- start 2023-07-12T02:02:26.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.386+0000 7fc0adc8a700 1 -- start start 2023-07-12T02:02:26.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.387+0000 7fc0adc8a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc0a81449d0 0x7fc0a814db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:26.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.387+0000 7fc0adc8a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc0a80b8d90 0x7fc0a806ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:26.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.387+0000 7fc0adc8a700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a80b8620 con 0x7fc0a80bc810 2023-07-12T02:02:26.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.387+0000 7fc0adc8a700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a80b97a0 con 0x7fc0a80b8d90 2023-07-12T02:02:26.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.387+0000 7fc0adc8a700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a8144da0 con 0x7fc0a81449d0 2023-07-12T02:02:26.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.387+0000 7fc0a7fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc0a80b8d90 0x7fc0a806ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:26.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.387+0000 7fc0a7fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc0a80b8d90 0x7fc0a806ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50938/0 (socket says 172.21.15.60:50938) 2023-07-12T02:02:26.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.387+0000 7fc0a7fff700 1 -- 172.21.15.60:0/1895581755 learned_addr learned my addr 172.21.15.60:0/1895581755 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:26.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.387+0000 7fc0a77fe700 1 --2- 172.21.15.60:0/1895581755 >> v2:172.21.15.79:3300/0 conn(0x7fc0a81449d0 0x7fc0a814db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:26.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.387+0000 7fc0a7fff700 1 -- 172.21.15.60:0/1895581755 >> v2:172.21.15.79:3300/0 conn(0x7fc0a81449d0 msgr2=0x7fc0a814db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:26.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.387+0000 7fc0a7fff700 1 --2- 172.21.15.60:0/1895581755 >> v2:172.21.15.79:3300/0 conn(0x7fc0a81449d0 0x7fc0a814db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:26.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.387+0000 7fc0a7fff700 1 -- 172.21.15.60:0/1895581755 >> v1:172.21.15.79:6789/0 conn(0x7fc0a80bc810 legacy=0x7fc0a80ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:26.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.387+0000 7fc0a7fff700 1 -- 172.21.15.60:0/1895581755 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a80b8900 con 0x7fc0a80b8d90 2023-07-12T02:02:26.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.388+0000 7fc0a7fff700 1 --2- 172.21.15.60:0/1895581755 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0a80b8d90 0x7fc0a806ade0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc0a806cbe0 tx=0x7fc098009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6273a019a094726 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:26.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.388+0000 7fc0a67fc700 1 -- 172.21.15.60:0/1895581755 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc098011830 con 0x7fc0a80b8d90 2023-07-12T02:02:26.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.388+0000 7fc0a67fc700 1 -- 172.21.15.60:0/1895581755 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc098011990 con 0x7fc0a80b8d90 2023-07-12T02:02:26.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.388+0000 7fc0a67fc700 1 -- 172.21.15.60:0/1895581755 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc098011d20 con 0x7fc0a80b8d90 2023-07-12T02:02:26.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.388+0000 7fc0adc8a700 1 -- 172.21.15.60:0/1895581755 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0a80b8d90 msgr2=0x7fc0a806ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:26.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.388+0000 7fc0adc8a700 1 --2- 172.21.15.60:0/1895581755 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0a80b8d90 0x7fc0a806ade0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc0a806cbe0 tx=0x7fc098009bd0 comp rx=0 tx=0).stop 2023-07-12T02:02:26.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.388+0000 7fc0adc8a700 1 -- 172.21.15.60:0/1895581755 shutdown_connections 2023-07-12T02:02:26.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.388+0000 7fc0adc8a700 1 --2- 172.21.15.60:0/1895581755 >> v2:172.21.15.79:3300/0 conn(0x7fc0a81449d0 0x7fc0a814db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:26.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.388+0000 7fc0adc8a700 1 --2- 172.21.15.60:0/1895581755 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0a80b8d90 0x7fc0a806ade0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:26.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.388+0000 7fc0adc8a700 1 -- 172.21.15.60:0/1895581755 >> 172.21.15.60:0/1895581755 conn(0x7fc0a80c0860 msgr2=0x7fc0a80c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:26.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.388+0000 7fc0adc8a700 1 -- 172.21.15.60:0/1895581755 shutdown_connections 2023-07-12T02:02:26.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.388+0000 7fc0adc8a700 1 -- 172.21.15.60:0/1895581755 wait complete. 2023-07-12T02:02:26.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.390+0000 7fc0adc8a700 1 Processor -- start 2023-07-12T02:02:26.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.390+0000 7fc0adc8a700 1 -- start start 2023-07-12T02:02:26.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.390+0000 7fc0adc8a700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc0a80b8d90 0x7fc0a80b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:26.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.390+0000 7fc0adc8a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0a80bc810 0x7fc0a8146ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:26.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.390+0000 7fc0adc8a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0a81449d0 0x7fc0a81471e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:26.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.390+0000 7fc0adc8a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a80be730 con 0x7fc0a80bc810 2023-07-12T02:02:26.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.390+0000 7fc0adc8a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a81d6440 con 0x7fc0a81449d0 2023-07-12T02:02:26.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.390+0000 7fc0adc8a700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a814b420 con 0x7fc0a80b8d90 2023-07-12T02:02:26.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.391+0000 7fc0a6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0a80bc810 0x7fc0a8146ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:26.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.391+0000 7fc0a6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0a80bc810 0x7fc0a8146ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50954/0 (socket says 172.21.15.60:50954) 2023-07-12T02:02:26.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.391+0000 7fc0a6ffd700 1 -- 172.21.15.60:0/478010308 learned_addr learned my addr 172.21.15.60:0/478010308 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:26.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.391+0000 7fc0a7fff700 1 --2- 172.21.15.60:0/478010308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0a81449d0 0x7fc0a81471e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:26.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.391+0000 7fc0a77fe700 1 --2- 172.21.15.60:0/478010308 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc0a80b8d90 0x7fc0a80b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:26.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.391+0000 7fc0a6ffd700 1 -- 172.21.15.60:0/478010308 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc0a80b8d90 msgr2=0x7fc0a80b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:26.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.391+0000 7fc0a6ffd700 1 --2- 172.21.15.60:0/478010308 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc0a80b8d90 0x7fc0a80b3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:26.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.391+0000 7fc0a6ffd700 1 -- 172.21.15.60:0/478010308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0a81449d0 msgr2=0x7fc0a81471e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:26.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.391+0000 7fc0a6ffd700 1 --2- 172.21.15.60:0/478010308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0a81449d0 0x7fc0a81471e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:26.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.391+0000 7fc0a6ffd700 1 -- 172.21.15.60:0/478010308 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc098009550 con 0x7fc0a80bc810 2023-07-12T02:02:26.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.391+0000 7fc0a77fe700 1 --2- 172.21.15.60:0/478010308 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc0a80b8d90 0x7fc0a80b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:02:26.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.391+0000 7fc0a7fff700 1 --2- 172.21.15.60:0/478010308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0a81449d0 0x7fc0a81471e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:02:26.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.391+0000 7fc0a6ffd700 1 --2- 172.21.15.60:0/478010308 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0a80bc810 0x7fc0a8146ca0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc09000c4e0 tx=0x7fc09000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:26.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.391+0000 7fc09ffff700 1 -- 172.21.15.60:0/478010308 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0900052d0 con 0x7fc0a80bc810 2023-07-12T02:02:26.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.391+0000 7fc09ffff700 1 -- 172.21.15.60:0/478010308 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc090005430 con 0x7fc0a80bc810 2023-07-12T02:02:26.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.391+0000 7fc0adc8a700 1 -- 172.21.15.60:0/478010308 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a80b44a0 con 0x7fc0a80bc810 2023-07-12T02:02:26.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.391+0000 7fc09ffff700 1 -- 172.21.15.60:0/478010308 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0900038c0 con 0x7fc0a80bc810 2023-07-12T02:02:26.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.391+0000 7fc0adc8a700 1 -- 172.21.15.60:0/478010308 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a80bb5c0 con 0x7fc0a80bc810 2023-07-12T02:02:26.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.392+0000 7fc0adc8a700 1 -- 172.21.15.60:0/478010308 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0a81d65b0 con 0x7fc0a80bc810 2023-07-12T02:02:26.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.393+0000 7fc09ffff700 1 -- 172.21.15.60:0/478010308 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc090003a20 con 0x7fc0a80bc810 2023-07-12T02:02:26.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.393+0000 7fc09ffff700 1 --2- 172.21.15.60:0/478010308 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc08806ace0 0x7fc08806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:26.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.393+0000 7fc09ffff700 1 -- 172.21.15.60:0/478010308 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc090088900 con 0x7fc0a80bc810 2023-07-12T02:02:26.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.393+0000 7fc0a77fe700 1 --2- 172.21.15.60:0/478010308 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc08806ace0 0x7fc08806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:26.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.394+0000 7fc0a77fe700 1 --2- 172.21.15.60:0/478010308 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc08806ace0 0x7fc08806d190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0007440 tx=0x7fc0a000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:26.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.397+0000 7fc09ffff700 1 -- 172.21.15.60:0/478010308 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fc090053a40 con 0x7fc0a80bc810 2023-07-12T02:02:26.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.593+0000 7fc0adc8a700 1 -- 172.21.15.60:0/478010308 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc0a8074360 con 0x7fc0a80bc810 2023-07-12T02:02:26.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.594+0000 7fc09ffff700 1 -- 172.21.15.60:0/478010308 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc090057060 con 0x7fc0a80bc810 2023-07-12T02:02:26.597 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-07-12T02:02:26.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.596+0000 7fc0adc8a700 1 -- 172.21.15.60:0/478010308 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc08806ace0 msgr2=0x7fc08806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:26.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.596+0000 7fc0adc8a700 1 --2- 172.21.15.60:0/478010308 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc08806ace0 0x7fc08806d190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0007440 tx=0x7fc0a000b040 comp rx=0 tx=0).stop 2023-07-12T02:02:26.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.596+0000 7fc0adc8a700 1 -- 172.21.15.60:0/478010308 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0a80bc810 msgr2=0x7fc0a8146ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:26.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.596+0000 7fc0adc8a700 1 --2- 172.21.15.60:0/478010308 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0a80bc810 0x7fc0a8146ca0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc09000c4e0 tx=0x7fc09000c8a0 comp rx=0 tx=0).stop 2023-07-12T02:02:26.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.596+0000 7fc0adc8a700 1 -- 172.21.15.60:0/478010308 shutdown_connections 2023-07-12T02:02:26.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.596+0000 7fc0adc8a700 1 --2- 172.21.15.60:0/478010308 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc08806ace0 0x7fc08806d190 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:26.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.596+0000 7fc0adc8a700 1 --2- 172.21.15.60:0/478010308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0a81449d0 0x7fc0a81471e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:26.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.596+0000 7fc0adc8a700 1 --2- 172.21.15.60:0/478010308 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc0a80b8d90 0x7fc0a80b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:26.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.596+0000 7fc0adc8a700 1 --2- 172.21.15.60:0/478010308 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0a80bc810 0x7fc0a8146ca0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:26.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.596+0000 7fc0adc8a700 1 -- 172.21.15.60:0/478010308 >> 172.21.15.60:0/478010308 conn(0x7fc0a80c0860 msgr2=0x7fc0a80baeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:26.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.596+0000 7fc0adc8a700 1 -- 172.21.15.60:0/478010308 shutdown_connections 2023-07-12T02:02:26.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.596+0000 7fc0adc8a700 1 -- 172.21.15.60:0/478010308 wait complete. 2023-07-12T02:02:26.611 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-12T02:02:26.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.736+0000 7f35a43ed700 1 Processor -- start 2023-07-12T02:02:26.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.736+0000 7f35a43ed700 1 -- start start 2023-07-12T02:02:26.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.737+0000 7f35a43ed700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f359c1449d0 0x7f359c14db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:26.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.737+0000 7f35a43ed700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f359c0b8d90 0x7f359c06ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:26.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.737+0000 7f35a43ed700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f359c0b8620 con 0x7f359c0bc810 2023-07-12T02:02:26.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.737+0000 7f35a43ed700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f359c0b97a0 con 0x7f359c1449d0 2023-07-12T02:02:26.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.737+0000 7f35a43ed700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f359c144da0 con 0x7f359c0b8d90 2023-07-12T02:02:26.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.738+0000 7f35a298a700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f359c0b8d90 0x7f359c06ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:26.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.738+0000 7f35a298a700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f359c0b8d90 0x7f359c06ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.60:45012/0 (socket says 172.21.15.60:45012) 2023-07-12T02:02:26.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.738+0000 7f35a298a700 1 -- 172.21.15.60:0/4261944496 learned_addr learned my addr 172.21.15.60:0/4261944496 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:26.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.738+0000 7f35a2189700 1 --2- 172.21.15.60:0/4261944496 >> v2:172.21.15.79:3300/0 conn(0x7f359c1449d0 0x7f359c14db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:26.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.738+0000 7f35a1988700 1 --1- 172.21.15.60:0/4261944496 >> v1:172.21.15.79:6789/0 conn(0x7f359c0bc810 0x7f359c0ba530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.60:58108/0 (socket says 172.21.15.60:58108) 2023-07-12T02:02:26.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.738+0000 7f35a1187700 1 -- 172.21.15.60:0/4261944496 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 829993631 0 0) 0x7f359c0b8620 con 0x7f359c0bc810 2023-07-12T02:02:26.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.738+0000 7f35a298a700 1 -- 172.21.15.60:0/4261944496 >> v2:172.21.15.79:3300/0 conn(0x7f359c1449d0 msgr2=0x7f359c14db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:26.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.738+0000 7f35a298a700 1 --2- 172.21.15.60:0/4261944496 >> v2:172.21.15.79:3300/0 conn(0x7f359c1449d0 0x7f359c14db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:26.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.738+0000 7f35a298a700 1 -- 172.21.15.60:0/4261944496 >> v1:172.21.15.79:6789/0 conn(0x7f359c0bc810 legacy=0x7f359c0ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:26.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.738+0000 7f35a298a700 1 -- 172.21.15.60:0/4261944496 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359c0b8900 con 0x7f359c0b8d90 2023-07-12T02:02:26.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.738+0000 7f35a298a700 1 --2- 172.21.15.60:0/4261944496 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f359c0b8d90 0x7f359c06ade0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3594009e50 tx=0x7f359400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd73eba5551b41fc server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:26.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.738+0000 7f35a1187700 1 -- 172.21.15.60:0/4261944496 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359400e070 con 0x7f359c0b8d90 2023-07-12T02:02:26.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.738+0000 7f35a1187700 1 -- 172.21.15.60:0/4261944496 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359400b910 con 0x7f359c0b8d90 2023-07-12T02:02:26.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.738+0000 7f35a1187700 1 -- 172.21.15.60:0/4261944496 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359400bcc0 con 0x7f359c0b8d90 2023-07-12T02:02:26.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.739+0000 7f35a43ed700 1 -- 172.21.15.60:0/4261944496 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f359c0b8d90 msgr2=0x7f359c06ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:26.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.739+0000 7f35a43ed700 1 --2- 172.21.15.60:0/4261944496 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f359c0b8d90 0x7f359c06ade0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3594009e50 tx=0x7f359400b330 comp rx=0 tx=0).stop 2023-07-12T02:02:26.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.739+0000 7f35a43ed700 1 -- 172.21.15.60:0/4261944496 shutdown_connections 2023-07-12T02:02:26.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.739+0000 7f35a43ed700 1 --2- 172.21.15.60:0/4261944496 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f359c0b8d90 0x7f359c06ade0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:26.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.739+0000 7f35a43ed700 1 --2- 172.21.15.60:0/4261944496 >> v2:172.21.15.79:3300/0 conn(0x7f359c1449d0 0x7f359c14db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:26.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.739+0000 7f35a43ed700 1 -- 172.21.15.60:0/4261944496 >> 172.21.15.60:0/4261944496 conn(0x7f359c0c0860 msgr2=0x7f359c0c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:26.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.739+0000 7f35a43ed700 1 -- 172.21.15.60:0/4261944496 shutdown_connections 2023-07-12T02:02:26.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.739+0000 7f35a43ed700 1 -- 172.21.15.60:0/4261944496 wait complete. 2023-07-12T02:02:26.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.740+0000 7f35a43ed700 1 Processor -- start 2023-07-12T02:02:26.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.740+0000 7f35a43ed700 1 -- start start 2023-07-12T02:02:26.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.741+0000 7f35a43ed700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f359c0b8d90 0x7f359c14a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:26.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.741+0000 7f35a43ed700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f359c0bc810 0x7f359c0b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:26.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.741+0000 7f35a43ed700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f359c1449d0 0x7f359c0a5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:26.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.741+0000 7f35a43ed700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359c14aca0 con 0x7f359c0b8d90 2023-07-12T02:02:26.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.741+0000 7f35a43ed700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359c0b6610 con 0x7f359c0bc810 2023-07-12T02:02:26.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.741+0000 7f35a43ed700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f359c148240 con 0x7f359c1449d0 2023-07-12T02:02:26.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.741+0000 7f35a2189700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f359c0b8d90 0x7f359c14a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:26.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.741+0000 7f35a2189700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f359c0b8d90 0x7f359c14a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50968/0 (socket says 172.21.15.60:50968) 2023-07-12T02:02:26.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.741+0000 7f35a2189700 1 -- 172.21.15.60:0/2217461392 learned_addr learned my addr 172.21.15.60:0/2217461392 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:26.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.741+0000 7f35a1988700 1 --2- 172.21.15.60:0/2217461392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f359c0bc810 0x7f359c0b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:26.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.741+0000 7f35a298a700 1 --2- 172.21.15.60:0/2217461392 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f359c1449d0 0x7f359c0a5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:26.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.741+0000 7f35a2189700 1 -- 172.21.15.60:0/2217461392 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f359c1449d0 msgr2=0x7f359c0a5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:26.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.741+0000 7f35a2189700 1 --2- 172.21.15.60:0/2217461392 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f359c1449d0 0x7f359c0a5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:26.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.741+0000 7f35a2189700 1 -- 172.21.15.60:0/2217461392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f359c0bc810 msgr2=0x7f359c0b60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:26.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.741+0000 7f35a2189700 1 --2- 172.21.15.60:0/2217461392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f359c0bc810 0x7f359c0b60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:26.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.741+0000 7f35a2189700 1 -- 172.21.15.60:0/2217461392 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3594009b30 con 0x7f359c0b8d90 2023-07-12T02:02:26.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.742+0000 7f35a2189700 1 --2- 172.21.15.60:0/2217461392 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f359c0b8d90 0x7f359c14a760 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f358c00e870 tx=0x7f358c00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:26.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.742+0000 7f3592ffd700 1 -- 172.21.15.60:0/2217461392 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c009590 con 0x7f359c0b8d90 2023-07-12T02:02:26.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.742+0000 7f3592ffd700 1 -- 172.21.15.60:0/2217461392 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358c013680 con 0x7f359c0b8d90 2023-07-12T02:02:26.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.742+0000 7f35a43ed700 1 -- 172.21.15.60:0/2217461392 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f359c1484e0 con 0x7f359c0b8d90 2023-07-12T02:02:26.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.742+0000 7f3592ffd700 1 -- 172.21.15.60:0/2217461392 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c0139f0 con 0x7f359c0b8d90 2023-07-12T02:02:26.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.742+0000 7f35a43ed700 1 -- 172.21.15.60:0/2217461392 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f359c14aeb0 con 0x7f359c0b8d90 2023-07-12T02:02:26.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.743+0000 7f35a43ed700 1 -- 172.21.15.60:0/2217461392 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f359c074360 con 0x7f359c0b8d90 2023-07-12T02:02:26.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.743+0000 7f3592ffd700 1 -- 172.21.15.60:0/2217461392 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f358c013b50 con 0x7f359c0b8d90 2023-07-12T02:02:26.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.743+0000 7f3592ffd700 1 --2- 172.21.15.60:0/2217461392 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f358006ace0 0x7f358006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:26.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.744+0000 7f3592ffd700 1 -- 172.21.15.60:0/2217461392 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f358c0893b0 con 0x7f359c0b8d90 2023-07-12T02:02:26.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.744+0000 7f35a1988700 1 --2- 172.21.15.60:0/2217461392 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f358006ace0 0x7f358006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:26.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.744+0000 7f35a1988700 1 --2- 172.21.15.60:0/2217461392 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f358006ace0 0x7f358006d190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f359c0a6aa0 tx=0x7f3598007de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:26.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.748+0000 7f3592ffd700 1 -- 172.21.15.60:0/2217461392 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f358c057e50 con 0x7f359c0b8d90 2023-07-12T02:02:26.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.941+0000 7f35a43ed700 1 -- 172.21.15.60:0/2217461392 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f359c1e2e50 con 0x7f359c0b8d90 2023-07-12T02:02:26.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.942+0000 7f3592ffd700 1 -- 172.21.15.60:0/2217461392 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f358c0579e0 con 0x7f359c0b8d90 2023-07-12T02:02:26.945 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-07-12T02:02:26.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.944+0000 7f35a43ed700 1 -- 172.21.15.60:0/2217461392 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f358006ace0 msgr2=0x7f358006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:26.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.944+0000 7f35a43ed700 1 --2- 172.21.15.60:0/2217461392 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f358006ace0 0x7f358006d190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f359c0a6aa0 tx=0x7f3598007de0 comp rx=0 tx=0).stop 2023-07-12T02:02:26.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.944+0000 7f35a43ed700 1 -- 172.21.15.60:0/2217461392 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f359c0b8d90 msgr2=0x7f359c14a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:26.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.944+0000 7f35a43ed700 1 --2- 172.21.15.60:0/2217461392 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f359c0b8d90 0x7f359c14a760 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f358c00e870 tx=0x7f358c00eb80 comp rx=0 tx=0).stop 2023-07-12T02:02:26.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.944+0000 7f35a43ed700 1 -- 172.21.15.60:0/2217461392 shutdown_connections 2023-07-12T02:02:26.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.944+0000 7f35a43ed700 1 --2- 172.21.15.60:0/2217461392 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f358006ace0 0x7f358006d190 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:26.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.944+0000 7f35a43ed700 1 --2- 172.21.15.60:0/2217461392 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f359c0b8d90 0x7f359c14a760 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:26.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.944+0000 7f35a43ed700 1 --2- 172.21.15.60:0/2217461392 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f359c1449d0 0x7f359c0a5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:26.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.944+0000 7f35a43ed700 1 --2- 172.21.15.60:0/2217461392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f359c0bc810 0x7f359c0b60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:26.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.944+0000 7f35a43ed700 1 -- 172.21.15.60:0/2217461392 >> 172.21.15.60:0/2217461392 conn(0x7f359c0c0860 msgr2=0x7f359c0be990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:26.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.944+0000 7f35a43ed700 1 -- 172.21.15.60:0/2217461392 shutdown_connections 2023-07-12T02:02:26.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:26.944+0000 7f35a43ed700 1 -- 172.21.15.60:0/2217461392 wait complete. 2023-07-12T02:02:26.959 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-12T02:02:27.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.081+0000 7f1725d26700 1 Processor -- start 2023-07-12T02:02:27.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.081+0000 7f1725d26700 1 -- start start 2023-07-12T02:02:27.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.082+0000 7f1725d26700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f17200bc810 0x7f17200ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:27.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.082+0000 7f1725d26700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f17200b8d90 0x7f172006ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:27.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.082+0000 7f1725d26700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17200b8620 con 0x7f17201449d0 2023-07-12T02:02:27.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.082+0000 7f1725d26700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17200b97a0 con 0x7f17200b8d90 2023-07-12T02:02:27.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.082+0000 7f1725d26700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1720144da0 con 0x7f17200bc810 2023-07-12T02:02:27.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.082+0000 7f171ffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f17200b8d90 0x7f172006ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:27.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.082+0000 7f171f7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f17201449d0 0x7f172014db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46190/0 (socket says 172.21.15.60:46190) 2023-07-12T02:02:27.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.082+0000 7f171f7fe700 1 -- 172.21.15.60:0/136891620 learned_addr learned my addr 172.21.15.60:0/136891620 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:27.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.082+0000 7f171effd700 1 --2- 172.21.15.60:0/136891620 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f17200bc810 0x7f17200ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:27.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.082+0000 7f171ffff700 1 -- 172.21.15.60:0/136891620 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f17200bc810 msgr2=0x7f17200ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:27.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.082+0000 7f171ffff700 1 --2- 172.21.15.60:0/136891620 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f17200bc810 0x7f17200ba530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:27.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.082+0000 7f171ffff700 1 -- 172.21.15.60:0/136891620 >> v1:172.21.15.60:6789/0 conn(0x7f17201449d0 legacy=0x7f172014db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:27.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.082+0000 7f171ffff700 1 -- 172.21.15.60:0/136891620 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17200b8900 con 0x7f17200b8d90 2023-07-12T02:02:27.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.082+0000 7f171e7fc700 1 -- 172.21.15.60:0/136891620 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1637169314 0 0) 0x7f17200b8620 con 0x7f17201449d0 2023-07-12T02:02:27.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.082+0000 7f171effd700 1 --2- 172.21.15.60:0/136891620 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f17200bc810 0x7f17200ba530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:02:27.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.083+0000 7f171ffff700 1 --2- 172.21.15.60:0/136891620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17200b8d90 0x7f172006ade0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1718009d90 tx=0x7f171800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eda68e706d0c83ed server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:27.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.083+0000 7f171e7fc700 1 -- 172.21.15.60:0/136891620 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171800e070 con 0x7f17200b8d90 2023-07-12T02:02:27.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.083+0000 7f171e7fc700 1 -- 172.21.15.60:0/136891620 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171800bbd0 con 0x7f17200b8d90 2023-07-12T02:02:27.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.083+0000 7f171e7fc700 1 -- 172.21.15.60:0/136891620 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1718012430 con 0x7f17200b8d90 2023-07-12T02:02:27.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.083+0000 7f1725d26700 1 -- 172.21.15.60:0/136891620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17200b8d90 msgr2=0x7f172006ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:27.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.083+0000 7f1725d26700 1 --2- 172.21.15.60:0/136891620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17200b8d90 0x7f172006ade0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1718009d90 tx=0x7f171800b330 comp rx=0 tx=0).stop 2023-07-12T02:02:27.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.083+0000 7f1725d26700 1 -- 172.21.15.60:0/136891620 shutdown_connections 2023-07-12T02:02:27.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.083+0000 7f1725d26700 1 --2- 172.21.15.60:0/136891620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17200b8d90 0x7f172006ade0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:27.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.083+0000 7f1725d26700 1 --2- 172.21.15.60:0/136891620 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f17200bc810 0x7f17200ba530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:27.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.083+0000 7f1725d26700 1 -- 172.21.15.60:0/136891620 >> 172.21.15.60:0/136891620 conn(0x7f17200c0860 msgr2=0x7f17200c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:27.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.083+0000 7f1725d26700 1 -- 172.21.15.60:0/136891620 shutdown_connections 2023-07-12T02:02:27.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.083+0000 7f1725d26700 1 -- 172.21.15.60:0/136891620 wait complete. 2023-07-12T02:02:27.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.085+0000 7f1725d26700 1 Processor -- start 2023-07-12T02:02:27.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.085+0000 7f1725d26700 1 -- start start 2023-07-12T02:02:27.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.086+0000 7f1725d26700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17200b8d90 0x7f17201476d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:27.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.086+0000 7f1725d26700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17200bc810 0x7f17201486d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:27.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.086+0000 7f1725d26700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f17201449d0 0x7f17201459d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:27.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.086+0000 7f1725d26700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172014a580 con 0x7f17200b8d90 2023-07-12T02:02:27.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.086+0000 7f1725d26700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1720146710 con 0x7f17200bc810 2023-07-12T02:02:27.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.086+0000 7f1725d26700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1720147c10 con 0x7f17201449d0 2023-07-12T02:02:27.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.086+0000 7f171f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17200b8d90 0x7f17201476d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:27.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.086+0000 7f171f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17200b8d90 0x7f17201476d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50986/0 (socket says 172.21.15.60:50986) 2023-07-12T02:02:27.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.086+0000 7f171f7fe700 1 -- 172.21.15.60:0/3893454147 learned_addr learned my addr 172.21.15.60:0/3893454147 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:27.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.086+0000 7f171ffff700 1 --2- 172.21.15.60:0/3893454147 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f17201449d0 0x7f17201459d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:27.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.086+0000 7f171effd700 1 --2- 172.21.15.60:0/3893454147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17200bc810 0x7f17201486d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:27.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.086+0000 7f171f7fe700 1 -- 172.21.15.60:0/3893454147 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f17201449d0 msgr2=0x7f17201459d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:27.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.086+0000 7f171f7fe700 1 --2- 172.21.15.60:0/3893454147 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f17201449d0 0x7f17201459d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:27.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.086+0000 7f171f7fe700 1 -- 172.21.15.60:0/3893454147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17200bc810 msgr2=0x7f17201486d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:27.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.086+0000 7f171f7fe700 1 --2- 172.21.15.60:0/3893454147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17200bc810 0x7f17201486d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:27.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.086+0000 7f171f7fe700 1 -- 172.21.15.60:0/3893454147 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1718009a70 con 0x7f17200b8d90 2023-07-12T02:02:27.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.086+0000 7f171effd700 1 --2- 172.21.15.60:0/3893454147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17200bc810 0x7f17201486d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:02:27.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.086+0000 7f171f7fe700 1 --2- 172.21.15.60:0/3893454147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17200b8d90 0x7f17201476d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f171000c580 tx=0x7f171000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:27.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.087+0000 7f1717fff700 1 -- 172.21.15.60:0/3893454147 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1710004c80 con 0x7f17200b8d90 2023-07-12T02:02:27.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.087+0000 7f1717fff700 1 -- 172.21.15.60:0/3893454147 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1710004e00 con 0x7f17200b8d90 2023-07-12T02:02:27.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.087+0000 7f1725d26700 1 -- 172.21.15.60:0/3893454147 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17201463a0 con 0x7f17200b8d90 2023-07-12T02:02:27.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.087+0000 7f1717fff700 1 -- 172.21.15.60:0/3893454147 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1710007310 con 0x7f17200b8d90 2023-07-12T02:02:27.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.087+0000 7f1725d26700 1 -- 172.21.15.60:0/3893454147 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f172014b3d0 con 0x7f17200b8d90 2023-07-12T02:02:27.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.087+0000 7f1725d26700 1 -- 172.21.15.60:0/3893454147 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1720074360 con 0x7f17200b8d90 2023-07-12T02:02:27.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.088+0000 7f1717fff700 1 -- 172.21.15.60:0/3893454147 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1710007470 con 0x7f17200b8d90 2023-07-12T02:02:27.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.088+0000 7f1717fff700 1 --2- 172.21.15.60:0/3893454147 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f170006ace0 0x7f170006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:27.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.089+0000 7f1717fff700 1 -- 172.21.15.60:0/3893454147 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1710089250 con 0x7f17200b8d90 2023-07-12T02:02:27.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.089+0000 7f171effd700 1 --2- 172.21.15.60:0/3893454147 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f170006ace0 0x7f170006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:27.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.089+0000 7f171effd700 1 --2- 172.21.15.60:0/3893454147 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f170006ace0 0x7f170006d190 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f17201475c0 tx=0x7f1708008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:27.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.093+0000 7f1717fff700 1 -- 172.21.15.60:0/3893454147 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f1710054270 con 0x7f17200b8d90 2023-07-12T02:02:27.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.334+0000 7f1725d26700 1 -- 172.21.15.60:0/3893454147 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f17200bbf00 con 0x7f17200b8d90 2023-07-12T02:02:27.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.335+0000 7f1717fff700 1 -- 172.21.15.60:0/3893454147 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3906 (secure 0 0 0) 0x7f1710057890 con 0x7f17200b8d90 2023-07-12T02:02:27.338 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:02:27.339 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2687011977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2687011977},{"type":"v1","addr":"172.21.15.60:6835","nonce":2687011977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/1153134400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1153134400},{"type":"v1","addr":"172.21.15.79:6835","nonce":1153134400}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-12T02:02:12.733570+0000","modified":"2023-07-12T02:02:15.754293+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6833/825430907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":825430907},{"type":"v1","addr":"172.21.15.60:6833","nonce":825430907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-12T02:02:27.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.337+0000 7f1725d26700 1 -- 172.21.15.60:0/3893454147 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f170006ace0 msgr2=0x7f170006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:27.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.337+0000 7f1725d26700 1 --2- 172.21.15.60:0/3893454147 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f170006ace0 0x7f170006d190 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f17201475c0 tx=0x7f1708008040 comp rx=0 tx=0).stop 2023-07-12T02:02:27.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.337+0000 7f1725d26700 1 -- 172.21.15.60:0/3893454147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17200b8d90 msgr2=0x7f17201476d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:27.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.337+0000 7f1725d26700 1 --2- 172.21.15.60:0/3893454147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17200b8d90 0x7f17201476d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f171000c580 tx=0x7f171000c940 comp rx=0 tx=0).stop 2023-07-12T02:02:27.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.337+0000 7f1725d26700 1 -- 172.21.15.60:0/3893454147 shutdown_connections 2023-07-12T02:02:27.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.337+0000 7f1725d26700 1 --2- 172.21.15.60:0/3893454147 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f170006ace0 0x7f170006d190 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:27.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.337+0000 7f1725d26700 1 --2- 172.21.15.60:0/3893454147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17200b8d90 0x7f17201476d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:27.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.337+0000 7f1725d26700 1 --2- 172.21.15.60:0/3893454147 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f17201449d0 0x7f17201459d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:27.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.337+0000 7f1725d26700 1 --2- 172.21.15.60:0/3893454147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17200bc810 0x7f17201486d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:27.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.337+0000 7f1725d26700 1 -- 172.21.15.60:0/3893454147 >> 172.21.15.60:0/3893454147 conn(0x7f17200c0860 msgr2=0x7f172014d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:27.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.337+0000 7f1725d26700 1 -- 172.21.15.60:0/3893454147 shutdown_connections 2023-07-12T02:02:27.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.337+0000 7f1725d26700 1 -- 172.21.15.60:0/3893454147 wait complete. 2023-07-12T02:02:27.342 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 7 2023-07-12T02:02:27.352 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:02:27.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.475+0000 7fa5974c2700 1 Processor -- start 2023-07-12T02:02:27.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.475+0000 7fa5974c2700 1 -- start start 2023-07-12T02:02:27.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.476+0000 7fa5974c2700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa59006b120 0x7fa590071350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:27.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.476+0000 7fa5974c2700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5900b7180 con 0x7fa5900b5fc0 2023-07-12T02:02:27.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.476+0000 7fa5974c2700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa590071070 con 0x7fa5900ba160 2023-07-12T02:02:27.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.476+0000 7fa5974c2700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5900b90b0 con 0x7fa59006b120 2023-07-12T02:02:27.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.476+0000 7fa595a5f700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa5900b5fc0 0x7fa5900b6440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49522/0 (socket says 172.21.15.60:49522) 2023-07-12T02:02:27.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.476+0000 7fa595a5f700 1 -- 172.21.15.60:0/741673685 learned_addr learned my addr 172.21.15.60:0/741673685 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:27.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.476+0000 7fa59525e700 1 --2- 172.21.15.60:0/741673685 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa59006b120 0x7fa590071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:27.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.477+0000 7fa587fff700 1 -- 172.21.15.60:0/741673685 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1773061911 0 0) 0x7fa5900b7180 con 0x7fa5900b5fc0 2023-07-12T02:02:27.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.477+0000 7fa587fff700 1 -- 172.21.15.60:0/741673685 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa57c0035b0 con 0x7fa5900b5fc0 2023-07-12T02:02:27.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.477+0000 7fa587fff700 1 -- 172.21.15.60:0/741673685 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3724795401 0 0) 0x7fa590071070 con 0x7fa5900ba160 2023-07-12T02:02:27.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.477+0000 7fa587fff700 1 -- 172.21.15.60:0/741673685 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5900b7180 con 0x7fa5900ba160 2023-07-12T02:02:27.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.477+0000 7fa59525e700 1 -- 172.21.15.60:0/741673685 >> v1:172.21.15.79:6789/0 conn(0x7fa5900ba160 legacy=0x7fa5901485e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:27.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.477+0000 7fa59525e700 1 -- 172.21.15.60:0/741673685 >> v1:172.21.15.60:6789/0 conn(0x7fa5900b5fc0 legacy=0x7fa5900b6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:27.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.477+0000 7fa59525e700 1 -- 172.21.15.60:0/741673685 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5900b6e10 con 0x7fa59006b120 2023-07-12T02:02:27.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.477+0000 7fa59525e700 1 --2- 172.21.15.60:0/741673685 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa59006b120 0x7fa590071350 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa58c009870 tx=0x7fa58c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e64f68c6b5959b41 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:27.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.477+0000 7fa587fff700 1 -- 172.21.15.60:0/741673685 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c011830 con 0x7fa59006b120 2023-07-12T02:02:27.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.477+0000 7fa587fff700 1 -- 172.21.15.60:0/741673685 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa58c011990 con 0x7fa59006b120 2023-07-12T02:02:27.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.477+0000 7fa587fff700 1 -- 172.21.15.60:0/741673685 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c011d00 con 0x7fa59006b120 2023-07-12T02:02:27.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.478+0000 7fa5974c2700 1 -- 172.21.15.60:0/741673685 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa59006b120 msgr2=0x7fa590071350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:27.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.478+0000 7fa5974c2700 1 --2- 172.21.15.60:0/741673685 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa59006b120 0x7fa590071350 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa58c009870 tx=0x7fa58c009b80 comp rx=0 tx=0).stop 2023-07-12T02:02:27.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.478+0000 7fa5974c2700 1 -- 172.21.15.60:0/741673685 shutdown_connections 2023-07-12T02:02:27.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.478+0000 7fa5974c2700 1 --2- 172.21.15.60:0/741673685 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa59006b120 0x7fa590071350 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:27.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.478+0000 7fa5974c2700 1 -- 172.21.15.60:0/741673685 >> 172.21.15.60:0/741673685 conn(0x7fa5900bd980 msgr2=0x7fa5900b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:27.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.478+0000 7fa5974c2700 1 -- 172.21.15.60:0/741673685 shutdown_connections 2023-07-12T02:02:27.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.478+0000 7fa5974c2700 1 -- 172.21.15.60:0/741673685 wait complete. 2023-07-12T02:02:27.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.479+0000 7fa5974c2700 1 Processor -- start 2023-07-12T02:02:27.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.479+0000 7fa5974c2700 1 -- start start 2023-07-12T02:02:27.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.480+0000 7fa5974c2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa59006b120 0x7fa590140080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:27.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.480+0000 7fa5974c2700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa5900b5fc0 0x7fa5901d2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:27.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.480+0000 7fa5974c2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5900ba160 0x7fa5900705c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:27.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.480+0000 7fa5974c2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5901405c0 con 0x7fa5900ba160 2023-07-12T02:02:27.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.480+0000 7fa5974c2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5901d2580 con 0x7fa59006b120 2023-07-12T02:02:27.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.480+0000 7fa5974c2700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5901d1230 con 0x7fa5900b5fc0 2023-07-12T02:02:27.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.480+0000 7fa595a5f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5900ba160 0x7fa5900705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:27.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.480+0000 7fa595a5f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5900ba160 0x7fa5900705c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47076/0 (socket says 172.21.15.60:47076) 2023-07-12T02:02:27.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.480+0000 7fa595a5f700 1 -- 172.21.15.60:0/395932963 learned_addr learned my addr 172.21.15.60:0/395932963 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:27.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.480+0000 7fa59525e700 1 --2- 172.21.15.60:0/395932963 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa59006b120 0x7fa590140080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:27.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.480+0000 7fa594a5d700 1 --2- 172.21.15.60:0/395932963 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa5900b5fc0 0x7fa5901d2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:27.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.480+0000 7fa595a5f700 1 -- 172.21.15.60:0/395932963 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa5900b5fc0 msgr2=0x7fa5901d2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:27.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.480+0000 7fa595a5f700 1 --2- 172.21.15.60:0/395932963 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa5900b5fc0 0x7fa5901d2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:27.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.480+0000 7fa595a5f700 1 -- 172.21.15.60:0/395932963 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa59006b120 msgr2=0x7fa590140080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:27.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.480+0000 7fa595a5f700 1 --2- 172.21.15.60:0/395932963 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa59006b120 0x7fa590140080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:27.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.480+0000 7fa595a5f700 1 -- 172.21.15.60:0/395932963 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa58c0094a0 con 0x7fa5900ba160 2023-07-12T02:02:27.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.480+0000 7fa595a5f700 1 --2- 172.21.15.60:0/395932963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5900ba160 0x7fa5900705c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa58800cba0 tx=0x7fa58800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:27.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.480+0000 7fa585ffb700 1 -- 172.21.15.60:0/395932963 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58800aac0 con 0x7fa5900ba160 2023-07-12T02:02:27.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.480+0000 7fa585ffb700 1 -- 172.21.15.60:0/395932963 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa58800ac20 con 0x7fa5900ba160 2023-07-12T02:02:27.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.480+0000 7fa585ffb700 1 -- 172.21.15.60:0/395932963 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa588012400 con 0x7fa5900ba160 2023-07-12T02:02:27.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.480+0000 7fa5974c2700 1 -- 172.21.15.60:0/395932963 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5901d1570 con 0x7fa5900ba160 2023-07-12T02:02:27.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.481+0000 7fa5974c2700 1 -- 172.21.15.60:0/395932963 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5901d0550 con 0x7fa5900ba160 2023-07-12T02:02:27.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.482+0000 7fa5974c2700 1 -- 172.21.15.60:0/395932963 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5900b94c0 con 0x7fa5900ba160 2023-07-12T02:02:27.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.482+0000 7fa585ffb700 1 -- 172.21.15.60:0/395932963 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa58801b3b0 con 0x7fa5900ba160 2023-07-12T02:02:27.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.482+0000 7fa585ffb700 1 --2- 172.21.15.60:0/395932963 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fa57406ace0 0x7fa57406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:27.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.482+0000 7fa585ffb700 1 -- 172.21.15.60:0/395932963 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa5880891f0 con 0x7fa5900ba160 2023-07-12T02:02:27.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.483+0000 7fa59525e700 1 --2- 172.21.15.60:0/395932963 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fa57406ace0 0x7fa57406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:27.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.483+0000 7fa59525e700 1 --2- 172.21.15.60:0/395932963 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fa57406ace0 0x7fa57406d190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa58c0090b0 tx=0x7fa58c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:27.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.487+0000 7fa585ffb700 1 -- 172.21.15.60:0/395932963 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fa5900b94c0 con 0x7fa5900ba160 2023-07-12T02:02:27.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.683+0000 7fa5974c2700 1 -- 172.21.15.60:0/395932963 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5900702e0 con 0x7fa5900ba160 2023-07-12T02:02:27.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.685+0000 7fa585ffb700 1 -- 172.21.15.60:0/395932963 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18173 (secure 0 0 0) 0x7fa5900702e0 con 0x7fa5900ba160 2023-07-12T02:02:27.688 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:02:27.688 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":21,"fsid":"97e7c909-e567-472e-a5aa-72fde15171f2","created":"2023-07-12T02:01:53.987086+0000","modified":"2023-07-12T02:02:14.307912+0000","last_up_change":"2023-07-12T02:02:04.031780+0000","last_in_change":"2023-07-12T02:01:56.538621+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-12T02:02:05.375042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-12T02:02:05.857441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:02:10.574633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-12T02:02:11.699872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ed8b71c2-3895-4952-a118-16ede0b4a98c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6801","nonce":2818935979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6803","nonce":2818935979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6807","nonce":2818935979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6805","nonce":2818935979}]},"public_addr":"172.21.15.60:6801/2818935979","cluster_addr":"172.21.15.60:6803/2818935979","heartbeat_back_addr":"172.21.15.60:6807/2818935979","heartbeat_front_addr":"172.21.15.60:6805/2818935979","state":["exists","up"]},{"osd":1,"uuid":"7cf4d354-78e0-43ce-8c09-4a7d2a0b57a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6817","nonce":1678864191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6819","nonce":1678864191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6823","nonce":1678864191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6821","nonce":1678864191}]},"public_addr":"172.21.15.60:6817/1678864191","cluster_addr":"172.21.15.60:6819/1678864191","heartbeat_back_addr":"172.21.15.60:6823/1678864191","heartbeat_front_addr":"172.21.15.60:6821/1678864191","state":["exists","up"]},{"osd":2,"uuid":"02c958b8-9599-4470-92cb-8f7018ec0189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6809","nonce":1459480680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6811","nonce":1459480680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6815","nonce":1459480680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6813","nonce":1459480680}]},"public_addr":"172.21.15.60:6809/1459480680","cluster_addr":"172.21.15.60:6811/1459480680","heartbeat_back_addr":"172.21.15.60:6815/1459480680","heartbeat_front_addr":"172.21.15.60:6813/1459480680","state":["exists","up"]},{"osd":3,"uuid":"bc300432-a228-4257-be5c-e42dd5f2015f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6825","nonce":3295100060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6827","nonce":3295100060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6831","nonce":3295100060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6829","nonce":3295100060}]},"public_addr":"172.21.15.60:6825/3295100060","cluster_addr":"172.21.15.60:6827/3295100060","heartbeat_back_addr":"172.21.15.60:6831/3295100060","heartbeat_front_addr":"172.21.15.60:6829/3295100060","state":["exists","up"]},{"osd":4,"uuid":"ad9f7dc4-7126-466d-a656-2844880c6060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6809","nonce":4127109138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6811","nonce":4127109138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6815","nonce":4127109138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6813","nonce":4127109138}]},"public_addr":"172.21.15.79:6809/4127109138","cluster_addr":"172.21.15.79:6811/4127109138","heartbeat_back_addr":"172.21.15.79:6815/4127109138","heartbeat_front_addr":"172.21.15.79:6813/4127109138","state":["exists","up"]},{"osd":5,"uuid":"e88d16ca-0b01-4ab9-8aa8-c4aff7f210f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6801","nonce":421449406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6803","nonce":421449406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6807","nonce":421449406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6805","nonce":421449406}]},"public_addr":"172.21.15.79:6801/421449406","cluster_addr":"172.21.15.79:6803/421449406","heartbeat_back_addr":"172.21.15.79:6807/421449406","heartbeat_front_addr":"172.21.15.79:6805/421449406","state":["exists","up"]},{"osd":6,"uuid":"6898cb84-56d1-48a9-bd45-97e4668e2fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6825","nonce":4144355139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6827","nonce":4144355139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6831","nonce":4144355139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6829","nonce":4144355139}]},"public_addr":"172.21.15.79:6825/4144355139","cluster_addr":"172.21.15.79:6827/4144355139","heartbeat_back_addr":"172.21.15.79:6831/4144355139","heartbeat_front_addr":"172.21.15.79:6829/4144355139","state":["exists","up"]},{"osd":7,"uuid":"65c10882-371e-4762-b384-9c3a48f332ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6817","nonce":2845223299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6819","nonce":2845223299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6823","nonce":2845223299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6821","nonce":2845223299}]},"public_addr":"172.21.15.79:6817/2845223299","cluster_addr":"172.21.15.79:6819/2845223299","heartbeat_back_addr":"172.21.15.79:6823/2845223299","heartbeat_front_addr":"172.21.15.79:6821/2845223299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.634716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.758349+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.728366+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.777395+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707262+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.649705+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.693021+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:02:27.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.687+0000 7fa5974c2700 1 -- 172.21.15.60:0/395932963 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fa57406ace0 msgr2=0x7fa57406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:27.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.687+0000 7fa5974c2700 1 --2- 172.21.15.60:0/395932963 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fa57406ace0 0x7fa57406d190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa58c0090b0 tx=0x7fa58c008030 comp rx=0 tx=0).stop 2023-07-12T02:02:27.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.687+0000 7fa5974c2700 1 -- 172.21.15.60:0/395932963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5900ba160 msgr2=0x7fa5900705c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:27.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.687+0000 7fa5974c2700 1 --2- 172.21.15.60:0/395932963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5900ba160 0x7fa5900705c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa58800cba0 tx=0x7fa58800cf60 comp rx=0 tx=0).stop 2023-07-12T02:02:27.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.687+0000 7fa5974c2700 1 -- 172.21.15.60:0/395932963 shutdown_connections 2023-07-12T02:02:27.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.687+0000 7fa5974c2700 1 --2- 172.21.15.60:0/395932963 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fa57406ace0 0x7fa57406d190 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:27.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.687+0000 7fa5974c2700 1 --2- 172.21.15.60:0/395932963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5900ba160 0x7fa5900705c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:27.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.687+0000 7fa5974c2700 1 --2- 172.21.15.60:0/395932963 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa59006b120 0x7fa590140080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:27.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.687+0000 7fa5974c2700 1 --2- 172.21.15.60:0/395932963 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa5900b5fc0 0x7fa5901d2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:27.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.687+0000 7fa5974c2700 1 -- 172.21.15.60:0/395932963 >> 172.21.15.60:0/395932963 conn(0x7fa5900bd980 msgr2=0x7fa5900bba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:27.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.687+0000 7fa5974c2700 1 -- 172.21.15.60:0/395932963 shutdown_connections 2023-07-12T02:02:27.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.687+0000 7fa5974c2700 1 -- 172.21.15.60:0/395932963 wait complete. 2023-07-12T02:02:27.702 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-12T02:02:27.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.825+0000 7f90c1734700 1 Processor -- start 2023-07-12T02:02:27.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.825+0000 7f90c1734700 1 -- start start 2023-07-12T02:02:27.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.826+0000 7f90c1734700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90bc071840 0x7f90bc156000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:27.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.826+0000 7f90c1734700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90bc06a640 con 0x7f90bc0721e0 2023-07-12T02:02:27.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.826+0000 7f90c1734700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90bc06f680 con 0x7f90bc147dc0 2023-07-12T02:02:27.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.826+0000 7f90c1734700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc070950 con 0x7f90bc071840 2023-07-12T02:02:27.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.826+0000 7f90ba7fc700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f90bc0721e0 0x7f90bc071130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49528/0 (socket says 172.21.15.60:49528) 2023-07-12T02:02:27.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.826+0000 7f90ba7fc700 1 -- 172.21.15.60:0/1798180180 learned_addr learned my addr 172.21.15.60:0/1798180180 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:27.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.827+0000 7f90bb7fe700 1 --2- 172.21.15.60:0/1798180180 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90bc071840 0x7f90bc156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:27.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.827+0000 7f90b9ffb700 1 -- 172.21.15.60:0/1798180180 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3865270028 0 0) 0x7f90bc06a640 con 0x7f90bc0721e0 2023-07-12T02:02:27.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.827+0000 7f90b9ffb700 1 -- 172.21.15.60:0/1798180180 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90a40035b0 con 0x7f90bc0721e0 2023-07-12T02:02:27.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.827+0000 7f90b9ffb700 1 -- 172.21.15.60:0/1798180180 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2725853256 0 0) 0x7f90a40035b0 con 0x7f90bc0721e0 2023-07-12T02:02:27.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.827+0000 7f90b9ffb700 1 -- 172.21.15.60:0/1798180180 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90bc071840 msgr2=0x7f90bc156000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:27.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.827+0000 7f90b9ffb700 1 --2- 172.21.15.60:0/1798180180 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90bc071840 0x7f90bc156000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:27.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.827+0000 7f90b9ffb700 1 -- 172.21.15.60:0/1798180180 >> v1:172.21.15.79:6789/0 conn(0x7f90bc147dc0 legacy=0x7f90bc069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:27.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.827+0000 7f90b9ffb700 1 -- 172.21.15.60:0/1798180180 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90bc06f920 con 0x7f90bc0721e0 2023-07-12T02:02:27.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.827+0000 7f90b9ffb700 1 -- 172.21.15.60:0/1798180180 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1141905739 0 0) 0x7f90ac001670 con 0x7f90bc0721e0 2023-07-12T02:02:27.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.827+0000 7f90b9ffb700 1 -- 172.21.15.60:0/1798180180 >> v1:172.21.15.60:6789/0 conn(0x7f90bc0721e0 legacy=0x7f90bc071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:27.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.827+0000 7f90b9ffb700 1 --2- 172.21.15.60:0/1798180180 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90bc071840 0x7f90a4003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:27.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.827+0000 7f90b9ffb700 1 --2- 172.21.15.60:0/1798180180 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90a4003f70 0x7f90a4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:27.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.827+0000 7f90b9ffb700 1 --2- 172.21.15.60:0/1798180180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90a4004d90 0x7f90a4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:27.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.827+0000 7f90b9ffb700 1 -- 172.21.15.60:0/1798180180 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc070950 con 0x7f90a4004d90 2023-07-12T02:02:27.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.827+0000 7f90b9ffb700 1 -- 172.21.15.60:0/1798180180 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a400bba0 con 0x7f90a4003f70 2023-07-12T02:02:27.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.827+0000 7f90b9ffb700 1 -- 172.21.15.60:0/1798180180 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a400bd60 con 0x7f90bc071840 2023-07-12T02:02:27.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.827+0000 7f90bb7fe700 1 --2- 172.21.15.60:0/1798180180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90a4004d90 0x7f90a4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:27.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.827+0000 7f90baffd700 1 --2- 172.21.15.60:0/1798180180 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90bc071840 0x7f90a4003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:27.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.827+0000 7f90ba7fc700 1 --2- 172.21.15.60:0/1798180180 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90a4003f70 0x7f90a4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:27.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.827+0000 7f90bb7fe700 1 -- 172.21.15.60:0/1798180180 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90bc071840 msgr2=0x7f90a4003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:27.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.827+0000 7f90bb7fe700 1 --2- 172.21.15.60:0/1798180180 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90bc071840 0x7f90a4003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:27.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.827+0000 7f90bb7fe700 1 -- 172.21.15.60:0/1798180180 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90a4003f70 msgr2=0x7f90a4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:27.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.827+0000 7f90bb7fe700 1 --2- 172.21.15.60:0/1798180180 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90a4003f70 0x7f90a4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:27.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.827+0000 7f90bb7fe700 1 -- 172.21.15.60:0/1798180180 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a40035b0 con 0x7f90a4004d90 2023-07-12T02:02:27.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.827+0000 7f90bb7fe700 1 --2- 172.21.15.60:0/1798180180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90a4004d90 0x7f90a4005200 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f90b4009f90 tx=0x7f90a4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bb30215bbd04ad6 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:27.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.828+0000 7f90b9ffb700 1 -- 172.21.15.60:0/1798180180 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b400ebd0 con 0x7f90a4004d90 2023-07-12T02:02:27.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.828+0000 7f90b9ffb700 1 -- 172.21.15.60:0/1798180180 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b400f040 con 0x7f90a4004d90 2023-07-12T02:02:27.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.828+0000 7f90b9ffb700 1 -- 172.21.15.60:0/1798180180 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b4014480 con 0x7f90a4004d90 2023-07-12T02:02:27.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.828+0000 7f90c1734700 1 -- 172.21.15.60:0/1798180180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90a4004d90 msgr2=0x7f90a4005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:27.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.828+0000 7f90c1734700 1 --2- 172.21.15.60:0/1798180180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90a4004d90 0x7f90a4005200 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f90b4009f90 tx=0x7f90a4005880 comp rx=0 tx=0).stop 2023-07-12T02:02:27.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.828+0000 7f90bb7fe700 1 -- 172.21.15.60:0/1798180180 reap_dead start 2023-07-12T02:02:27.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.828+0000 7f90c1734700 1 -- 172.21.15.60:0/1798180180 shutdown_connections 2023-07-12T02:02:27.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.828+0000 7f90c1734700 1 -- 172.21.15.60:0/1798180180 >> 172.21.15.60:0/1798180180 conn(0x7f90bc06d0e0 msgr2=0x7f90bc06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:27.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.828+0000 7f90c1734700 1 -- 172.21.15.60:0/1798180180 shutdown_connections 2023-07-12T02:02:27.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.828+0000 7f90c1734700 1 -- 172.21.15.60:0/1798180180 wait complete. 2023-07-12T02:02:27.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.829+0000 7f90c1734700 1 Processor -- start 2023-07-12T02:02:27.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.829+0000 7f90c1734700 1 -- start start 2023-07-12T02:02:27.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.830+0000 7f90c1734700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90a4004d90 0x7f90bc14e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:27.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.830+0000 7f90c1734700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90bc14be20 0x7f90bc149d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:27.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.830+0000 7f90c1734700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90bc145a00 0x7f90bc145e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:27.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.830+0000 7f90c1734700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc14a290 con 0x7f90a4004d90 2023-07-12T02:02:27.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.830+0000 7f90c1734700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc1463c0 con 0x7f90bc145a00 2023-07-12T02:02:27.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.830+0000 7f90c1734700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc1475f0 con 0x7f90bc14be20 2023-07-12T02:02:27.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.830+0000 7f90baffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90a4004d90 0x7f90bc14e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:27.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.830+0000 7f90baffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90a4004d90 0x7f90bc14e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47098/0 (socket says 172.21.15.60:47098) 2023-07-12T02:02:27.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.830+0000 7f90baffd700 1 -- 172.21.15.60:0/967986104 learned_addr learned my addr 172.21.15.60:0/967986104 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:27.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.830+0000 7f90bb7fe700 1 --2- 172.21.15.60:0/967986104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90bc145a00 0x7f90bc145e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:27.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.830+0000 7f90ba7fc700 1 --2- 172.21.15.60:0/967986104 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90bc14be20 0x7f90bc149d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:27.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.830+0000 7f90baffd700 1 -- 172.21.15.60:0/967986104 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90bc14be20 msgr2=0x7f90bc149d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:27.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.830+0000 7f90baffd700 1 --2- 172.21.15.60:0/967986104 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90bc14be20 0x7f90bc149d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:27.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.830+0000 7f90baffd700 1 -- 172.21.15.60:0/967986104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90bc145a00 msgr2=0x7f90bc145e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:27.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.830+0000 7f90baffd700 1 --2- 172.21.15.60:0/967986104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90bc145a00 0x7f90bc145e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:27.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.830+0000 7f90baffd700 1 -- 172.21.15.60:0/967986104 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90bc146d50 con 0x7f90a4004d90 2023-07-12T02:02:27.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.830+0000 7f90ba7fc700 1 --2- 172.21.15.60:0/967986104 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90bc14be20 0x7f90bc149d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:27.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.831+0000 7f90baffd700 1 --2- 172.21.15.60:0/967986104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90a4004d90 0x7f90bc14e760 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f90b000f820 tx=0x7f90b000fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:27.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.831+0000 7f90a37fe700 1 -- 172.21.15.60:0/967986104 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b00052e0 con 0x7f90a4004d90 2023-07-12T02:02:27.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.831+0000 7f90a37fe700 1 -- 172.21.15.60:0/967986104 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b0005440 con 0x7f90a4004d90 2023-07-12T02:02:27.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.831+0000 7f90c1734700 1 -- 172.21.15.60:0/967986104 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90bc147030 con 0x7f90a4004d90 2023-07-12T02:02:27.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.831+0000 7f90a37fe700 1 -- 172.21.15.60:0/967986104 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b00038c0 con 0x7f90a4004d90 2023-07-12T02:02:27.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.831+0000 7f90c1734700 1 -- 172.21.15.60:0/967986104 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90bc0bc8a0 con 0x7f90a4004d90 2023-07-12T02:02:27.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.832+0000 7f90c1734700 1 -- 172.21.15.60:0/967986104 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90bc145720 con 0x7f90a4004d90 2023-07-12T02:02:27.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.832+0000 7f90a37fe700 1 -- 172.21.15.60:0/967986104 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f90b0003a20 con 0x7f90a4004d90 2023-07-12T02:02:27.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.833+0000 7f90a37fe700 1 --2- 172.21.15.60:0/967986104 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f90a806ace0 0x7f90a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:27.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.833+0000 7f90a37fe700 1 -- 172.21.15.60:0/967986104 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f90b0089360 con 0x7f90a4004d90 2023-07-12T02:02:27.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.833+0000 7f90ba7fc700 1 --2- 172.21.15.60:0/967986104 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f90a806ace0 0x7f90a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:27.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.833+0000 7f90ba7fc700 1 --2- 172.21.15.60:0/967986104 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f90a806ace0 0x7f90a806d190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f90bc14ecf0 tx=0x7f90ac009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:27.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:27.837+0000 7f90a37fe700 1 -- 172.21.15.60:0/967986104 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f90bc145720 con 0x7f90a4004d90 2023-07-12T02:02:28.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.077+0000 7f90c1734700 1 -- 172.21.15.60:0/967986104 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90bc145720 con 0x7f90a4004d90 2023-07-12T02:02:28.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.077+0000 7f90a37fe700 1 -- 172.21.15.60:0/967986104 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3906 (secure 0 0 0) 0x7f90bc145720 con 0x7f90a4004d90 2023-07-12T02:02:28.081 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:02:28.081 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2687011977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2687011977},{"type":"v1","addr":"172.21.15.60:6835","nonce":2687011977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/1153134400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1153134400},{"type":"v1","addr":"172.21.15.79:6835","nonce":1153134400}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-12T02:02:12.733570+0000","modified":"2023-07-12T02:02:15.754293+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6833/825430907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":825430907},{"type":"v1","addr":"172.21.15.60:6833","nonce":825430907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-12T02:02:28.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.080+0000 7f90c1734700 1 -- 172.21.15.60:0/967986104 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f90a806ace0 msgr2=0x7f90a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:28.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.080+0000 7f90c1734700 1 --2- 172.21.15.60:0/967986104 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f90a806ace0 0x7f90a806d190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f90bc14ecf0 tx=0x7f90ac009040 comp rx=0 tx=0).stop 2023-07-12T02:02:28.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.080+0000 7f90c1734700 1 -- 172.21.15.60:0/967986104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90a4004d90 msgr2=0x7f90bc14e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:28.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.080+0000 7f90c1734700 1 --2- 172.21.15.60:0/967986104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90a4004d90 0x7f90bc14e760 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f90b000f820 tx=0x7f90b000fb30 comp rx=0 tx=0).stop 2023-07-12T02:02:28.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.080+0000 7f90c1734700 1 -- 172.21.15.60:0/967986104 shutdown_connections 2023-07-12T02:02:28.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.080+0000 7f90c1734700 1 --2- 172.21.15.60:0/967986104 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f90a806ace0 0x7f90a806d190 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:28.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.080+0000 7f90c1734700 1 --2- 172.21.15.60:0/967986104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90a4004d90 0x7f90bc14e760 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:28.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.080+0000 7f90c1734700 1 --2- 172.21.15.60:0/967986104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90bc145a00 0x7f90bc145e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:28.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.080+0000 7f90c1734700 1 --2- 172.21.15.60:0/967986104 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90bc14be20 0x7f90bc149d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:28.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.080+0000 7f90c1734700 1 -- 172.21.15.60:0/967986104 >> 172.21.15.60:0/967986104 conn(0x7f90bc06d0e0 msgr2=0x7f90bc0b83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:28.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.080+0000 7f90c1734700 1 -- 172.21.15.60:0/967986104 shutdown_connections 2023-07-12T02:02:28.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.080+0000 7f90c1734700 1 -- 172.21.15.60:0/967986104 wait complete. 2023-07-12T02:02:28.085 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 7 2023-07-12T02:02:28.396 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-12T02:02:12.733570+0000', 'modified': '2023-07-12T02:02:15.754293+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4287}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4287': {'gid': 4287, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.60:6833/825430907', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6832', 'nonce': 825430907}, {'type': 'v1', 'addr': '172.21.15.60:6833', 'nonce': 825430907}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-12T02:02:28.396 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-12T02:02:28.397 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-07-12T02:02:28.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.522+0000 7f09d61ae700 1 Processor -- start 2023-07-12T02:02:28.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.522+0000 7f09d61ae700 1 -- start start 2023-07-12T02:02:28.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.523+0000 7f09d61ae700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f09d014c3a0 0x7f09d0153e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:28.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.523+0000 7f09d61ae700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09d0071c60 con 0x7f09d006b120 2023-07-12T02:02:28.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.523+0000 7f09d61ae700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09d0070fd0 con 0x7f09d0071590 2023-07-12T02:02:28.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.523+0000 7f09d61ae700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09d00712b0 con 0x7f09d014c3a0 2023-07-12T02:02:28.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.523+0000 7f09cf7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f09d006b120 0x7f09d014bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49544/0 (socket says 172.21.15.60:49544) 2023-07-12T02:02:28.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.523+0000 7f09cf7fe700 1 -- 172.21.15.60:0/1220051638 learned_addr learned my addr 172.21.15.60:0/1220051638 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:28.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.523+0000 7f09cffff700 1 --2- 172.21.15.60:0/1220051638 >> v2:172.21.15.60:3300/0 conn(0x7f09d014c3a0 0x7f09d0153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:28.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.523+0000 7f09ce7fc700 1 -- 172.21.15.60:0/1220051638 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4100259355 0 0) 0x7f09d0071c60 con 0x7f09d006b120 2023-07-12T02:02:28.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.523+0000 7f09ce7fc700 1 -- 172.21.15.60:0/1220051638 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09bc0035b0 con 0x7f09d006b120 2023-07-12T02:02:28.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.523+0000 7f09cffff700 1 -- 172.21.15.60:0/1220051638 >> v1:172.21.15.79:6789/0 conn(0x7f09d0071590 legacy=0x7f09d0142310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:28.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.523+0000 7f09cffff700 1 -- 172.21.15.60:0/1220051638 >> v1:172.21.15.60:6789/0 conn(0x7f09d006b120 legacy=0x7f09d014bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:28.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.523+0000 7f09cffff700 1 -- 172.21.15.60:0/1220051638 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d00ba240 con 0x7f09d014c3a0 2023-07-12T02:02:28.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.524+0000 7f09cffff700 1 --2- 172.21.15.60:0/1220051638 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09d014c3a0 0x7f09d0153e80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f09c8009d90 tx=0x7f09c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=671fcbde94857bd7 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:28.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.524+0000 7f09ce7fc700 1 -- 172.21.15.60:0/1220051638 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c800e070 con 0x7f09d014c3a0 2023-07-12T02:02:28.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.524+0000 7f09ce7fc700 1 -- 172.21.15.60:0/1220051638 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c800bb20 con 0x7f09d014c3a0 2023-07-12T02:02:28.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.524+0000 7f09ce7fc700 1 -- 172.21.15.60:0/1220051638 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c8012430 con 0x7f09d014c3a0 2023-07-12T02:02:28.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.524+0000 7f09d61ae700 1 -- 172.21.15.60:0/1220051638 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09d014c3a0 msgr2=0x7f09d0153e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:28.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.524+0000 7f09d61ae700 1 --2- 172.21.15.60:0/1220051638 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09d014c3a0 0x7f09d0153e80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f09c8009d90 tx=0x7f09c800b330 comp rx=0 tx=0).stop 2023-07-12T02:02:28.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.524+0000 7f09d61ae700 1 -- 172.21.15.60:0/1220051638 shutdown_connections 2023-07-12T02:02:28.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.524+0000 7f09d61ae700 1 --2- 172.21.15.60:0/1220051638 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09d014c3a0 0x7f09d0153e80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:28.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.524+0000 7f09d61ae700 1 -- 172.21.15.60:0/1220051638 >> 172.21.15.60:0/1220051638 conn(0x7f09d00bd980 msgr2=0x7f09d00b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:28.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.524+0000 7f09d61ae700 1 -- 172.21.15.60:0/1220051638 shutdown_connections 2023-07-12T02:02:28.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.524+0000 7f09d61ae700 1 -- 172.21.15.60:0/1220051638 wait complete. 2023-07-12T02:02:28.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.525+0000 7f09d61ae700 1 Processor -- start 2023-07-12T02:02:28.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.526+0000 7f09d61ae700 1 -- start start 2023-07-12T02:02:28.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.526+0000 7f09d61ae700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f09d006b120 0x7f09d0146740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:28.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.526+0000 7f09d61ae700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09d0071590 0x7f09d0147530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:28.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.526+0000 7f09d61ae700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09d014c3a0 0x7f09d01e2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:28.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.526+0000 7f09d61ae700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d0146c80 con 0x7f09d0071590 2023-07-12T02:02:28.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.526+0000 7f09d61ae700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d0146f00 con 0x7f09d014c3a0 2023-07-12T02:02:28.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.526+0000 7f09d61ae700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d014b980 con 0x7f09d006b120 2023-07-12T02:02:28.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.526+0000 7f09ceffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09d0071590 0x7f09d0147530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:28.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.526+0000 7f09ceffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09d0071590 0x7f09d0147530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47114/0 (socket says 172.21.15.60:47114) 2023-07-12T02:02:28.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.526+0000 7f09ceffd700 1 -- 172.21.15.60:0/3252057768 learned_addr learned my addr 172.21.15.60:0/3252057768 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:28.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.527+0000 7f09cf7fe700 1 --2- 172.21.15.60:0/3252057768 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f09d006b120 0x7f09d0146740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:28.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.527+0000 7f09cffff700 1 --2- 172.21.15.60:0/3252057768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09d014c3a0 0x7f09d01e2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:28.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.527+0000 7f09ceffd700 1 -- 172.21.15.60:0/3252057768 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f09d006b120 msgr2=0x7f09d0146740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:28.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.527+0000 7f09ceffd700 1 --2- 172.21.15.60:0/3252057768 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f09d006b120 0x7f09d0146740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:28.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.527+0000 7f09ceffd700 1 -- 172.21.15.60:0/3252057768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09d014c3a0 msgr2=0x7f09d01e2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:28.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.527+0000 7f09ceffd700 1 --2- 172.21.15.60:0/3252057768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09d014c3a0 0x7f09d01e2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:28.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.527+0000 7f09ceffd700 1 -- 172.21.15.60:0/3252057768 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c8009a70 con 0x7f09d0071590 2023-07-12T02:02:28.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.527+0000 7f09ceffd700 1 --2- 172.21.15.60:0/3252057768 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09d0071590 0x7f09d0147530 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f09b800c4b0 tx=0x7f09b800c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:28.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.527+0000 7f09c7fff700 1 -- 172.21.15.60:0/3252057768 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b8005220 con 0x7f09d0071590 2023-07-12T02:02:28.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.527+0000 7f09c7fff700 1 -- 172.21.15.60:0/3252057768 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b8005380 con 0x7f09d0071590 2023-07-12T02:02:28.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.527+0000 7f09c7fff700 1 -- 172.21.15.60:0/3252057768 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b8006aa0 con 0x7f09d0071590 2023-07-12T02:02:28.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.527+0000 7f09d61ae700 1 -- 172.21.15.60:0/3252057768 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09d0147eb0 con 0x7f09d0071590 2023-07-12T02:02:28.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.527+0000 7f09d61ae700 1 -- 172.21.15.60:0/3252057768 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09d0070cf0 con 0x7f09d0071590 2023-07-12T02:02:28.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.528+0000 7f09c7fff700 1 -- 172.21.15.60:0/3252057768 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f09b8006c00 con 0x7f09d0071590 2023-07-12T02:02:28.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.529+0000 7f09c7fff700 1 --2- 172.21.15.60:0/3252057768 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f09b006ace0 0x7f09b006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:28.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.529+0000 7f09c7fff700 1 -- 172.21.15.60:0/3252057768 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f09b8088770 con 0x7f09d0071590 2023-07-12T02:02:28.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.529+0000 7f09cf7fe700 1 --2- 172.21.15.60:0/3252057768 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f09b006ace0 0x7f09b006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:28.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.530+0000 7f09cf7fe700 1 --2- 172.21.15.60:0/3252057768 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f09b006ace0 0x7f09b006d190 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f09c00011e0 tx=0x7f09c0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:28.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.531+0000 7f09e2347b80 1 Processor -- start 2023-07-12T02:02:28.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.531+0000 7f09e2347b80 1 -- start start 2023-07-12T02:02:28.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.532+0000 7f09e2347b80 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x555dce6f9650 0x555dce6f69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:28.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.532+0000 7f09e2347b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dce6f5ac0 0x555dce6f5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:28.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.532+0000 7f09e2347b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dce726de0 0x555dce727250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:28.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.532+0000 7f09e2347b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dce66fea0 con 0x555dce726de0 2023-07-12T02:02:28.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.532+0000 7f09e2347b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dce5e3600 con 0x555dce6f5ac0 2023-07-12T02:02:28.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.532+0000 7f09e2347b80 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x555dce652910 con 0x555dce6f9650 2023-07-12T02:02:28.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.532+0000 7f09cffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dce726de0 0x555dce727250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:28.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.532+0000 7f09cffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dce726de0 0x555dce727250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47120/0 (socket says 172.21.15.60:47120) 2023-07-12T02:02:28.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.532+0000 7f09cffff700 1 -- 172.21.15.60:0/1719381522 learned_addr learned my addr 172.21.15.60:0/1719381522 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:28.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.532+0000 7f09cf7fe700 1 --2- 172.21.15.60:0/1719381522 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x555dce6f9650 0x555dce6f69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:28.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.532+0000 7f09ceffd700 1 --2- 172.21.15.60:0/1719381522 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dce6f5ac0 0x555dce6f5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:28.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.532+0000 7f09cffff700 1 -- 172.21.15.60:0/1719381522 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x555dce6f9650 msgr2=0x555dce6f69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:28.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.532+0000 7f09cffff700 1 --2- 172.21.15.60:0/1719381522 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x555dce6f9650 0x555dce6f69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:28.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.532+0000 7f09cffff700 1 -- 172.21.15.60:0/1719381522 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dce6f5ac0 msgr2=0x555dce6f5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:28.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.532+0000 7f09cffff700 1 --2- 172.21.15.60:0/1719381522 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dce6f5ac0 0x555dce6f5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:28.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.532+0000 7f09cffff700 1 -- 172.21.15.60:0/1719381522 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555dce43f790 con 0x555dce726de0 2023-07-12T02:02:28.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.532+0000 7f09cf7fe700 1 --2- 172.21.15.60:0/1719381522 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x555dce6f9650 0x555dce6f69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:28.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.532+0000 7f09cffff700 1 --2- 172.21.15.60:0/1719381522 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dce726de0 0x555dce727250 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f09d00660e0 tx=0x7f09c8010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e4f5c1d5f1626f5 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:28.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.532+0000 7f09c57fa700 1 -- 172.21.15.60:0/1719381522 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c8003a20 con 0x555dce726de0 2023-07-12T02:02:28.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.532+0000 7f09c57fa700 1 -- 172.21.15.60:0/1719381522 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c8003b80 con 0x555dce726de0 2023-07-12T02:02:28.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.532+0000 7f09c57fa700 1 -- 172.21.15.60:0/1719381522 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c80125e0 con 0x555dce726de0 2023-07-12T02:02:28.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.533+0000 7f09e2347b80 1 -- 172.21.15.60:0/1719381522 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dce726de0 msgr2=0x555dce727250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:28.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.533+0000 7f09e2347b80 1 --2- 172.21.15.60:0/1719381522 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dce726de0 0x555dce727250 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f09d00660e0 tx=0x7f09c8010000 comp rx=0 tx=0).stop 2023-07-12T02:02:28.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.533+0000 7f09e2347b80 1 -- 172.21.15.60:0/1719381522 shutdown_connections 2023-07-12T02:02:28.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.533+0000 7f09e2347b80 1 --2- 172.21.15.60:0/1719381522 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dce726de0 0x555dce727250 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:28.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.533+0000 7f09e2347b80 1 --2- 172.21.15.60:0/1719381522 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x555dce6f9650 0x555dce6f69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:28.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.533+0000 7f09e2347b80 1 --2- 172.21.15.60:0/1719381522 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dce6f5ac0 0x555dce6f5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:28.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.533+0000 7f09e2347b80 1 -- 172.21.15.60:0/1719381522 >> 172.21.15.60:0/1719381522 conn(0x555dce6f0320 msgr2=0x555dce6fa380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:28.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.533+0000 7f09e2347b80 1 -- 172.21.15.60:0/1719381522 shutdown_connections 2023-07-12T02:02:28.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.533+0000 7f09e2347b80 1 -- 172.21.15.60:0/1719381522 wait complete. 2023-07-12T02:02:28.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.534+0000 7f09e2347b80 1 -- start start 2023-07-12T02:02:28.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.534+0000 7f09e2347b80 1 Processor -- start 2023-07-12T02:02:28.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.534+0000 7f09e2347b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dce6f5ac0 0x555dce720050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:28.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.534+0000 7f09e2347b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dce6f9650 0x555dce72c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:28.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.534+0000 7f09e2347b80 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x555dce726de0 0x555dce72cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:28.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.534+0000 7f09e2347b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dce64bbe0 con 0x555dce6f9650 2023-07-12T02:02:28.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.534+0000 7f09e2347b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dce6095b0 con 0x555dce6f5ac0 2023-07-12T02:02:28.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.534+0000 7f09e2347b80 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x555dce5ef910 con 0x555dce726de0 2023-07-12T02:02:28.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.534+0000 7f09e2347b80 10 client.0 _ll_register_callbacks cb 0x555dce607b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-12T02:02:28.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.534+0000 7f09ceffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dce6f9650 0x555dce72c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:28.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.535+0000 7f09ceffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dce6f9650 0x555dce72c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47128/0 (socket says 172.21.15.60:47128) 2023-07-12T02:02:28.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.535+0000 7f09ceffd700 1 -- 172.21.15.60:0/2307964098 learned_addr learned my addr 172.21.15.60:0/2307964098 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:28.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.535+0000 7f09cffff700 1 --2- 172.21.15.60:0/2307964098 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x555dce726de0 0x555dce72cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:28.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.535+0000 7f09cf7fe700 1 --2- 172.21.15.60:0/2307964098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dce6f5ac0 0x555dce720050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:28.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.535+0000 7f09ceffd700 1 -- 172.21.15.60:0/2307964098 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x555dce726de0 msgr2=0x555dce72cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:28.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.535+0000 7f09ceffd700 1 --2- 172.21.15.60:0/2307964098 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x555dce726de0 0x555dce72cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:28.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.535+0000 7f09ceffd700 1 -- 172.21.15.60:0/2307964098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dce6f5ac0 msgr2=0x555dce720050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:28.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.535+0000 7f09ceffd700 1 --2- 172.21.15.60:0/2307964098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dce6f5ac0 0x555dce720050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:28.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.535+0000 7f09ceffd700 1 -- 172.21.15.60:0/2307964098 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09d00ba240 con 0x555dce6f9650 2023-07-12T02:02:28.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.535+0000 7f09ceffd700 1 --2- 172.21.15.60:0/2307964098 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dce6f9650 0x555dce72c7d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f09b8053a70 tx=0x7f09b805b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27e69ac889de03af server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:28.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.535+0000 7f09ae7fc700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-07-12T02:02:28.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.535+0000 7f09ae7fc700 1 -- 172.21.15.60:0/2307964098 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b8056c60 con 0x555dce6f9650 2023-07-12T02:02:28.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.535+0000 7f09ae7fc700 1 -- 172.21.15.60:0/2307964098 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f09b805f430 con 0x555dce6f9650 2023-07-12T02:02:28.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.535+0000 7f09e2347b80 1 -- 172.21.15.60:0/2307964098 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555dce6ed930 con 0x555dce6f9650 2023-07-12T02:02:28.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.535+0000 7f09ae7fc700 1 -- 172.21.15.60:0/2307964098 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09b805f5f0 con 0x555dce6f9650 2023-07-12T02:02:28.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.535+0000 7f09e2347b80 10 client.4665 fetch_fsmap learned FSMap version 7 2023-07-12T02:02:28.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.535+0000 7f09e2347b80 1 -- 172.21.15.60:0/2307964098 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x555dce52c0a0 con 0x555dce6f9650 2023-07-12T02:02:28.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.535+0000 7f09ae7fc700 1 -- 172.21.15.60:0/2307964098 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555dce6ed930 con 0x555dce6f9650 2023-07-12T02:02:28.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.535+0000 7f09ae7fc700 1 -- 172.21.15.60:0/2307964098 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 7) v1 ==== 2569+0+0 (secure 0 0 0) 0x7f09b806e030 con 0x555dce6f9650 2023-07-12T02:02:28.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.535+0000 7f09e2347b80 10 client.4665 fetch_fsmap finished waiting for FSMap version 7 2023-07-12T02:02:28.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.535+0000 7f09e2347b80 10 client.4665 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-12T02:02:28.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.536+0000 7f09e2347b80 20 client.4665 populate_metadata read hostname 'smithi060' 2023-07-12T02:02:28.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.536+0000 7f09e2347b80 1 --2- 172.21.15.60:0/2307964098 >> [v2:172.21.15.60:6832/825430907,v1:172.21.15.60:6833/825430907] conn(0x555dce72d250 0x555dce714290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:28.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.536+0000 7f09e2347b80 4 client.4665 mds_command: new command op to 4287 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-12T02:02:28.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.536+0000 7f09e2347b80 1 -- 172.21.15.60:0/2307964098 --> [v2:172.21.15.60:6832/825430907,v1:172.21.15.60:6833/825430907] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555dce6ca0e0 con 0x555dce72d250 2023-07-12T02:02:28.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.536+0000 7f09cf7fe700 1 --2- 172.21.15.60:0/2307964098 >> [v2:172.21.15.60:6832/825430907,v1:172.21.15.60:6833/825430907] conn(0x555dce72d250 0x555dce714290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:28.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.536+0000 7f09ae7fc700 10 client.4665 ms_handle_connect on v2:172.21.15.60:6832/825430907 2023-07-12T02:02:28.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.536+0000 7f09cf7fe700 1 --2- 172.21.15.60:0/2307964098 >> [v2:172.21.15.60:6832/825430907,v1:172.21.15.60:6833/825430907] conn(0x555dce72d250 0x555dce714290 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6e22e449b113615 server_cookie=56257625924ab64d in_seq=0 out_seq=0 2023-07-12T02:02:28.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.536+0000 7f09ae7fc700 1 -- 172.21.15.60:0/2307964098 <== mds.0 v2:172.21.15.60:6832/825430907 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x555dce6ca0e0 con 0x555dce72d250 2023-07-12T02:02:28.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.536+0000 7f09ae7fc700 10 client.4665 handle_command_reply: tid=0 2023-07-12T02:02:28.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.537+0000 7f09e2347b80 1 client.4665 shutdown 2023-07-12T02:02:28.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.537+0000 7f09e2347b80 1 -- 172.21.15.60:0/2307964098 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dce6f9650 msgr2=0x555dce72c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:28.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.537+0000 7f09e2347b80 1 --2- 172.21.15.60:0/2307964098 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dce6f9650 0x555dce72c7d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f09b8053a70 tx=0x7f09b805b650 comp rx=0 tx=0).stop 2023-07-12T02:02:28.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.537+0000 7f09e2347b80 1 -- 172.21.15.60:0/2307964098 shutdown_connections 2023-07-12T02:02:28.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.537+0000 7f09e2347b80 1 --2- 172.21.15.60:0/2307964098 >> [v2:172.21.15.60:6832/825430907,v1:172.21.15.60:6833/825430907] conn(0x555dce72d250 0x555dce714290 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:28.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.537+0000 7f09e2347b80 1 --2- 172.21.15.60:0/2307964098 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x555dce726de0 0x555dce72cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:28.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.537+0000 7f09ae7fc700 0 client.4665 ms_handle_reset on v2:172.21.15.60:6832/825430907 2023-07-12T02:02:28.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.537+0000 7f09e2347b80 1 --2- 172.21.15.60:0/2307964098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dce6f5ac0 0x555dce720050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:28.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.537+0000 7f09e2347b80 1 --2- 172.21.15.60:0/2307964098 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dce6f9650 0x555dce72c7d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:28.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.537+0000 7f09e2347b80 1 -- 172.21.15.60:0/2307964098 >> 172.21.15.60:0/2307964098 conn(0x555dce6f0320 msgr2=0x555dce6f6890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:28.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.537+0000 7f09e2347b80 1 -- 172.21.15.60:0/2307964098 shutdown_connections 2023-07-12T02:02:28.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.537+0000 7f09e2347b80 1 -- 172.21.15.60:0/2307964098 wait complete. 2023-07-12T02:02:28.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.537+0000 7f09e2347b80 20 client.4665 trim_cache size 0 max 16384 2023-07-12T02:02:28.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.555+0000 7f09e2347b80 1 Processor -- start 2023-07-12T02:02:28.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.555+0000 7f09e2347b80 1 -- start start 2023-07-12T02:02:28.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.555+0000 7f09e2347b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dce6f5ac0 0x555dce6f5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:28.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.555+0000 7f09e2347b80 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x555dce6f9650 0x555dce71f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:28.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.555+0000 7f09e2347b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dce726de0 0x555dce71f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:28.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.555+0000 7f09e2347b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dce440390 con 0x555dce726de0 2023-07-12T02:02:28.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.555+0000 7f09e2347b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dce6f2440 con 0x555dce6f5ac0 2023-07-12T02:02:28.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.555+0000 7f09e2347b80 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x555dce740ee0 con 0x555dce6f9650 2023-07-12T02:02:28.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.555+0000 7f09cffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dce726de0 0x555dce71f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:28.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.556+0000 7f09cffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dce726de0 0x555dce71f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47140/0 (socket says 172.21.15.60:47140) 2023-07-12T02:02:28.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.556+0000 7f09cffff700 1 -- 172.21.15.60:0/3472574001 learned_addr learned my addr 172.21.15.60:0/3472574001 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:28.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.556+0000 7f09cf7fe700 1 --2- 172.21.15.60:0/3472574001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dce6f5ac0 0x555dce6f5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:28.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.556+0000 7f09ceffd700 1 --2- 172.21.15.60:0/3472574001 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x555dce6f9650 0x555dce71f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:28.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.556+0000 7f09cffff700 1 -- 172.21.15.60:0/3472574001 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x555dce6f9650 msgr2=0x555dce71f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:28.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.556+0000 7f09cffff700 1 --2- 172.21.15.60:0/3472574001 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x555dce6f9650 0x555dce71f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:28.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.556+0000 7f09cffff700 1 -- 172.21.15.60:0/3472574001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dce6f5ac0 msgr2=0x555dce6f5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:28.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.556+0000 7f09cffff700 1 --2- 172.21.15.60:0/3472574001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dce6f5ac0 0x555dce6f5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:28.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.556+0000 7f09cffff700 1 -- 172.21.15.60:0/3472574001 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555dce7284f0 con 0x555dce726de0 2023-07-12T02:02:28.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.556+0000 7f09cffff700 1 --2- 172.21.15.60:0/3472574001 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dce726de0 0x555dce71f760 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f09c800b760 tx=0x7f09c8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=358c42a540a6ae91 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:28.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.556+0000 7f09c5ffb700 1 -- 172.21.15.60:0/3472574001 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c80070a0 con 0x555dce726de0 2023-07-12T02:02:28.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.556+0000 7f09c5ffb700 1 -- 172.21.15.60:0/3472574001 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c8012590 con 0x555dce726de0 2023-07-12T02:02:28.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.556+0000 7f09c5ffb700 1 -- 172.21.15.60:0/3472574001 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c8012940 con 0x555dce726de0 2023-07-12T02:02:28.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.557+0000 7f09e2347b80 1 -- 172.21.15.60:0/3472574001 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dce726de0 msgr2=0x555dce71f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:28.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.557+0000 7f09e2347b80 1 --2- 172.21.15.60:0/3472574001 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dce726de0 0x555dce71f760 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f09c800b760 tx=0x7f09c8012000 comp rx=0 tx=0).stop 2023-07-12T02:02:28.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.557+0000 7f09e2347b80 1 -- 172.21.15.60:0/3472574001 shutdown_connections 2023-07-12T02:02:28.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.557+0000 7f09e2347b80 1 --2- 172.21.15.60:0/3472574001 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dce726de0 0x555dce71f760 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:28.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.557+0000 7f09e2347b80 1 --2- 172.21.15.60:0/3472574001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dce6f5ac0 0x555dce6f5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:28.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.557+0000 7f09e2347b80 1 --2- 172.21.15.60:0/3472574001 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x555dce6f9650 0x555dce71f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:28.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.557+0000 7f09e2347b80 1 -- 172.21.15.60:0/3472574001 >> 172.21.15.60:0/3472574001 conn(0x555dce6f0320 msgr2=0x555dce6f6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:28.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.557+0000 7f09e2347b80 1 -- 172.21.15.60:0/3472574001 shutdown_connections 2023-07-12T02:02:28.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.557+0000 7f09e2347b80 1 -- 172.21.15.60:0/3472574001 wait complete. 2023-07-12T02:02:28.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.557+0000 7f09e2347b80 1 -- start start 2023-07-12T02:02:28.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.557+0000 7f09e2347b80 1 Processor -- start 2023-07-12T02:02:28.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.558+0000 7f09e2347b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dce6f5ac0 0x555dce714440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:28.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.558+0000 7f09e2347b80 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x555dce6f9650 0x555dce78f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:28.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.558+0000 7f09e2347b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dce726de0 0x555dce78f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:28.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.558+0000 7f09e2347b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dce798fe0 con 0x555dce6f5ac0 2023-07-12T02:02:28.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.558+0000 7f09e2347b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dce798b10 con 0x555dce726de0 2023-07-12T02:02:28.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.558+0000 7f09e2347b80 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x555dce722090 con 0x555dce6f9650 2023-07-12T02:02:28.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.558+0000 7f09e2347b80 10 client.0 _ll_register_callbacks cb 0x7f09b8056ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-12T02:02:28.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.558+0000 7f09cf7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dce6f5ac0 0x555dce714440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:28.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.558+0000 7f09cf7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dce6f5ac0 0x555dce714440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47142/0 (socket says 172.21.15.60:47142) 2023-07-12T02:02:28.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.558+0000 7f09cf7fe700 1 -- 172.21.15.60:0/677847671 learned_addr learned my addr 172.21.15.60:0/677847671 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:28.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.558+0000 7f09ceffd700 1 --2- 172.21.15.60:0/677847671 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x555dce6f9650 0x555dce78f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:28.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.558+0000 7f09cffff700 1 --2- 172.21.15.60:0/677847671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dce726de0 0x555dce78f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:28.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.558+0000 7f09cf7fe700 1 -- 172.21.15.60:0/677847671 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x555dce6f9650 msgr2=0x555dce78f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:28.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.558+0000 7f09cf7fe700 1 --2- 172.21.15.60:0/677847671 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x555dce6f9650 0x555dce78f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:28.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.558+0000 7f09cf7fe700 1 -- 172.21.15.60:0/677847671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dce726de0 msgr2=0x555dce78f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:28.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.558+0000 7f09cf7fe700 1 --2- 172.21.15.60:0/677847671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dce726de0 0x555dce78f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:28.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.558+0000 7f09cf7fe700 1 -- 172.21.15.60:0/677847671 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555dce43f790 con 0x555dce6f5ac0 2023-07-12T02:02:28.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.559+0000 7f09cf7fe700 1 --2- 172.21.15.60:0/677847671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dce6f5ac0 0x555dce714440 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f09c0005fd0 tx=0x7f09c0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42a465a7e38b63df server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:28.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.559+0000 7f09ae7fc700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-07-12T02:02:28.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.559+0000 7f09ae7fc700 1 -- 172.21.15.60:0/677847671 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c00076c0 con 0x555dce6f5ac0 2023-07-12T02:02:28.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.559+0000 7f09ae7fc700 1 -- 172.21.15.60:0/677847671 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f09c0007820 con 0x555dce6f5ac0 2023-07-12T02:02:28.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.559+0000 7f09e2347b80 1 -- 172.21.15.60:0/677847671 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f09c8003b80 con 0x555dce6f5ac0 2023-07-12T02:02:28.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.559+0000 7f09ae7fc700 1 -- 172.21.15.60:0/677847671 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09c002e440 con 0x555dce6f5ac0 2023-07-12T02:02:28.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.559+0000 7f09e2347b80 10 client.4671 fetch_fsmap learned FSMap version 7 2023-07-12T02:02:28.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.559+0000 7f09e2347b80 1 -- 172.21.15.60:0/677847671 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x555dce611b10 con 0x555dce6f5ac0 2023-07-12T02:02:28.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.559+0000 7f09ae7fc700 1 -- 172.21.15.60:0/677847671 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c8003b80 con 0x555dce6f5ac0 2023-07-12T02:02:28.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.559+0000 7f09ae7fc700 1 -- 172.21.15.60:0/677847671 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 7) v1 ==== 2569+0+0 (secure 0 0 0) 0x7f09c002e5a0 con 0x555dce6f5ac0 2023-07-12T02:02:28.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.559+0000 7f09e2347b80 10 client.4671 fetch_fsmap finished waiting for FSMap version 7 2023-07-12T02:02:28.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.559+0000 7f09e2347b80 10 client.4671 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-12T02:02:28.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.559+0000 7f09e2347b80 20 client.4671 populate_metadata read hostname 'smithi060' 2023-07-12T02:02:28.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.559+0000 7f09e2347b80 1 --2- 172.21.15.60:0/677847671 >> [v2:172.21.15.60:6832/825430907,v1:172.21.15.60:6833/825430907] conn(0x555dce727b30 0x555dce725770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:28.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.559+0000 7f09e2347b80 4 client.4671 mds_command: new command op to 4287 tid=0[{"prefix": "status"}] 2023-07-12T02:02:28.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.559+0000 7f09e2347b80 1 -- 172.21.15.60:0/677847671 --> [v2:172.21.15.60:6832/825430907,v1:172.21.15.60:6833/825430907] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555dce644d20 con 0x555dce727b30 2023-07-12T02:02:28.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.559+0000 7f09ceffd700 1 --2- 172.21.15.60:0/677847671 >> [v2:172.21.15.60:6832/825430907,v1:172.21.15.60:6833/825430907] conn(0x555dce727b30 0x555dce725770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:28.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.560+0000 7f09ae7fc700 10 client.4671 ms_handle_connect on v2:172.21.15.60:6832/825430907 2023-07-12T02:02:28.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.560+0000 7f09ceffd700 1 --2- 172.21.15.60:0/677847671 >> [v2:172.21.15.60:6832/825430907,v1:172.21.15.60:6833/825430907] conn(0x555dce727b30 0x555dce725770 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4af1de166e91097a server_cookie=b877e7f72e5f7e74 in_seq=0 out_seq=0 2023-07-12T02:02:28.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.560+0000 7f09ae7fc700 1 -- 172.21.15.60:0/677847671 <== mds.0 v2:172.21.15.60:6832/825430907 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x555dce644d20 con 0x555dce727b30 2023-07-12T02:02:28.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.560+0000 7f09ae7fc700 10 client.4671 handle_command_reply: tid=0 2023-07-12T02:02:28.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.560+0000 7f09e2347b80 1 client.4671 shutdown 2023-07-12T02:02:28.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.560+0000 7f09e2347b80 1 -- 172.21.15.60:0/677847671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dce6f5ac0 msgr2=0x555dce714440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:28.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.560+0000 7f09e2347b80 1 --2- 172.21.15.60:0/677847671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dce6f5ac0 0x555dce714440 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f09c0005fd0 tx=0x7f09c0000ed0 comp rx=0 tx=0).stop 2023-07-12T02:02:28.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.560+0000 7f09e2347b80 1 -- 172.21.15.60:0/677847671 shutdown_connections 2023-07-12T02:02:28.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.560+0000 7f09e2347b80 1 --2- 172.21.15.60:0/677847671 >> [v2:172.21.15.60:6832/825430907,v1:172.21.15.60:6833/825430907] conn(0x555dce727b30 0x555dce725770 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:28.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.560+0000 7f09e2347b80 1 --2- 172.21.15.60:0/677847671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555dce6f5ac0 0x555dce714440 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:28.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.560+0000 7f09e2347b80 1 --2- 172.21.15.60:0/677847671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555dce726de0 0x555dce78f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:28.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.560+0000 7f09ae7fc700 0 client.4671 ms_handle_reset on v2:172.21.15.60:6832/825430907 2023-07-12T02:02:28.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.560+0000 7f09e2347b80 1 --2- 172.21.15.60:0/677847671 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x555dce6f9650 0x555dce78f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:28.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.560+0000 7f09e2347b80 1 -- 172.21.15.60:0/677847671 >> 172.21.15.60:0/677847671 conn(0x555dce6f0320 msgr2=0x555dce6f5e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:28.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.560+0000 7f09e2347b80 1 -- 172.21.15.60:0/677847671 shutdown_connections 2023-07-12T02:02:28.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.560+0000 7f09e2347b80 1 -- 172.21.15.60:0/677847671 wait complete. 2023-07-12T02:02:28.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.560+0000 7f09e2347b80 20 client.4671 trim_cache size 0 max 16384 2023-07-12T02:02:28.573 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-07-12T02:02:28.573 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "97e7c909-e567-472e-a5aa-72fde15171f2", 2023-07-12T02:02:28.573 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 0, 2023-07-12T02:02:28.574 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4287, 2023-07-12T02:02:28.574 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2023-07-12T02:02:28.574 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2023-07-12T02:02:28.574 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2023-07-12T02:02:28.574 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 15.252225249, 2023-07-12T02:02:28.574 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 7, 2023-07-12T02:02:28.574 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 21, 2023-07-12T02:02:28.575 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 21, 2023-07-12T02:02:28.575 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 21.165162098 2023-07-12T02:02:28.575 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-07-12T02:02:28.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.561+0000 7f09d61ae700 1 -- 172.21.15.60:0/3252057768 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f09b006ace0 msgr2=0x7f09b006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:28.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.561+0000 7f09d61ae700 1 --2- 172.21.15.60:0/3252057768 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f09b006ace0 0x7f09b006d190 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f09c00011e0 tx=0x7f09c0009040 comp rx=0 tx=0).stop 2023-07-12T02:02:28.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.561+0000 7f09d61ae700 1 -- 172.21.15.60:0/3252057768 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09d0071590 msgr2=0x7f09d0147530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:28.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.561+0000 7f09d61ae700 1 --2- 172.21.15.60:0/3252057768 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09d0071590 0x7f09d0147530 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f09b800c4b0 tx=0x7f09b800c870 comp rx=0 tx=0).stop 2023-07-12T02:02:28.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.561+0000 7f09d61ae700 1 -- 172.21.15.60:0/3252057768 shutdown_connections 2023-07-12T02:02:28.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.561+0000 7f09d61ae700 1 --2- 172.21.15.60:0/3252057768 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f09b006ace0 0x7f09b006d190 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:28.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.561+0000 7f09d61ae700 1 --2- 172.21.15.60:0/3252057768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09d014c3a0 0x7f09d01e2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:28.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.561+0000 7f09d61ae700 1 --2- 172.21.15.60:0/3252057768 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f09d006b120 0x7f09d0146740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:28.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.561+0000 7f09d61ae700 1 --2- 172.21.15.60:0/3252057768 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09d0071590 0x7f09d0147530 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:28.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.561+0000 7f09d61ae700 1 -- 172.21.15.60:0/3252057768 >> 172.21.15.60:0/3252057768 conn(0x7f09d00bd980 msgr2=0x7f09d01409f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:28.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.561+0000 7f09d61ae700 1 -- 172.21.15.60:0/3252057768 shutdown_connections 2023-07-12T02:02:28.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.561+0000 7f09d61ae700 1 -- 172.21.15.60:0/3252057768 wait complete. 2023-07-12T02:02:28.578 INFO:teuthology.run_tasks:Running task kclient... 2023-07-12T02:02:28.602 INFO:tasks.kclient:Mounting kernel clients... 2023-07-12T02:02:28.602 INFO:tasks.kclient:config is {'client.0': {}} 2023-07-12T02:02:28.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:02:28.603 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list 2023-07-12T02:02:28.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:02:28.655 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link delete ceph-brx 2023-07-12T02:02:28.729 INFO:teuthology.orchestra.run.smithi174.stderr:Cannot find device "ceph-brx" 2023-07-12T02:02:28.731 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-12T02:02:28.732 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-07-12T02:02:28.732 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-12T02:02:28.733 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-12T02:02:28.733 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-12T02:02:28.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.858+0000 7f7570f27700 1 Processor -- start 2023-07-12T02:02:28.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.858+0000 7f7570f27700 1 -- start start 2023-07-12T02:02:28.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.859+0000 7f7570f27700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f756c1449d0 0x7f756c14db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:28.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.859+0000 7f7570f27700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f756c0bc810 0x7f756c0ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:28.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.859+0000 7f7570f27700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f756c0b8620 con 0x7f756c0b8d90 2023-07-12T02:02:28.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.859+0000 7f7570f27700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f756c0b97a0 con 0x7f756c0bc810 2023-07-12T02:02:28.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.859+0000 7f7570f27700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f756c144da0 con 0x7f756c1449d0 2023-07-12T02:02:28.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.859+0000 7f7569d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f756c0bc810 0x7f756c0ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:28.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.859+0000 7f756ad9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f756c0b8d90 0x7f756c06ade0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49560/0 (socket says 172.21.15.60:49560) 2023-07-12T02:02:28.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.859+0000 7f756ad9d700 1 -- 172.21.15.60:0/3644807227 learned_addr learned my addr 172.21.15.60:0/3644807227 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:28.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.859+0000 7f756a59c700 1 --2- 172.21.15.60:0/3644807227 >> v2:172.21.15.79:3300/0 conn(0x7f756c1449d0 0x7f756c14db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:28.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.859+0000 7f7569d9b700 1 -- 172.21.15.60:0/3644807227 >> v2:172.21.15.79:3300/0 conn(0x7f756c1449d0 msgr2=0x7f756c14db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:28.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.859+0000 7f7569d9b700 1 --2- 172.21.15.60:0/3644807227 >> v2:172.21.15.79:3300/0 conn(0x7f756c1449d0 0x7f756c14db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:28.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.859+0000 7f7569d9b700 1 -- 172.21.15.60:0/3644807227 >> v1:172.21.15.60:6789/0 conn(0x7f756c0b8d90 legacy=0x7f756c06ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:28.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.859+0000 7f7569d9b700 1 -- 172.21.15.60:0/3644807227 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f756c0b8900 con 0x7f756c0bc810 2023-07-12T02:02:28.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.860+0000 7f7569d9b700 1 --2- 172.21.15.60:0/3644807227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f756c0bc810 0x7f756c0ba530 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f756c06cbe0 tx=0x7f755c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68d2c067a562482f server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:28.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.860+0000 7f756959a700 1 -- 172.21.15.60:0/3644807227 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755c011830 con 0x7f756c0bc810 2023-07-12T02:02:28.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.860+0000 7f756959a700 1 -- 172.21.15.60:0/3644807227 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f755c011990 con 0x7f756c0bc810 2023-07-12T02:02:28.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.860+0000 7f756959a700 1 -- 172.21.15.60:0/3644807227 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755c011d20 con 0x7f756c0bc810 2023-07-12T02:02:28.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.860+0000 7f7570f27700 1 -- 172.21.15.60:0/3644807227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f756c0bc810 msgr2=0x7f756c0ba530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:28.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.860+0000 7f7570f27700 1 --2- 172.21.15.60:0/3644807227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f756c0bc810 0x7f756c0ba530 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f756c06cbe0 tx=0x7f755c009b20 comp rx=0 tx=0).stop 2023-07-12T02:02:28.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.860+0000 7f7570f27700 1 -- 172.21.15.60:0/3644807227 shutdown_connections 2023-07-12T02:02:28.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.860+0000 7f7570f27700 1 --2- 172.21.15.60:0/3644807227 >> v2:172.21.15.79:3300/0 conn(0x7f756c1449d0 0x7f756c14db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:28.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.860+0000 7f7570f27700 1 --2- 172.21.15.60:0/3644807227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f756c0bc810 0x7f756c0ba530 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:28.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.860+0000 7f7570f27700 1 -- 172.21.15.60:0/3644807227 >> 172.21.15.60:0/3644807227 conn(0x7f756c0c0860 msgr2=0x7f756c0c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:28.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.860+0000 7f7570f27700 1 -- 172.21.15.60:0/3644807227 shutdown_connections 2023-07-12T02:02:28.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.860+0000 7f7570f27700 1 -- 172.21.15.60:0/3644807227 wait complete. 2023-07-12T02:02:28.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.862+0000 7f7570f27700 1 Processor -- start 2023-07-12T02:02:28.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.862+0000 7f7570f27700 1 -- start start 2023-07-12T02:02:28.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.862+0000 7f7570f27700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f756c0b8d90 0x7f756c0b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:28.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.862+0000 7f7570f27700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f756c0bc810 0x7f756c14d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:28.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.862+0000 7f7570f27700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f756c1449d0 0x7f756c0b1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:28.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.862+0000 7f7570f27700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f756c14d6d0 con 0x7f756c0b8d90 2023-07-12T02:02:28.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.862+0000 7f7570f27700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f756c0b14e0 con 0x7f756c1449d0 2023-07-12T02:02:28.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.862+0000 7f7570f27700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f756c0b3350 con 0x7f756c0bc810 2023-07-12T02:02:28.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.862+0000 7f756a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f756c0b8d90 0x7f756c0b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:28.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.862+0000 7f756a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f756c0b8d90 0x7f756c0b2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47160/0 (socket says 172.21.15.60:47160) 2023-07-12T02:02:28.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.862+0000 7f756a59c700 1 -- 172.21.15.60:0/3928401811 learned_addr learned my addr 172.21.15.60:0/3928401811 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:28.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.863+0000 7f756ad9d700 1 --2- 172.21.15.60:0/3928401811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f756c1449d0 0x7f756c0b1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:28.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.863+0000 7f7569d9b700 1 --2- 172.21.15.60:0/3928401811 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f756c0bc810 0x7f756c14d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:28.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.863+0000 7f756a59c700 1 -- 172.21.15.60:0/3928401811 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f756c0bc810 msgr2=0x7f756c14d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:28.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.863+0000 7f756a59c700 1 --2- 172.21.15.60:0/3928401811 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f756c0bc810 0x7f756c14d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:28.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.863+0000 7f756a59c700 1 -- 172.21.15.60:0/3928401811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f756c1449d0 msgr2=0x7f756c0b1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:28.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.863+0000 7f756a59c700 1 --2- 172.21.15.60:0/3928401811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f756c1449d0 0x7f756c0b1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:28.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.863+0000 7f756a59c700 1 -- 172.21.15.60:0/3928401811 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f755c0094a0 con 0x7f756c0b8d90 2023-07-12T02:02:28.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.863+0000 7f756a59c700 1 --2- 172.21.15.60:0/3928401811 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f756c0b8d90 0x7f756c0b2cb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f756000d800 tx=0x7f756000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:28.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.863+0000 7f755affd700 1 -- 172.21.15.60:0/3928401811 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75600125f0 con 0x7f756c0b8d90 2023-07-12T02:02:28.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.863+0000 7f755affd700 1 -- 172.21.15.60:0/3928401811 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7560012750 con 0x7f756c0b8d90 2023-07-12T02:02:28.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.863+0000 7f7570f27700 1 -- 172.21.15.60:0/3928401811 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f756c0b3ac0 con 0x7f756c0b8d90 2023-07-12T02:02:28.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.863+0000 7f755affd700 1 -- 172.21.15.60:0/3928401811 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7560012ae0 con 0x7f756c0b8d90 2023-07-12T02:02:28.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.863+0000 7f7570f27700 1 -- 172.21.15.60:0/3928401811 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f756c0b4080 con 0x7f756c0b8d90 2023-07-12T02:02:28.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.864+0000 7f7570f27700 1 -- 172.21.15.60:0/3928401811 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f756c074360 con 0x7f756c0b8d90 2023-07-12T02:02:28.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.865+0000 7f755affd700 1 -- 172.21.15.60:0/3928401811 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7560012c40 con 0x7f756c0b8d90 2023-07-12T02:02:28.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.865+0000 7f755affd700 1 --2- 172.21.15.60:0/3928401811 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f754c06ace0 0x7f754c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:28.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.865+0000 7f755affd700 1 -- 172.21.15.60:0/3928401811 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7560089850 con 0x7f756c0b8d90 2023-07-12T02:02:28.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.865+0000 7f7569d9b700 1 --2- 172.21.15.60:0/3928401811 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f754c06ace0 0x7f754c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:28.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.866+0000 7f7569d9b700 1 --2- 172.21.15.60:0/3928401811 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f754c06ace0 0x7f754c06d190 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f755c0090b0 tx=0x7f755c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:28.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:28.870+0000 7f755affd700 1 -- 172.21.15.60:0/3928401811 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f7560054900 con 0x7f756c0b8d90 2023-07-12T02:02:29.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:29.112+0000 7f7570f27700 1 -- 172.21.15.60:0/3928401811 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f756c0bcf50 con 0x7f756c0b8d90 2023-07-12T02:02:29.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:29.112+0000 7f755affd700 1 -- 172.21.15.60:0/3928401811 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7560057f20 con 0x7f756c0b8d90 2023-07-12T02:02:29.116 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-12T02:02:29.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:29.114+0000 7f7570f27700 1 -- 172.21.15.60:0/3928401811 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f754c06ace0 msgr2=0x7f754c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:29.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:29.114+0000 7f7570f27700 1 --2- 172.21.15.60:0/3928401811 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f754c06ace0 0x7f754c06d190 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f755c0090b0 tx=0x7f755c008030 comp rx=0 tx=0).stop 2023-07-12T02:02:29.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:29.114+0000 7f7570f27700 1 -- 172.21.15.60:0/3928401811 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f756c0b8d90 msgr2=0x7f756c0b2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:29.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:29.114+0000 7f7570f27700 1 --2- 172.21.15.60:0/3928401811 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f756c0b8d90 0x7f756c0b2cb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f756000d800 tx=0x7f756000dbc0 comp rx=0 tx=0).stop 2023-07-12T02:02:29.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:29.114+0000 7f7570f27700 1 -- 172.21.15.60:0/3928401811 shutdown_connections 2023-07-12T02:02:29.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:29.114+0000 7f7570f27700 1 --2- 172.21.15.60:0/3928401811 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f754c06ace0 0x7f754c06d190 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:29.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:29.114+0000 7f7570f27700 1 --2- 172.21.15.60:0/3928401811 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f756c0b8d90 0x7f756c0b2cb0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:29.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:29.114+0000 7f7570f27700 1 --2- 172.21.15.60:0/3928401811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f756c1449d0 0x7f756c0b1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:29.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:29.114+0000 7f7570f27700 1 --2- 172.21.15.60:0/3928401811 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f756c0bc810 0x7f756c14d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:29.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:29.114+0000 7f7570f27700 1 -- 172.21.15.60:0/3928401811 >> 172.21.15.60:0/3928401811 conn(0x7f756c0c0860 msgr2=0x7f756c143bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:29.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:29.114+0000 7f7570f27700 1 -- 172.21.15.60:0/3928401811 shutdown_connections 2023-07-12T02:02:29.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:29.114+0000 7f7570f27700 1 -- 172.21.15.60:0/3928401811 wait complete. 2023-07-12T02:02:29.129 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-12T02:02:29.129 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-12T02:02:29.130 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi174.front.sepia.ceph.com 2023-07-12T02:02:29.130 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-12T02:02:29.130 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-12T02:02:29.130 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-12T02:02:29.130 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-12T02:02:29.131 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-12T02:02:29.131 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-12T02:02:29.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:02:29.131 DEBUG:teuthology.orchestra.run.smithi174:> ip addr 2023-07-12T02:02:29.178 INFO:teuthology.orchestra.run.smithi174.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-12T02:02:29.179 INFO:teuthology.orchestra.run.smithi174.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-12T02:02:29.179 INFO:teuthology.orchestra.run.smithi174.stdout: inet 127.0.0.1/8 scope host lo 2023-07-12T02:02:29.179 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:02:29.180 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 ::1/128 scope host 2023-07-12T02:02:29.180 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:02:29.180 INFO:teuthology.orchestra.run.smithi174.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-12T02:02:29.180 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:d9:36:e0 brd ff:ff:ff:ff:ff:ff 2023-07-12T02:02:29.180 INFO:teuthology.orchestra.run.smithi174.stdout: altname enp7s0f0 2023-07-12T02:02:29.180 INFO:teuthology.orchestra.run.smithi174.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-12T02:02:29.180 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:d9:36:e1 brd ff:ff:ff:ff:ff:ff 2023-07-12T02:02:29.181 INFO:teuthology.orchestra.run.smithi174.stdout: altname enp7s0f1 2023-07-12T02:02:29.181 INFO:teuthology.orchestra.run.smithi174.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-12T02:02:29.181 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:88:77:1a brd ff:ff:ff:ff:ff:ff 2023-07-12T02:02:29.181 INFO:teuthology.orchestra.run.smithi174.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-12T02:02:29.181 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:88:77:1b brd ff:ff:ff:ff:ff:ff 2023-07-12T02:02:29.181 INFO:teuthology.orchestra.run.smithi174.stdout: inet 172.21.15.174/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-12T02:02:29.181 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft 41930sec preferred_lft 41930sec 2023-07-12T02:02:29.181 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::ec4:7aff:fe88:771b/64 scope link 2023-07-12T02:02:29.182 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:02:29.182 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-12T02:02:29.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:02:29.183 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec bash -c ' 2023-07-12T02:02:29.183 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2023-07-12T02:02:29.184 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link add name ceph-brx type bridge 2023-07-12T02:02:29.184 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip addr flush dev ceph-brx 2023-07-12T02:02:29.184 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link set ceph-brx up 2023-07-12T02:02:29.184 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-12T02:02:29.184 DEBUG:teuthology.orchestra.run.smithi174:> ') 2023-07-12T02:02:29.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:02:29.594 DEBUG:teuthology.orchestra.run.smithi174:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-12T02:02:29.695 INFO:teuthology.orchestra.run.smithi174.stdout:1 2023-07-12T02:02:29.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:02:29.698 DEBUG:teuthology.orchestra.run.smithi174:> route 2023-07-12T02:02:29.767 INFO:teuthology.orchestra.run.smithi174.stdout:Kernel IP routing table 2023-07-12T02:02:29.767 INFO:teuthology.orchestra.run.smithi174.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-12T02:02:29.767 INFO:teuthology.orchestra.run.smithi174.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-12T02:02:29.767 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-12T02:02:29.768 INFO:teuthology.orchestra.run.smithi174.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-12T02:02:29.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:02:29.769 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec bash -c ' 2023-07-12T02:02:29.769 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2023-07-12T02:02:29.770 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-12T02:02:29.770 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-12T02:02:29.770 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-12T02:02:29.770 DEBUG:teuthology.orchestra.run.smithi174:> ') 2023-07-12T02:02:30.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:02:30.449 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list 2023-07-12T02:02:30.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:02:30.495 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list-id 2023-07-12T02:02:30.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:02:30.581 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec bash -c ' 2023-07-12T02:02:30.581 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2023-07-12T02:02:30.581 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-12T02:02:30.581 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-07-12T02:02:30.582 DEBUG:teuthology.orchestra.run.smithi174:> ') 2023-07-12T02:02:30.721 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-07-12T02:02:30.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:02:30.721 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec bash -c ' 2023-07-12T02:02:30.722 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2023-07-12T02:02:30.722 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-07-12T02:02:30.722 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-12T02:02:30.722 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-07-12T02:02:30.723 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-07-12T02:02:30.723 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-07-12T02:02:30.723 DEBUG:teuthology.orchestra.run.smithi174:> ') 2023-07-12T02:02:30.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:02:30.987 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec bash -c ' 2023-07-12T02:02:30.988 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2023-07-12T02:02:30.988 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link set brx.0 up 2023-07-12T02:02:30.988 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link set dev brx.0 master ceph-brx 2023-07-12T02:02:30.988 DEBUG:teuthology.orchestra.run.smithi174:> ') 2023-07-12T02:02:31.165 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-12T02:02:31.165 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-12T02:02:31.210 INFO:teuthology.orchestra.run.smithi174.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-12T02:02:31.210 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-12T02:02:31.211 DEBUG:teuthology.orchestra.run.smithi174:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-12T02:02:31.294 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-12T02:02:31.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:02:31.294 DEBUG:teuthology.orchestra.run.smithi174:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-12T02:02:31.437 INFO:teuthology.orchestra.run.smithi174.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-12T02:02:31.437 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-12T02:02:31.438 INFO:teuthology.orchestra.run.smithi174.stdout:invalid new device string format 2023-07-12T02:02:31.865 INFO:teuthology.orchestra.run.smithi174.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-12T02:02:31.865 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-12T02:02:31.865 INFO:teuthology.orchestra.run.smithi174.stdout:invalid new device string format 2023-07-12T02:02:31.866 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.79:3300,172.21.15.79:3301" 2023-07-12T02:02:31.866 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-12T02:02:31.890 INFO:teuthology.orchestra.run.smithi174.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-12T02:02:31.891 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-12T02:02:31.891 INFO:teuthology.orchestra.run.smithi174.stdout:invalid new device string format 2023-07-12T02:02:31.891 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.79:3300,172.21.15.79:3301" 2023-07-12T02:02:31.891 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-12T02:02:31.891 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: resolved to: "172.21.15.60:6789,172.21.15.79:6789,172.21.15.79:6790" 2023-07-12T02:02:31.892 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.60:6789,172.21.15.79:6789,172.21.15.79:6790:/ 2023-07-12T02:02:31.892 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=97e7c909-e567-472e-a5aa-72fde15171f2" will pass to kernel 2023-07-12T02:02:31.896 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-12T02:02:31.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:02:31.896 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-12T02:02:31.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:02:31.967 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-12T02:02:32.083 INFO:teuthology.orchestra.run.smithi174.stdout:client4502 2023-07-12T02:02:32.083 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-07-12T02:02:32.084 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-12T02:02:32.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:02:32.129 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-12T02:02:32.275 INFO:teuthology.orchestra.run.smithi174.stdout:client4502 2023-07-12T02:02:32.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:02:32.276 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-12T02:02:32.382 INFO:teuthology.orchestra.run.smithi174.stdout:client4502 2023-07-12T02:02:32.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:02:32.383 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/97e7c909-e567-472e-a5aa-72fde15171f2.client4502/status') 2023-07-12T02:02:32.489 INFO:teuthology.orchestra.run.smithi174.stdout:instance: client.4502 (3)172.21.15.174:0/1398930994 2023-07-12T02:02:32.490 INFO:teuthology.orchestra.run.smithi174.stdout:blocklisted: false 2023-07-12T02:02:32.490 INFO:teuthology.orchestra.run.smithi174.stderr:0+1 records in 2023-07-12T02:02:32.490 INFO:teuthology.orchestra.run.smithi174.stderr:0+1 records out 2023-07-12T02:02:32.490 INFO:teuthology.orchestra.run.smithi174.stderr:71 bytes copied, 4.9016e-05 s, 1.4 MB/s 2023-07-12T02:02:32.492 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-07-12T02:02:32.510 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:02:32.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.647+0000 7f8150570700 1 Processor -- start 2023-07-12T02:02:32.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.647+0000 7f8150570700 1 -- start start 2023-07-12T02:02:32.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.647+0000 7f8150570700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f81480bc810 0x7f81480ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:32.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.647+0000 7f8150570700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f81480b8d90 0x7f814806ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:32.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.647+0000 7f8150570700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81480b8620 con 0x7f81481449d0 2023-07-12T02:02:32.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.647+0000 7f8150570700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81480b97a0 con 0x7f81480bc810 2023-07-12T02:02:32.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.647+0000 7f8150570700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8148144da0 con 0x7f81480b8d90 2023-07-12T02:02:32.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.648+0000 7f814db0b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f81480bc810 0x7f81480ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:32.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.648+0000 7f814e30c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f81481449d0 0x7f814814db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49566/0 (socket says 172.21.15.60:49566) 2023-07-12T02:02:32.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.648+0000 7f814db0b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f81480bc810 0x7f81480ba530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47172/0 (socket says 172.21.15.60:47172) 2023-07-12T02:02:32.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.648+0000 7f814e30c700 1 -- 172.21.15.60:0/2517997103 learned_addr learned my addr 172.21.15.60:0/2517997103 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:32.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.648+0000 7f814eb0d700 1 --2- 172.21.15.60:0/2517997103 >> v2:172.21.15.79:3300/0 conn(0x7f81480b8d90 0x7f814806ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:32.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.648+0000 7f814db0b700 1 -- 172.21.15.60:0/2517997103 >> v2:172.21.15.79:3300/0 conn(0x7f81480b8d90 msgr2=0x7f814806ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:32.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.648+0000 7f814db0b700 1 --2- 172.21.15.60:0/2517997103 >> v2:172.21.15.79:3300/0 conn(0x7f81480b8d90 0x7f814806ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:32.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.648+0000 7f814db0b700 1 -- 172.21.15.60:0/2517997103 >> v1:172.21.15.60:6789/0 conn(0x7f81481449d0 legacy=0x7f814814db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:32.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.648+0000 7f814db0b700 1 -- 172.21.15.60:0/2517997103 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81480b8900 con 0x7f81480bc810 2023-07-12T02:02:32.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.648+0000 7f814d30a700 1 -- 172.21.15.60:0/2517997103 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1472672106 0 0) 0x7f81480b8620 con 0x7f81481449d0 2023-07-12T02:02:32.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.648+0000 7f814eb0d700 1 --2- 172.21.15.60:0/2517997103 >> v2:172.21.15.79:3300/0 conn(0x7f81480b8d90 0x7f814806ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:32.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.648+0000 7f814db0b700 1 --2- 172.21.15.60:0/2517997103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81480bc810 0x7f81480ba530 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f81480be710 tx=0x7f8138009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=617ebc0b88ddea13 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:32.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.648+0000 7f814d30a700 1 -- 172.21.15.60:0/2517997103 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8138011830 con 0x7f81480bc810 2023-07-12T02:02:32.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.648+0000 7f814d30a700 1 -- 172.21.15.60:0/2517997103 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8138011990 con 0x7f81480bc810 2023-07-12T02:02:32.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.648+0000 7f814d30a700 1 -- 172.21.15.60:0/2517997103 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8138011d20 con 0x7f81480bc810 2023-07-12T02:02:32.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.649+0000 7f8150570700 1 -- 172.21.15.60:0/2517997103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81480bc810 msgr2=0x7f81480ba530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:32.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.649+0000 7f8150570700 1 --2- 172.21.15.60:0/2517997103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81480bc810 0x7f81480ba530 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f81480be710 tx=0x7f8138009b20 comp rx=0 tx=0).stop 2023-07-12T02:02:32.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.649+0000 7f8150570700 1 -- 172.21.15.60:0/2517997103 shutdown_connections 2023-07-12T02:02:32.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.649+0000 7f8150570700 1 --2- 172.21.15.60:0/2517997103 >> v2:172.21.15.79:3300/0 conn(0x7f81480b8d90 0x7f814806ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:32.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.649+0000 7f8150570700 1 --2- 172.21.15.60:0/2517997103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81480bc810 0x7f81480ba530 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:32.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.649+0000 7f8150570700 1 -- 172.21.15.60:0/2517997103 >> 172.21.15.60:0/2517997103 conn(0x7f81480c0860 msgr2=0x7f81480c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:32.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.649+0000 7f8150570700 1 -- 172.21.15.60:0/2517997103 shutdown_connections 2023-07-12T02:02:32.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.649+0000 7f8150570700 1 -- 172.21.15.60:0/2517997103 wait complete. 2023-07-12T02:02:32.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.650+0000 7f8150570700 1 Processor -- start 2023-07-12T02:02:32.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.651+0000 7f8150570700 1 -- start start 2023-07-12T02:02:32.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.651+0000 7f8150570700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81480b8d90 0x7f8148145160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:32.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.651+0000 7f8150570700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f81480bc810 0x7f81481df7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:32.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.651+0000 7f8150570700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81481449d0 0x7f81481dfd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:32.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.651+0000 7f8150570700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81481e2d20 con 0x7f81480b8d90 2023-07-12T02:02:32.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.651+0000 7f8150570700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81481e2f70 con 0x7f81481449d0 2023-07-12T02:02:32.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.651+0000 7f8150570700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81481e3250 con 0x7f81480bc810 2023-07-12T02:02:32.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.652+0000 7f814e30c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81480b8d90 0x7f8148145160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:32.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.652+0000 7f814e30c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81480b8d90 0x7f8148145160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47188/0 (socket says 172.21.15.60:47188) 2023-07-12T02:02:32.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.652+0000 7f814e30c700 1 -- 172.21.15.60:0/2071023427 learned_addr learned my addr 172.21.15.60:0/2071023427 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:32.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.652+0000 7f814eb0d700 1 --2- 172.21.15.60:0/2071023427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81481449d0 0x7f81481dfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:32.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.652+0000 7f814e30c700 1 -- 172.21.15.60:0/2071023427 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f81480bc810 msgr2=0x7f81481df7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:32.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.652+0000 7f814e30c700 1 --2- 172.21.15.60:0/2071023427 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f81480bc810 0x7f81481df7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:32.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.652+0000 7f814e30c700 1 -- 172.21.15.60:0/2071023427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81481449d0 msgr2=0x7f81481dfd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:32.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.652+0000 7f814e30c700 1 --2- 172.21.15.60:0/2071023427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81481449d0 0x7f81481dfd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:32.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.652+0000 7f814e30c700 1 -- 172.21.15.60:0/2071023427 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81380094a0 con 0x7f81480b8d90 2023-07-12T02:02:32.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.652+0000 7f814eb0d700 1 --2- 172.21.15.60:0/2071023427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81481449d0 0x7f81481dfd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:02:32.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.652+0000 7f814e30c700 1 --2- 172.21.15.60:0/2071023427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81480b8d90 0x7f8148145160 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f814400c550 tx=0x7f814400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:32.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.652+0000 7f813effd700 1 -- 172.21.15.60:0/2071023427 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8144004c80 con 0x7f81480b8d90 2023-07-12T02:02:32.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.652+0000 7f813effd700 1 -- 172.21.15.60:0/2071023427 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8144004e00 con 0x7f81480b8d90 2023-07-12T02:02:32.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.652+0000 7f813effd700 1 -- 172.21.15.60:0/2071023427 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8144007310 con 0x7f81480b8d90 2023-07-12T02:02:32.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.652+0000 7f8150570700 1 -- 172.21.15.60:0/2071023427 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81481e3530 con 0x7f81480b8d90 2023-07-12T02:02:32.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.652+0000 7f8150570700 1 -- 172.21.15.60:0/2071023427 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81480be760 con 0x7f81480b8d90 2023-07-12T02:02:32.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.653+0000 7f8150570700 1 -- 172.21.15.60:0/2071023427 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81481e3a50 con 0x7f81480b8d90 2023-07-12T02:02:32.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.654+0000 7f813effd700 1 -- 172.21.15.60:0/2071023427 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8144007470 con 0x7f81480b8d90 2023-07-12T02:02:32.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.654+0000 7f813effd700 1 --2- 172.21.15.60:0/2071023427 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f812c06ace0 0x7f812c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:32.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.654+0000 7f813effd700 1 -- 172.21.15.60:0/2071023427 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8144089140 con 0x7f81480b8d90 2023-07-12T02:02:32.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.654+0000 7f814db0b700 1 --2- 172.21.15.60:0/2071023427 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f812c06ace0 0x7f812c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:32.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.655+0000 7f814db0b700 1 --2- 172.21.15.60:0/2071023427 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f812c06ace0 0x7f812c06d190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f81480b3d60 tx=0x7f8138010000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:32.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.658+0000 7f813effd700 1 -- 172.21.15.60:0/2071023427 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f81481e3a50 con 0x7f81480b8d90 2023-07-12T02:02:32.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.860+0000 7f8150570700 1 -- 172.21.15.60:0/2071023427 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81481e3a50 con 0x7f81480b8d90 2023-07-12T02:02:32.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.861+0000 7f813effd700 1 -- 172.21.15.60:0/2071023427 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18173 (secure 0 0 0) 0x7f81481e3a50 con 0x7f81480b8d90 2023-07-12T02:02:32.865 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:02:32.865 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":21,"fsid":"97e7c909-e567-472e-a5aa-72fde15171f2","created":"2023-07-12T02:01:53.987086+0000","modified":"2023-07-12T02:02:14.307912+0000","last_up_change":"2023-07-12T02:02:04.031780+0000","last_in_change":"2023-07-12T02:01:56.538621+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-12T02:02:05.375042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-12T02:02:05.857441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:02:10.574633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-12T02:02:11.699872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ed8b71c2-3895-4952-a118-16ede0b4a98c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6801","nonce":2818935979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6803","nonce":2818935979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6807","nonce":2818935979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6805","nonce":2818935979}]},"public_addr":"172.21.15.60:6801/2818935979","cluster_addr":"172.21.15.60:6803/2818935979","heartbeat_back_addr":"172.21.15.60:6807/2818935979","heartbeat_front_addr":"172.21.15.60:6805/2818935979","state":["exists","up"]},{"osd":1,"uuid":"7cf4d354-78e0-43ce-8c09-4a7d2a0b57a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6817","nonce":1678864191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6819","nonce":1678864191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6823","nonce":1678864191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6821","nonce":1678864191}]},"public_addr":"172.21.15.60:6817/1678864191","cluster_addr":"172.21.15.60:6819/1678864191","heartbeat_back_addr":"172.21.15.60:6823/1678864191","heartbeat_front_addr":"172.21.15.60:6821/1678864191","state":["exists","up"]},{"osd":2,"uuid":"02c958b8-9599-4470-92cb-8f7018ec0189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6809","nonce":1459480680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6811","nonce":1459480680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6815","nonce":1459480680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6813","nonce":1459480680}]},"public_addr":"172.21.15.60:6809/1459480680","cluster_addr":"172.21.15.60:6811/1459480680","heartbeat_back_addr":"172.21.15.60:6815/1459480680","heartbeat_front_addr":"172.21.15.60:6813/1459480680","state":["exists","up"]},{"osd":3,"uuid":"bc300432-a228-4257-be5c-e42dd5f2015f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6825","nonce":3295100060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6827","nonce":3295100060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6831","nonce":3295100060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6829","nonce":3295100060}]},"public_addr":"172.21.15.60:6825/3295100060","cluster_addr":"172.21.15.60:6827/3295100060","heartbeat_back_addr":"172.21.15.60:6831/3295100060","heartbeat_front_addr":"172.21.15.60:6829/3295100060","state":["exists","up"]},{"osd":4,"uuid":"ad9f7dc4-7126-466d-a656-2844880c6060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6809","nonce":4127109138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6811","nonce":4127109138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6815","nonce":4127109138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6813","nonce":4127109138}]},"public_addr":"172.21.15.79:6809/4127109138","cluster_addr":"172.21.15.79:6811/4127109138","heartbeat_back_addr":"172.21.15.79:6815/4127109138","heartbeat_front_addr":"172.21.15.79:6813/4127109138","state":["exists","up"]},{"osd":5,"uuid":"e88d16ca-0b01-4ab9-8aa8-c4aff7f210f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6801","nonce":421449406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6803","nonce":421449406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6807","nonce":421449406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6805","nonce":421449406}]},"public_addr":"172.21.15.79:6801/421449406","cluster_addr":"172.21.15.79:6803/421449406","heartbeat_back_addr":"172.21.15.79:6807/421449406","heartbeat_front_addr":"172.21.15.79:6805/421449406","state":["exists","up"]},{"osd":6,"uuid":"6898cb84-56d1-48a9-bd45-97e4668e2fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6825","nonce":4144355139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6827","nonce":4144355139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6831","nonce":4144355139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6829","nonce":4144355139}]},"public_addr":"172.21.15.79:6825/4144355139","cluster_addr":"172.21.15.79:6827/4144355139","heartbeat_back_addr":"172.21.15.79:6831/4144355139","heartbeat_front_addr":"172.21.15.79:6829/4144355139","state":["exists","up"]},{"osd":7,"uuid":"65c10882-371e-4762-b384-9c3a48f332ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6817","nonce":2845223299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6819","nonce":2845223299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6823","nonce":2845223299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6821","nonce":2845223299}]},"public_addr":"172.21.15.79:6817/2845223299","cluster_addr":"172.21.15.79:6819/2845223299","heartbeat_back_addr":"172.21.15.79:6823/2845223299","heartbeat_front_addr":"172.21.15.79:6821/2845223299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.634716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.758349+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.728366+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.777395+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707262+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.649705+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.693021+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:02:32.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.863+0000 7f8150570700 1 -- 172.21.15.60:0/2071023427 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f812c06ace0 msgr2=0x7f812c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:32.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.863+0000 7f8150570700 1 --2- 172.21.15.60:0/2071023427 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f812c06ace0 0x7f812c06d190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f81480b3d60 tx=0x7f8138010000 comp rx=0 tx=0).stop 2023-07-12T02:02:32.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.864+0000 7f8150570700 1 -- 172.21.15.60:0/2071023427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81480b8d90 msgr2=0x7f8148145160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:32.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.864+0000 7f8150570700 1 --2- 172.21.15.60:0/2071023427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81480b8d90 0x7f8148145160 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f814400c550 tx=0x7f814400c910 comp rx=0 tx=0).stop 2023-07-12T02:02:32.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.864+0000 7f8150570700 1 -- 172.21.15.60:0/2071023427 shutdown_connections 2023-07-12T02:02:32.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.864+0000 7f8150570700 1 --2- 172.21.15.60:0/2071023427 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f812c06ace0 0x7f812c06d190 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:32.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.864+0000 7f8150570700 1 --2- 172.21.15.60:0/2071023427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81480b8d90 0x7f8148145160 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:32.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.864+0000 7f8150570700 1 --2- 172.21.15.60:0/2071023427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81481449d0 0x7f81481dfd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:32.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.864+0000 7f8150570700 1 --2- 172.21.15.60:0/2071023427 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f81480bc810 0x7f81481df7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:32.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.864+0000 7f8150570700 1 -- 172.21.15.60:0/2071023427 >> 172.21.15.60:0/2071023427 conn(0x7f81480c0860 msgr2=0x7f81480baeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:32.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.864+0000 7f8150570700 1 -- 172.21.15.60:0/2071023427 shutdown_connections 2023-07-12T02:02:32.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:32.864+0000 7f8150570700 1 -- 172.21.15.60:0/2071023427 wait complete. 2023-07-12T02:02:32.879 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-12T02:02:05.375042+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-12T02:02:05.857441+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-12T02:02:10.574633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-12T02:02:11.699872+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-12T02:02:32.880 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-12T02:02:33.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.005+0000 7f8b0849e700 1 Processor -- start 2023-07-12T02:02:33.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.005+0000 7f8b0849e700 1 -- start start 2023-07-12T02:02:33.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.005+0000 7f8b0849e700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b001449d0 0x7f8b0014db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:33.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.005+0000 7f8b0849e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8b000b8d90 0x7f8b0006ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:33.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.005+0000 7f8b0849e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b000b8620 con 0x7f8b000bc810 2023-07-12T02:02:33.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.005+0000 7f8b0849e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b000b97a0 con 0x7f8b000b8d90 2023-07-12T02:02:33.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.005+0000 7f8b0849e700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b00144da0 con 0x7f8b001449d0 2023-07-12T02:02:33.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.006+0000 7f8b05a39700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f8b000bc810 0x7f8b000ba530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49576/0 (socket says 172.21.15.60:49576) 2023-07-12T02:02:33.012 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.006+0000 7f8b05a39700 1 -- 172.21.15.60:0/1395656566 learned_addr learned my addr 172.21.15.60:0/1395656566 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:33.012 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.006+0000 7f8b0623a700 1 --2- 172.21.15.60:0/1395656566 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b001449d0 0x7f8b0014db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:33.012 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.006+0000 7f8b06a3b700 1 --2- 172.21.15.60:0/1395656566 >> v2:172.21.15.79:3300/0 conn(0x7f8b000b8d90 0x7f8b0006ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:33.012 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.006+0000 7f8b05238700 1 -- 172.21.15.60:0/1395656566 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2051946505 0 0) 0x7f8b000b8620 con 0x7f8b000bc810 2023-07-12T02:02:33.012 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.006+0000 7f8b05238700 1 -- 172.21.15.60:0/1395656566 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8aec0035b0 con 0x7f8b000bc810 2023-07-12T02:02:33.012 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.006+0000 7f8b05238700 1 -- 172.21.15.60:0/1395656566 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3386412389 0 0) 0x7f8aec0035b0 con 0x7f8b000bc810 2023-07-12T02:02:33.012 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.006+0000 7f8b05238700 1 -- 172.21.15.60:0/1395656566 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b001449d0 msgr2=0x7f8b0014db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:33.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.006+0000 7f8b05238700 1 --2- 172.21.15.60:0/1395656566 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b001449d0 0x7f8b0014db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:33.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.006+0000 7f8b05238700 1 -- 172.21.15.60:0/1395656566 >> v2:172.21.15.79:3300/0 conn(0x7f8b000b8d90 msgr2=0x7f8b0006ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:33.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.006+0000 7f8b05238700 1 --2- 172.21.15.60:0/1395656566 >> v2:172.21.15.79:3300/0 conn(0x7f8b000b8d90 0x7f8b0006ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:33.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.006+0000 7f8b05238700 1 -- 172.21.15.60:0/1395656566 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b000b8900 con 0x7f8b000bc810 2023-07-12T02:02:33.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.006+0000 7f8b05238700 1 -- 172.21.15.60:0/1395656566 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1141905739 0 0) 0x7f8af0001670 con 0x7f8b000bc810 2023-07-12T02:02:33.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.006+0000 7f8b05238700 1 -- 172.21.15.60:0/1395656566 >> v1:172.21.15.60:6789/0 conn(0x7f8b000bc810 legacy=0x7f8b000ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:33.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.006+0000 7f8b05238700 1 --2- 172.21.15.60:0/1395656566 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b001449d0 0x7f8aec003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:33.013 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.006+0000 7f8b05238700 1 --2- 172.21.15.60:0/1395656566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8aec003f80 0x7f8aec004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:33.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.006+0000 7f8b05238700 1 --2- 172.21.15.60:0/1395656566 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8aec004d90 0x7f8aec005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:33.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.006+0000 7f8b05238700 1 -- 172.21.15.60:0/1395656566 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b000b97a0 con 0x7f8aec004d90 2023-07-12T02:02:33.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.006+0000 7f8b05238700 1 -- 172.21.15.60:0/1395656566 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aec00ba10 con 0x7f8aec003f80 2023-07-12T02:02:33.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.006+0000 7f8b05238700 1 -- 172.21.15.60:0/1395656566 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aec00bb80 con 0x7f8b001449d0 2023-07-12T02:02:33.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.006+0000 7f8b06a3b700 1 --2- 172.21.15.60:0/1395656566 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8aec004d90 0x7f8aec005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:33.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.006+0000 7f8b0623a700 1 --2- 172.21.15.60:0/1395656566 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b001449d0 0x7f8aec003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:33.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.006+0000 7f8b05a39700 1 --2- 172.21.15.60:0/1395656566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8aec003f80 0x7f8aec004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:33.014 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.007+0000 7f8b06a3b700 1 -- 172.21.15.60:0/1395656566 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b001449d0 msgr2=0x7f8aec003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:33.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.007+0000 7f8b06a3b700 1 --2- 172.21.15.60:0/1395656566 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b001449d0 0x7f8aec003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:33.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.007+0000 7f8b06a3b700 1 -- 172.21.15.60:0/1395656566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8aec003f80 msgr2=0x7f8aec004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:33.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.007+0000 7f8b06a3b700 1 --2- 172.21.15.60:0/1395656566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8aec003f80 0x7f8aec004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:33.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.007+0000 7f8b06a3b700 1 -- 172.21.15.60:0/1395656566 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aec0035b0 con 0x7f8aec004d90 2023-07-12T02:02:33.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.007+0000 7f8b06a3b700 1 --2- 172.21.15.60:0/1395656566 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8aec004d90 0x7f8aec005200 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8af8009fc0 tx=0x7f8aec005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad2695d7cbd7973d server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:33.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.007+0000 7f8b05238700 1 -- 172.21.15.60:0/1395656566 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af800ec30 con 0x7f8aec004d90 2023-07-12T02:02:33.015 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.007+0000 7f8b05238700 1 -- 172.21.15.60:0/1395656566 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af800f040 con 0x7f8aec004d90 2023-07-12T02:02:33.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.007+0000 7f8b05238700 1 -- 172.21.15.60:0/1395656566 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af8014480 con 0x7f8aec004d90 2023-07-12T02:02:33.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.007+0000 7f8b0849e700 1 -- 172.21.15.60:0/1395656566 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8aec004d90 msgr2=0x7f8aec005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:33.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.007+0000 7f8b0849e700 1 --2- 172.21.15.60:0/1395656566 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8aec004d90 0x7f8aec005200 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8af8009fc0 tx=0x7f8aec005880 comp rx=0 tx=0).stop 2023-07-12T02:02:33.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.007+0000 7f8b06a3b700 1 -- 172.21.15.60:0/1395656566 reap_dead start 2023-07-12T02:02:33.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.007+0000 7f8b0849e700 1 -- 172.21.15.60:0/1395656566 shutdown_connections 2023-07-12T02:02:33.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.007+0000 7f8b0849e700 1 -- 172.21.15.60:0/1395656566 >> 172.21.15.60:0/1395656566 conn(0x7f8b000c0860 msgr2=0x7f8b000c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:33.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.008+0000 7f8b0849e700 1 -- 172.21.15.60:0/1395656566 shutdown_connections 2023-07-12T02:02:33.016 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.008+0000 7f8b0849e700 1 -- 172.21.15.60:0/1395656566 wait complete. 2023-07-12T02:02:33.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.009+0000 7f8b0849e700 1 Processor -- start 2023-07-12T02:02:33.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.009+0000 7f8b0849e700 1 -- start start 2023-07-12T02:02:33.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.009+0000 7f8b0849e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8aec004d90 0x7f8b000b3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:33.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.009+0000 7f8b0849e700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b000b1750 0x7f8b001e3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:33.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.009+0000 7f8b0849e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b000a5630 0x7f8b000a5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:33.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.009+0000 7f8b0849e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b000b4270 con 0x7f8aec004d90 2023-07-12T02:02:33.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.009+0000 7f8b0849e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b000b44b0 con 0x7f8b000a5630 2023-07-12T02:02:33.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.009+0000 7f8b0849e700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b000b2020 con 0x7f8b000b1750 2023-07-12T02:02:33.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.009+0000 7f8b0623a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8aec004d90 0x7f8b000b3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:33.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.009+0000 7f8b0623a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8aec004d90 0x7f8b000b3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47198/0 (socket says 172.21.15.60:47198) 2023-07-12T02:02:33.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.009+0000 7f8b0623a700 1 -- 172.21.15.60:0/1438793516 learned_addr learned my addr 172.21.15.60:0/1438793516 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:33.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.009+0000 7f8b06a3b700 1 --2- 172.21.15.60:0/1438793516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b000a5630 0x7f8b000a5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:33.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.009+0000 7f8b05a39700 1 --2- 172.21.15.60:0/1438793516 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b000b1750 0x7f8b001e3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:33.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.010+0000 7f8b0623a700 1 -- 172.21.15.60:0/1438793516 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b000b1750 msgr2=0x7f8b001e3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:33.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.010+0000 7f8b0623a700 1 --2- 172.21.15.60:0/1438793516 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b000b1750 0x7f8b001e3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:33.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.010+0000 7f8b0623a700 1 -- 172.21.15.60:0/1438793516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b000a5630 msgr2=0x7f8b000a5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:33.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.010+0000 7f8b0623a700 1 --2- 172.21.15.60:0/1438793516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b000a5630 0x7f8b000a5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:33.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.010+0000 7f8b0623a700 1 -- 172.21.15.60:0/1438793516 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b001e32c0 con 0x7f8aec004d90 2023-07-12T02:02:33.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.010+0000 7f8b0623a700 1 --2- 172.21.15.60:0/1438793516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8aec004d90 0x7f8b000b3d30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8afc011aa0 tx=0x7f8afc011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:33.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.010+0000 7f8af6ffd700 1 -- 172.21.15.60:0/1438793516 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc011ee0 con 0x7f8aec004d90 2023-07-12T02:02:33.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.010+0000 7f8af6ffd700 1 -- 172.21.15.60:0/1438793516 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8afc00f940 con 0x7f8aec004d90 2023-07-12T02:02:33.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.010+0000 7f8b0849e700 1 -- 172.21.15.60:0/1438793516 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b001e35a0 con 0x7f8aec004d90 2023-07-12T02:02:33.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.010+0000 7f8af6ffd700 1 -- 172.21.15.60:0/1438793516 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc00fcf0 con 0x7f8aec004d90 2023-07-12T02:02:33.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.010+0000 7f8b0849e700 1 -- 172.21.15.60:0/1438793516 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b00147c30 con 0x7f8aec004d90 2023-07-12T02:02:33.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.011+0000 7f8b0849e700 1 -- 172.21.15.60:0/1438793516 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b001e3910 con 0x7f8aec004d90 2023-07-12T02:02:33.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.011+0000 7f8af6ffd700 1 -- 172.21.15.60:0/1438793516 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8afc014440 con 0x7f8aec004d90 2023-07-12T02:02:33.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.012+0000 7f8af6ffd700 1 --2- 172.21.15.60:0/1438793516 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f8ae406ace0 0x7f8ae406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:33.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.012+0000 7f8af6ffd700 1 -- 172.21.15.60:0/1438793516 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8afc089b60 con 0x7f8aec004d90 2023-07-12T02:02:33.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.012+0000 7f8b05a39700 1 --2- 172.21.15.60:0/1438793516 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f8ae406ace0 0x7f8ae406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:33.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.012+0000 7f8b05a39700 1 --2- 172.21.15.60:0/1438793516 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f8ae406ace0 0x7f8ae406d190 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8b000bb700 tx=0x7f8af0007980 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:33.023 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.016+0000 7f8af6ffd700 1 -- 172.21.15.60:0/1438793516 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f8afc058760 con 0x7f8aec004d90 2023-07-12T02:02:33.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.211+0000 7f8b0849e700 1 -- 172.21.15.60:0/1438793516 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8b00074360 con 0x7f8aec004d90 2023-07-12T02:02:33.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.212+0000 7f8af6ffd700 1 -- 172.21.15.60:0/1438793516 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8afc0582f0 con 0x7f8aec004d90 2023-07-12T02:02:33.215 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2023-07-12T02:02:33.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.214+0000 7f8b0849e700 1 -- 172.21.15.60:0/1438793516 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f8ae406ace0 msgr2=0x7f8ae406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:33.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.214+0000 7f8b0849e700 1 --2- 172.21.15.60:0/1438793516 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f8ae406ace0 0x7f8ae406d190 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8b000bb700 tx=0x7f8af0007980 comp rx=0 tx=0).stop 2023-07-12T02:02:33.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.214+0000 7f8b0849e700 1 -- 172.21.15.60:0/1438793516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8aec004d90 msgr2=0x7f8b000b3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:33.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.214+0000 7f8b0849e700 1 --2- 172.21.15.60:0/1438793516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8aec004d90 0x7f8b000b3d30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8afc011aa0 tx=0x7f8afc011db0 comp rx=0 tx=0).stop 2023-07-12T02:02:33.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.214+0000 7f8b0849e700 1 -- 172.21.15.60:0/1438793516 shutdown_connections 2023-07-12T02:02:33.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.214+0000 7f8b0849e700 1 --2- 172.21.15.60:0/1438793516 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f8ae406ace0 0x7f8ae406d190 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:33.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.214+0000 7f8b0849e700 1 --2- 172.21.15.60:0/1438793516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8aec004d90 0x7f8b000b3d30 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:33.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.214+0000 7f8b0849e700 1 --2- 172.21.15.60:0/1438793516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b000a5630 0x7f8b000a5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:33.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.214+0000 7f8b0849e700 1 --2- 172.21.15.60:0/1438793516 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8b000b1750 0x7f8b001e3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:33.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.214+0000 7f8b0849e700 1 -- 172.21.15.60:0/1438793516 >> 172.21.15.60:0/1438793516 conn(0x7f8b000c0860 msgr2=0x7f8b000baeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:33.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.214+0000 7f8b0849e700 1 -- 172.21.15.60:0/1438793516 shutdown_connections 2023-07-12T02:02:33.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.214+0000 7f8b0849e700 1 -- 172.21.15.60:0/1438793516 wait complete. 2023-07-12T02:02:33.229 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-12T02:02:33.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.354+0000 7ffaac49b700 1 Processor -- start 2023-07-12T02:02:33.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.354+0000 7ffaac49b700 1 -- start start 2023-07-12T02:02:33.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.355+0000 7ffaac49b700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffaa41449d0 0x7ffaa414db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:33.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.355+0000 7ffaac49b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ffaa40bc810 0x7ffaa40ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:33.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.355+0000 7ffaac49b700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa40b8620 con 0x7ffaa40b8d90 2023-07-12T02:02:33.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.355+0000 7ffaac49b700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaa40b97a0 con 0x7ffaa40bc810 2023-07-12T02:02:33.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.355+0000 7ffaac49b700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa4144da0 con 0x7ffaa41449d0 2023-07-12T02:02:33.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.355+0000 7ffaaaa38700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ffaa40b8d90 0x7ffaa406ade0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49582/0 (socket says 172.21.15.60:49582) 2023-07-12T02:02:33.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.355+0000 7ffaaaa38700 1 -- 172.21.15.60:0/2151076982 learned_addr learned my addr 172.21.15.60:0/2151076982 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:33.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.355+0000 7ffaa9a36700 1 --2- 172.21.15.60:0/2151076982 >> v2:172.21.15.79:3300/0 conn(0x7ffaa40bc810 0x7ffaa40ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:33.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.355+0000 7ffaaa237700 1 --2- 172.21.15.60:0/2151076982 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffaa41449d0 0x7ffaa414db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:33.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.355+0000 7ffaa9235700 1 -- 172.21.15.60:0/2151076982 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3866489591 0 0) 0x7ffaa40b8620 con 0x7ffaa40b8d90 2023-07-12T02:02:33.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.355+0000 7ffaa9235700 1 -- 172.21.15.60:0/2151076982 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa900035b0 con 0x7ffaa40b8d90 2023-07-12T02:02:33.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.355+0000 7ffaa9235700 1 -- 172.21.15.60:0/2151076982 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1215435538 0 0) 0x7ffa900035b0 con 0x7ffaa40b8d90 2023-07-12T02:02:33.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.355+0000 7ffaa9235700 1 -- 172.21.15.60:0/2151076982 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffaa41449d0 msgr2=0x7ffaa414db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:33.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.355+0000 7ffaa9235700 1 --2- 172.21.15.60:0/2151076982 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffaa41449d0 0x7ffaa414db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:33.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.355+0000 7ffaa9235700 1 -- 172.21.15.60:0/2151076982 >> v2:172.21.15.79:3300/0 conn(0x7ffaa40bc810 msgr2=0x7ffaa40ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:33.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.355+0000 7ffaa9235700 1 --2- 172.21.15.60:0/2151076982 >> v2:172.21.15.79:3300/0 conn(0x7ffaa40bc810 0x7ffaa40ba530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:33.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.355+0000 7ffaa9235700 1 -- 172.21.15.60:0/2151076982 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa40b8900 con 0x7ffaa40b8d90 2023-07-12T02:02:33.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.355+0000 7ffaa9235700 1 -- 172.21.15.60:0/2151076982 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1141905739 0 0) 0x7ffa9c0019f0 con 0x7ffaa40b8d90 2023-07-12T02:02:33.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.356+0000 7ffaa9235700 1 -- 172.21.15.60:0/2151076982 >> v1:172.21.15.60:6789/0 conn(0x7ffaa40b8d90 legacy=0x7ffaa406ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:33.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.356+0000 7ffaa9235700 1 --2- 172.21.15.60:0/2151076982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa90003a00 0x7ffa90003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:33.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.356+0000 7ffaa9235700 1 --2- 172.21.15.60:0/2151076982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa90004850 0x7ffa90004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:33.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.356+0000 7ffaa9235700 1 --2- 172.21.15.60:0/2151076982 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffaa41449d0 0x7ffa90005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:33.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.356+0000 7ffaa9235700 1 -- 172.21.15.60:0/2151076982 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa40b97a0 con 0x7ffa90003a00 2023-07-12T02:02:33.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.356+0000 7ffaa9235700 1 -- 172.21.15.60:0/2151076982 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9000ba10 con 0x7ffa90004850 2023-07-12T02:02:33.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.356+0000 7ffaa9235700 1 -- 172.21.15.60:0/2151076982 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9000bb50 con 0x7ffaa41449d0 2023-07-12T02:02:33.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.356+0000 7ffaaa237700 1 --2- 172.21.15.60:0/2151076982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa90003a00 0x7ffa90003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:33.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.356+0000 7ffaaaa38700 1 --2- 172.21.15.60:0/2151076982 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffaa41449d0 0x7ffa90005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:33.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.356+0000 7ffaa9a36700 1 --2- 172.21.15.60:0/2151076982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa90004850 0x7ffa90004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:33.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.356+0000 7ffaaa237700 1 -- 172.21.15.60:0/2151076982 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffaa41449d0 msgr2=0x7ffa90005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:33.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.356+0000 7ffaaa237700 1 --2- 172.21.15.60:0/2151076982 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffaa41449d0 0x7ffa90005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:33.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.356+0000 7ffaaa237700 1 -- 172.21.15.60:0/2151076982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa90004850 msgr2=0x7ffa90004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:33.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.356+0000 7ffaaa237700 1 --2- 172.21.15.60:0/2151076982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa90004850 0x7ffa90004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:33.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.356+0000 7ffaaa237700 1 -- 172.21.15.60:0/2151076982 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa900035b0 con 0x7ffa90003a00 2023-07-12T02:02:33.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.356+0000 7ffaaa237700 1 --2- 172.21.15.60:0/2151076982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa90003a00 0x7ffa90003e10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ffa94009b60 tx=0x7ffa90005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4c00f67276b905 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:33.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.356+0000 7ffaa9235700 1 -- 172.21.15.60:0/2151076982 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9400e6c0 con 0x7ffa90003a00 2023-07-12T02:02:33.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.356+0000 7ffaa9235700 1 -- 172.21.15.60:0/2151076982 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9400e820 con 0x7ffa90003a00 2023-07-12T02:02:33.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.356+0000 7ffaa9235700 1 -- 172.21.15.60:0/2151076982 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9400eb90 con 0x7ffa90003a00 2023-07-12T02:02:33.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.357+0000 7ffaac49b700 1 -- 172.21.15.60:0/2151076982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa90003a00 msgr2=0x7ffa90003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:33.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.357+0000 7ffaac49b700 1 --2- 172.21.15.60:0/2151076982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa90003a00 0x7ffa90003e10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ffa94009b60 tx=0x7ffa90005880 comp rx=0 tx=0).stop 2023-07-12T02:02:33.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.357+0000 7ffaaaa38700 1 -- 172.21.15.60:0/2151076982 reap_dead start 2023-07-12T02:02:33.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.357+0000 7ffaac49b700 1 -- 172.21.15.60:0/2151076982 shutdown_connections 2023-07-12T02:02:33.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.357+0000 7ffaac49b700 1 -- 172.21.15.60:0/2151076982 >> 172.21.15.60:0/2151076982 conn(0x7ffaa40c0860 msgr2=0x7ffaa40c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:33.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.357+0000 7ffaac49b700 1 -- 172.21.15.60:0/2151076982 shutdown_connections 2023-07-12T02:02:33.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.357+0000 7ffaac49b700 1 -- 172.21.15.60:0/2151076982 wait complete. 2023-07-12T02:02:33.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.358+0000 7ffaac49b700 1 Processor -- start 2023-07-12T02:02:33.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.358+0000 7ffaac49b700 1 -- start start 2023-07-12T02:02:33.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.359+0000 7ffaac49b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa90003a00 0x7ffaa4146b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:33.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.359+0000 7ffaac49b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffaa40be9d0 0x7ffaa4145380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:33.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.359+0000 7ffaac49b700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffaa41458c0 0x7ffaa40b2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:33.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.359+0000 7ffaac49b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa414b540 con 0x7ffa90003a00 2023-07-12T02:02:33.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.359+0000 7ffaac49b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa4144ef0 con 0x7ffaa40be9d0 2023-07-12T02:02:33.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.359+0000 7ffaac49b700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa414b750 con 0x7ffaa41458c0 2023-07-12T02:02:33.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.359+0000 7ffaaa237700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa90003a00 0x7ffaa4146b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:33.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.359+0000 7ffaaa237700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa90003a00 0x7ffaa4146b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47214/0 (socket says 172.21.15.60:47214) 2023-07-12T02:02:33.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.359+0000 7ffaaa237700 1 -- 172.21.15.60:0/205110425 learned_addr learned my addr 172.21.15.60:0/205110425 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:33.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.359+0000 7ffaaaa38700 1 --2- 172.21.15.60:0/205110425 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffaa41458c0 0x7ffaa40b2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:33.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.359+0000 7ffaa9a36700 1 --2- 172.21.15.60:0/205110425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffaa40be9d0 0x7ffaa4145380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:33.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.360+0000 7ffaaa237700 1 -- 172.21.15.60:0/205110425 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffaa41458c0 msgr2=0x7ffaa40b2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:33.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.360+0000 7ffaaa237700 1 --2- 172.21.15.60:0/205110425 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffaa41458c0 0x7ffaa40b2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:33.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.360+0000 7ffaaa237700 1 -- 172.21.15.60:0/205110425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffaa40be9d0 msgr2=0x7ffaa4145380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:33.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.360+0000 7ffaaa237700 1 --2- 172.21.15.60:0/205110425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffaa40be9d0 0x7ffaa4145380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:33.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.360+0000 7ffaaa237700 1 -- 172.21.15.60:0/205110425 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa4145d30 con 0x7ffa90003a00 2023-07-12T02:02:33.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.360+0000 7ffaaa237700 1 --2- 172.21.15.60:0/205110425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa90003a00 0x7ffaa4146b10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ffa90004750 tx=0x7ffa940047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:33.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.360+0000 7ffa9affd700 1 -- 172.21.15.60:0/205110425 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9400e6c0 con 0x7ffa90003a00 2023-07-12T02:02:33.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.360+0000 7ffa9affd700 1 -- 172.21.15.60:0/205110425 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa940038c0 con 0x7ffa90003a00 2023-07-12T02:02:33.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.360+0000 7ffaac49b700 1 -- 172.21.15.60:0/205110425 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa40bee40 con 0x7ffa90003a00 2023-07-12T02:02:33.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.360+0000 7ffa9affd700 1 -- 172.21.15.60:0/205110425 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa94003c70 con 0x7ffa90003a00 2023-07-12T02:02:33.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.360+0000 7ffaac49b700 1 -- 172.21.15.60:0/205110425 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa4147d10 con 0x7ffa90003a00 2023-07-12T02:02:33.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.361+0000 7ffaac49b700 1 -- 172.21.15.60:0/205110425 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaa414b540 con 0x7ffa90003a00 2023-07-12T02:02:33.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.361+0000 7ffa9affd700 1 -- 172.21.15.60:0/205110425 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffa94013470 con 0x7ffa90003a00 2023-07-12T02:02:33.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.362+0000 7ffa9affd700 1 --2- 172.21.15.60:0/205110425 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ffa8806ace0 0x7ffa8806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:33.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.362+0000 7ffa9affd700 1 -- 172.21.15.60:0/205110425 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffa9408acf0 con 0x7ffa90003a00 2023-07-12T02:02:33.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.362+0000 7ffaa9a36700 1 --2- 172.21.15.60:0/205110425 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ffa8806ace0 0x7ffa8806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:33.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.362+0000 7ffaa9a36700 1 --2- 172.21.15.60:0/205110425 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ffa8806ace0 0x7ffa8806d190 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ffaa40b40b0 tx=0x7ffaa0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:33.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.366+0000 7ffa9affd700 1 -- 172.21.15.60:0/205110425 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7ffa94055e30 con 0x7ffa90003a00 2023-07-12T02:02:33.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.559+0000 7ffaac49b700 1 -- 172.21.15.60:0/205110425 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffaa4074360 con 0x7ffa90003a00 2023-07-12T02:02:33.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.560+0000 7ffa9affd700 1 -- 172.21.15.60:0/205110425 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffa94059450 con 0x7ffa90003a00 2023-07-12T02:02:33.563 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-07-12T02:02:33.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.562+0000 7ffaac49b700 1 -- 172.21.15.60:0/205110425 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ffa8806ace0 msgr2=0x7ffa8806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:33.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.562+0000 7ffaac49b700 1 --2- 172.21.15.60:0/205110425 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ffa8806ace0 0x7ffa8806d190 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ffaa40b40b0 tx=0x7ffaa0008040 comp rx=0 tx=0).stop 2023-07-12T02:02:33.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.562+0000 7ffaac49b700 1 -- 172.21.15.60:0/205110425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa90003a00 msgr2=0x7ffaa4146b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:33.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.562+0000 7ffaac49b700 1 --2- 172.21.15.60:0/205110425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa90003a00 0x7ffaa4146b10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ffa90004750 tx=0x7ffa940047c0 comp rx=0 tx=0).stop 2023-07-12T02:02:33.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.562+0000 7ffaac49b700 1 -- 172.21.15.60:0/205110425 shutdown_connections 2023-07-12T02:02:33.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.562+0000 7ffaac49b700 1 --2- 172.21.15.60:0/205110425 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ffa8806ace0 0x7ffa8806d190 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:33.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.562+0000 7ffaac49b700 1 --2- 172.21.15.60:0/205110425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa90003a00 0x7ffaa4146b10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:33.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.562+0000 7ffaac49b700 1 --2- 172.21.15.60:0/205110425 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffaa41458c0 0x7ffaa40b2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:33.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.562+0000 7ffaac49b700 1 --2- 172.21.15.60:0/205110425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffaa40be9d0 0x7ffaa4145380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:33.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.562+0000 7ffaac49b700 1 -- 172.21.15.60:0/205110425 >> 172.21.15.60:0/205110425 conn(0x7ffaa40c0860 msgr2=0x7ffaa4142150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:33.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.562+0000 7ffaac49b700 1 -- 172.21.15.60:0/205110425 shutdown_connections 2023-07-12T02:02:33.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.562+0000 7ffaac49b700 1 -- 172.21.15.60:0/205110425 wait complete. 2023-07-12T02:02:33.577 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-12T02:02:33.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.703+0000 7fbecee7e700 1 Processor -- start 2023-07-12T02:02:33.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.703+0000 7fbecee7e700 1 -- start start 2023-07-12T02:02:33.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.703+0000 7fbecee7e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbec806b120 0x7fbec80b8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:33.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.703+0000 7fbecee7e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbec814aa40 0x7fbec814aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:33.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.703+0000 7fbecee7e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbec8070410 con 0x7fbec81444c0 2023-07-12T02:02:33.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.703+0000 7fbecee7e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbec80b9590 con 0x7fbec814aa40 2023-07-12T02:02:33.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.703+0000 7fbecee7e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbec814b400 con 0x7fbec806b120 2023-07-12T02:02:33.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.704+0000 7fbec7fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbec814aa40 0x7fbec814aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:33.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.704+0000 7fbecd41b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fbec81444c0 0x7fbec81448e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49594/0 (socket says 172.21.15.60:49594) 2023-07-12T02:02:33.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.704+0000 7fbecd41b700 1 -- 172.21.15.60:0/3090624184 learned_addr learned my addr 172.21.15.60:0/3090624184 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:33.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.704+0000 7fbeccc1a700 1 --2- 172.21.15.60:0/3090624184 >> v2:172.21.15.79:3300/0 conn(0x7fbec806b120 0x7fbec80b8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:33.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.704+0000 7fbec7fff700 1 -- 172.21.15.60:0/3090624184 >> v2:172.21.15.79:3300/0 conn(0x7fbec806b120 msgr2=0x7fbec80b8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:33.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.704+0000 7fbec7fff700 1 --2- 172.21.15.60:0/3090624184 >> v2:172.21.15.79:3300/0 conn(0x7fbec806b120 0x7fbec80b8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:33.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.704+0000 7fbec7fff700 1 -- 172.21.15.60:0/3090624184 >> v1:172.21.15.60:6789/0 conn(0x7fbec81444c0 legacy=0x7fbec81448e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:33.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.704+0000 7fbec7fff700 1 -- 172.21.15.60:0/3090624184 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec806ef60 con 0x7fbec814aa40 2023-07-12T02:02:33.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.704+0000 7fbec77fe700 1 -- 172.21.15.60:0/3090624184 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 840923619 0 0) 0x7fbec8070410 con 0x7fbec81444c0 2023-07-12T02:02:33.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.704+0000 7fbec7fff700 1 --2- 172.21.15.60:0/3090624184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbec814aa40 0x7fbec814aec0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbec80672f0 tx=0x7fbeb4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39d1bc3009edb47b server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:33.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.704+0000 7fbec77fe700 1 -- 172.21.15.60:0/3090624184 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb4011830 con 0x7fbec814aa40 2023-07-12T02:02:33.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.704+0000 7fbec77fe700 1 -- 172.21.15.60:0/3090624184 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeb4011990 con 0x7fbec814aa40 2023-07-12T02:02:33.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.704+0000 7fbec77fe700 1 -- 172.21.15.60:0/3090624184 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb4011d20 con 0x7fbec814aa40 2023-07-12T02:02:33.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.705+0000 7fbecee7e700 1 -- 172.21.15.60:0/3090624184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbec814aa40 msgr2=0x7fbec814aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:33.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.705+0000 7fbecee7e700 1 --2- 172.21.15.60:0/3090624184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbec814aa40 0x7fbec814aec0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbec80672f0 tx=0x7fbeb4009b20 comp rx=0 tx=0).stop 2023-07-12T02:02:33.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.705+0000 7fbecee7e700 1 -- 172.21.15.60:0/3090624184 shutdown_connections 2023-07-12T02:02:33.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.705+0000 7fbecee7e700 1 --2- 172.21.15.60:0/3090624184 >> v2:172.21.15.79:3300/0 conn(0x7fbec806b120 0x7fbec80b8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:33.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.705+0000 7fbecee7e700 1 --2- 172.21.15.60:0/3090624184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbec814aa40 0x7fbec814aec0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:33.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.705+0000 7fbecee7e700 1 -- 172.21.15.60:0/3090624184 >> 172.21.15.60:0/3090624184 conn(0x7fbec80bd980 msgr2=0x7fbec80b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:33.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.705+0000 7fbecee7e700 1 -- 172.21.15.60:0/3090624184 shutdown_connections 2023-07-12T02:02:33.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.705+0000 7fbecee7e700 1 -- 172.21.15.60:0/3090624184 wait complete. 2023-07-12T02:02:33.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.706+0000 7fbecee7e700 1 Processor -- start 2023-07-12T02:02:33.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.706+0000 7fbecee7e700 1 -- start start 2023-07-12T02:02:33.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.707+0000 7fbecee7e700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbec806b120 0x7fbec813bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:33.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.707+0000 7fbecee7e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbec81444c0 0x7fbec81dfc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:33.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.707+0000 7fbecee7e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbec814aa40 0x7fbec81e3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:33.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.707+0000 7fbecee7e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec813d570 con 0x7fbec814aa40 2023-07-12T02:02:33.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.707+0000 7fbecee7e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec813c520 con 0x7fbec81444c0 2023-07-12T02:02:33.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.707+0000 7fbecee7e700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbec81433b0 con 0x7fbec806b120 2023-07-12T02:02:33.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.707+0000 7fbecd41b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbec814aa40 0x7fbec81e3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:33.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.707+0000 7fbecd41b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbec814aa40 0x7fbec81e3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47244/0 (socket says 172.21.15.60:47244) 2023-07-12T02:02:33.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.707+0000 7fbecd41b700 1 -- 172.21.15.60:0/3131794610 learned_addr learned my addr 172.21.15.60:0/3131794610 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:33.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.707+0000 7fbec7fff700 1 --2- 172.21.15.60:0/3131794610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbec81444c0 0x7fbec81dfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:33.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.707+0000 7fbeccc1a700 1 --2- 172.21.15.60:0/3131794610 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbec806b120 0x7fbec813bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:33.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.707+0000 7fbecd41b700 1 -- 172.21.15.60:0/3131794610 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbec806b120 msgr2=0x7fbec813bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:33.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.707+0000 7fbecd41b700 1 --2- 172.21.15.60:0/3131794610 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbec806b120 0x7fbec813bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:33.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.707+0000 7fbecd41b700 1 -- 172.21.15.60:0/3131794610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbec81444c0 msgr2=0x7fbec81dfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:33.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.707+0000 7fbecd41b700 1 --2- 172.21.15.60:0/3131794610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbec81444c0 0x7fbec81dfc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:33.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.707+0000 7fbecd41b700 1 -- 172.21.15.60:0/3131794610 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb40094a0 con 0x7fbec814aa40 2023-07-12T02:02:33.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.707+0000 7fbeccc1a700 1 --2- 172.21.15.60:0/3131794610 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbec806b120 0x7fbec813bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:33.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.707+0000 7fbecd41b700 1 --2- 172.21.15.60:0/3131794610 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbec814aa40 0x7fbec81e3140 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbec0002230 tx=0x7fbec000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:33.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.707+0000 7fbec57fa700 1 -- 172.21.15.60:0/3131794610 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec000ab70 con 0x7fbec814aa40 2023-07-12T02:02:33.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.707+0000 7fbec57fa700 1 -- 172.21.15.60:0/3131794610 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec000acf0 con 0x7fbec814aa40 2023-07-12T02:02:33.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.707+0000 7fbecee7e700 1 -- 172.21.15.60:0/3131794610 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbec813d200 con 0x7fbec814aa40 2023-07-12T02:02:33.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.707+0000 7fbec57fa700 1 -- 172.21.15.60:0/3131794610 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec0007310 con 0x7fbec814aa40 2023-07-12T02:02:33.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.707+0000 7fbecee7e700 1 -- 172.21.15.60:0/3131794610 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbec80b3b00 con 0x7fbec814aa40 2023-07-12T02:02:33.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.708+0000 7fbecee7e700 1 -- 172.21.15.60:0/3131794610 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbec813d060 con 0x7fbec814aa40 2023-07-12T02:02:33.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.709+0000 7fbec57fa700 1 -- 172.21.15.60:0/3131794610 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbec0007470 con 0x7fbec814aa40 2023-07-12T02:02:33.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.709+0000 7fbec57fa700 1 --2- 172.21.15.60:0/3131794610 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fbeac06ace0 0x7fbeac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:33.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.710+0000 7fbec57fa700 1 -- 172.21.15.60:0/3131794610 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbec0089250 con 0x7fbec814aa40 2023-07-12T02:02:33.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.710+0000 7fbeccc1a700 1 --2- 172.21.15.60:0/3131794610 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fbeac06ace0 0x7fbeac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:33.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.710+0000 7fbeccc1a700 1 --2- 172.21.15.60:0/3131794610 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fbeac06ace0 0x7fbeac06d190 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbebc0099f0 tx=0x7fbebc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:33.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.714+0000 7fbec57fa700 1 -- 172.21.15.60:0/3131794610 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fbec813d060 con 0x7fbec814aa40 2023-07-12T02:02:33.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.913+0000 7fbecee7e700 1 -- 172.21.15.60:0/3131794610 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbec813d060 con 0x7fbec814aa40 2023-07-12T02:02:33.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.913+0000 7fbec57fa700 1 -- 172.21.15.60:0/3131794610 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbec813d060 con 0x7fbec814aa40 2023-07-12T02:02:33.917 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-07-12T02:02:33.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.916+0000 7fbecee7e700 1 -- 172.21.15.60:0/3131794610 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fbeac06ace0 msgr2=0x7fbeac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:33.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.916+0000 7fbecee7e700 1 --2- 172.21.15.60:0/3131794610 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fbeac06ace0 0x7fbeac06d190 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbebc0099f0 tx=0x7fbebc008040 comp rx=0 tx=0).stop 2023-07-12T02:02:33.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.916+0000 7fbecee7e700 1 -- 172.21.15.60:0/3131794610 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbec814aa40 msgr2=0x7fbec81e3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:33.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.916+0000 7fbecee7e700 1 --2- 172.21.15.60:0/3131794610 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbec814aa40 0x7fbec81e3140 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbec0002230 tx=0x7fbec000cf50 comp rx=0 tx=0).stop 2023-07-12T02:02:33.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.916+0000 7fbecee7e700 1 -- 172.21.15.60:0/3131794610 shutdown_connections 2023-07-12T02:02:33.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.916+0000 7fbecee7e700 1 --2- 172.21.15.60:0/3131794610 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fbeac06ace0 0x7fbeac06d190 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:33.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.916+0000 7fbecee7e700 1 --2- 172.21.15.60:0/3131794610 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbec814aa40 0x7fbec81e3140 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:33.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.916+0000 7fbecee7e700 1 --2- 172.21.15.60:0/3131794610 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbec806b120 0x7fbec813bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:33.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.916+0000 7fbecee7e700 1 --2- 172.21.15.60:0/3131794610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbec81444c0 0x7fbec81dfc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:33.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.916+0000 7fbecee7e700 1 -- 172.21.15.60:0/3131794610 >> 172.21.15.60:0/3131794610 conn(0x7fbec80bd980 msgr2=0x7fbec80b96d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:33.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.916+0000 7fbecee7e700 1 -- 172.21.15.60:0/3131794610 shutdown_connections 2023-07-12T02:02:33.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:33.916+0000 7fbecee7e700 1 -- 172.21.15.60:0/3131794610 wait complete. 2023-07-12T02:02:33.931 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-12T02:02:34.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.057+0000 7f92b17a7700 1 Processor -- start 2023-07-12T02:02:34.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.057+0000 7f92b17a7700 1 -- start start 2023-07-12T02:02:34.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.057+0000 7f92b17a7700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f92ac1449d0 0x7f92ac14db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:34.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.057+0000 7f92b17a7700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92ac0b8620 con 0x7f92ac0bc810 2023-07-12T02:02:34.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.057+0000 7f92b17a7700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92ac0b8900 con 0x7f92ac0b8d90 2023-07-12T02:02:34.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.057+0000 7f92b17a7700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92ac0b97a0 con 0x7f92ac1449d0 2023-07-12T02:02:34.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.057+0000 7f92aaffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f92ac1449d0 0x7f92ac14db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:34.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.058+0000 7f92aa7fc700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f92ac0bc810 0x7f92ac0ba530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49608/0 (socket says 172.21.15.60:49608) 2023-07-12T02:02:34.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.058+0000 7f92aa7fc700 1 -- 172.21.15.60:0/2367012583 learned_addr learned my addr 172.21.15.60:0/2367012583 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:34.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.058+0000 7f92aaffd700 1 -- 172.21.15.60:0/2367012583 >> v1:172.21.15.79:6789/0 conn(0x7f92ac0b8d90 legacy=0x7f92ac06ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:34.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.058+0000 7f92aaffd700 1 -- 172.21.15.60:0/2367012583 >> v1:172.21.15.60:6789/0 conn(0x7f92ac0bc810 legacy=0x7f92ac0ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:34.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.058+0000 7f92aaffd700 1 -- 172.21.15.60:0/2367012583 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ac0bac40 con 0x7f92ac1449d0 2023-07-12T02:02:34.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.058+0000 7f92a9ffb700 1 -- 172.21.15.60:0/2367012583 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2315403973 0 0) 0x7f92ac0b8620 con 0x7f92ac0bc810 2023-07-12T02:02:34.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.058+0000 7f92aaffd700 1 --2- 172.21.15.60:0/2367012583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92ac1449d0 0x7f92ac14db50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f929c009840 tx=0x7f929c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d33c15c4ce99007 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:34.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.058+0000 7f92a9ffb700 1 -- 172.21.15.60:0/2367012583 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929c004230 con 0x7f92ac1449d0 2023-07-12T02:02:34.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.058+0000 7f92a9ffb700 1 -- 172.21.15.60:0/2367012583 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f929c004390 con 0x7f92ac1449d0 2023-07-12T02:02:34.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.058+0000 7f92a9ffb700 1 -- 172.21.15.60:0/2367012583 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929c0036a0 con 0x7f92ac1449d0 2023-07-12T02:02:34.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.059+0000 7f92b17a7700 1 -- 172.21.15.60:0/2367012583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92ac1449d0 msgr2=0x7f92ac14db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:34.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.059+0000 7f92b17a7700 1 --2- 172.21.15.60:0/2367012583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92ac1449d0 0x7f92ac14db50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f929c009840 tx=0x7f929c009b50 comp rx=0 tx=0).stop 2023-07-12T02:02:34.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.059+0000 7f92b17a7700 1 -- 172.21.15.60:0/2367012583 shutdown_connections 2023-07-12T02:02:34.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.059+0000 7f92b17a7700 1 --2- 172.21.15.60:0/2367012583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92ac1449d0 0x7f92ac14db50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:34.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.059+0000 7f92b17a7700 1 -- 172.21.15.60:0/2367012583 >> 172.21.15.60:0/2367012583 conn(0x7f92ac0c0860 msgr2=0x7f92ac0c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:34.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.059+0000 7f92b17a7700 1 -- 172.21.15.60:0/2367012583 shutdown_connections 2023-07-12T02:02:34.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.059+0000 7f92b17a7700 1 -- 172.21.15.60:0/2367012583 wait complete. 2023-07-12T02:02:34.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.060+0000 7f92b17a7700 1 Processor -- start 2023-07-12T02:02:34.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.060+0000 7f92b17a7700 1 -- start start 2023-07-12T02:02:34.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.060+0000 7f92b17a7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92ac0b8d90 0x7f92ac145ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:34.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.061+0000 7f92b17a7700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f92ac0bc810 0x7f92ac1469d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:34.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.061+0000 7f92b17a7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92ac1449d0 0x7f92ac147840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:34.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.061+0000 7f92b17a7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ac145630 con 0x7f92ac1449d0 2023-07-12T02:02:34.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.061+0000 7f92b17a7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ac145020 con 0x7f92ac0b8d90 2023-07-12T02:02:34.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.061+0000 7f92b17a7700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92ac1452c0 con 0x7f92ac0bc810 2023-07-12T02:02:34.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.061+0000 7f92ab7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92ac1449d0 0x7f92ac147840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:34.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.061+0000 7f92ab7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92ac1449d0 0x7f92ac147840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47262/0 (socket says 172.21.15.60:47262) 2023-07-12T02:02:34.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.061+0000 7f92ab7fe700 1 -- 172.21.15.60:0/2422738609 learned_addr learned my addr 172.21.15.60:0/2422738609 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:34.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.061+0000 7f92aaffd700 1 --2- 172.21.15.60:0/2422738609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92ac0b8d90 0x7f92ac145ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:34.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.061+0000 7f92aa7fc700 1 --2- 172.21.15.60:0/2422738609 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f92ac0bc810 0x7f92ac1469d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:34.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.061+0000 7f92ab7fe700 1 -- 172.21.15.60:0/2422738609 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f92ac0bc810 msgr2=0x7f92ac1469d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:34.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.061+0000 7f92ab7fe700 1 --2- 172.21.15.60:0/2422738609 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f92ac0bc810 0x7f92ac1469d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:34.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.061+0000 7f92ab7fe700 1 -- 172.21.15.60:0/2422738609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92ac0b8d90 msgr2=0x7f92ac145ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:34.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.061+0000 7f92ab7fe700 1 --2- 172.21.15.60:0/2422738609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92ac0b8d90 0x7f92ac145ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:34.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.061+0000 7f92ab7fe700 1 -- 172.21.15.60:0/2422738609 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f929c0094a0 con 0x7f92ac1449d0 2023-07-12T02:02:34.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.061+0000 7f92aa7fc700 1 --2- 172.21.15.60:0/2422738609 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f92ac0bc810 0x7f92ac1469d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:34.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.061+0000 7f92aaffd700 1 --2- 172.21.15.60:0/2422738609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92ac0b8d90 0x7f92ac145ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:34.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.061+0000 7f92ab7fe700 1 --2- 172.21.15.60:0/2422738609 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92ac1449d0 0x7f92ac147840 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f92a400b970 tx=0x7f92a400bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:34.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.061+0000 7f92937fe700 1 -- 172.21.15.60:0/2422738609 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a400c9b0 con 0x7f92ac1449d0 2023-07-12T02:02:34.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.061+0000 7f92937fe700 1 -- 172.21.15.60:0/2422738609 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a400cb10 con 0x7f92ac1449d0 2023-07-12T02:02:34.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.061+0000 7f92b17a7700 1 -- 172.21.15.60:0/2422738609 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92ac148310 con 0x7f92ac1449d0 2023-07-12T02:02:34.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.061+0000 7f92937fe700 1 -- 172.21.15.60:0/2422738609 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a4014440 con 0x7f92ac1449d0 2023-07-12T02:02:34.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.061+0000 7f92b17a7700 1 -- 172.21.15.60:0/2422738609 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92ac147d80 con 0x7f92ac1449d0 2023-07-12T02:02:34.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.062+0000 7f92b17a7700 1 -- 172.21.15.60:0/2422738609 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92ac1457a0 con 0x7f92ac1449d0 2023-07-12T02:02:34.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.063+0000 7f92937fe700 1 -- 172.21.15.60:0/2422738609 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f92a401d3b0 con 0x7f92ac1449d0 2023-07-12T02:02:34.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.063+0000 7f92937fe700 1 --2- 172.21.15.60:0/2422738609 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f929806ace0 0x7f929806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:34.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.063+0000 7f92937fe700 1 -- 172.21.15.60:0/2422738609 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f92a4089050 con 0x7f92ac1449d0 2023-07-12T02:02:34.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.063+0000 7f92aaffd700 1 --2- 172.21.15.60:0/2422738609 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f929806ace0 0x7f929806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:34.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.064+0000 7f92aaffd700 1 --2- 172.21.15.60:0/2422738609 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f929806ace0 0x7f929806d190 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f929c000c00 tx=0x7f929c01c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:34.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.068+0000 7f92937fe700 1 -- 172.21.15.60:0/2422738609 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f92a4054190 con 0x7f92ac1449d0 2023-07-12T02:02:34.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.262+0000 7f92b17a7700 1 -- 172.21.15.60:0/2422738609 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f92ac074360 con 0x7f92ac1449d0 2023-07-12T02:02:34.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.263+0000 7f92937fe700 1 -- 172.21.15.60:0/2422738609 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f92a40577b0 con 0x7f92ac1449d0 2023-07-12T02:02:34.266 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-07-12T02:02:34.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.264+0000 7f92b17a7700 1 -- 172.21.15.60:0/2422738609 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f929806ace0 msgr2=0x7f929806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:34.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.264+0000 7f92b17a7700 1 --2- 172.21.15.60:0/2422738609 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f929806ace0 0x7f929806d190 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f929c000c00 tx=0x7f929c01c040 comp rx=0 tx=0).stop 2023-07-12T02:02:34.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.264+0000 7f92b17a7700 1 -- 172.21.15.60:0/2422738609 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92ac1449d0 msgr2=0x7f92ac147840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:34.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.264+0000 7f92b17a7700 1 --2- 172.21.15.60:0/2422738609 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92ac1449d0 0x7f92ac147840 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f92a400b970 tx=0x7f92a400bd30 comp rx=0 tx=0).stop 2023-07-12T02:02:34.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.264+0000 7f92b17a7700 1 -- 172.21.15.60:0/2422738609 shutdown_connections 2023-07-12T02:02:34.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.264+0000 7f92b17a7700 1 --2- 172.21.15.60:0/2422738609 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f929806ace0 0x7f929806d190 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:34.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.264+0000 7f92b17a7700 1 --2- 172.21.15.60:0/2422738609 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92ac1449d0 0x7f92ac147840 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:34.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.264+0000 7f92b17a7700 1 --2- 172.21.15.60:0/2422738609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92ac0b8d90 0x7f92ac145ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:34.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.264+0000 7f92b17a7700 1 --2- 172.21.15.60:0/2422738609 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f92ac0bc810 0x7f92ac1469d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:34.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.265+0000 7f92b17a7700 1 -- 172.21.15.60:0/2422738609 >> 172.21.15.60:0/2422738609 conn(0x7f92ac0c0860 msgr2=0x7f92ac0bf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:34.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.265+0000 7f92b17a7700 1 -- 172.21.15.60:0/2422738609 shutdown_connections 2023-07-12T02:02:34.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.265+0000 7f92b17a7700 1 -- 172.21.15.60:0/2422738609 wait complete. 2023-07-12T02:02:34.280 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:02:34.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.403+0000 7fac49369700 1 Processor -- start 2023-07-12T02:02:34.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.403+0000 7fac49369700 1 -- start start 2023-07-12T02:02:34.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.404+0000 7fac49369700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fac44071840 0x7fac44156000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:34.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.404+0000 7fac49369700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac4406a640 con 0x7fac440721e0 2023-07-12T02:02:34.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.404+0000 7fac49369700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac4406f680 con 0x7fac44147dc0 2023-07-12T02:02:34.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.404+0000 7fac49369700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac44070950 con 0x7fac44071840 2023-07-12T02:02:34.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.404+0000 7fac437fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fac44071840 0x7fac44156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:34.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.404+0000 7fac427fc700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fac440721e0 0x7fac44071130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49612/0 (socket says 172.21.15.60:49612) 2023-07-12T02:02:34.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.404+0000 7fac427fc700 1 -- 172.21.15.60:0/1974337887 learned_addr learned my addr 172.21.15.60:0/1974337887 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:34.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.404+0000 7fac437fe700 1 -- 172.21.15.60:0/1974337887 >> v1:172.21.15.79:6789/0 conn(0x7fac44147dc0 legacy=0x7fac44069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:34.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.404+0000 7fac437fe700 1 -- 172.21.15.60:0/1974337887 >> v1:172.21.15.60:6789/0 conn(0x7fac440721e0 legacy=0x7fac44071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:34.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.404+0000 7fac437fe700 1 -- 172.21.15.60:0/1974337887 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac4406f920 con 0x7fac44071840 2023-07-12T02:02:34.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.404+0000 7fac437fe700 1 --2- 172.21.15.60:0/1974337887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac44071840 0x7fac44156000 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fac3c009d90 tx=0x7fac3c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4de6e830ad914606 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:34.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.404+0000 7fac41ffb700 1 -- 172.21.15.60:0/1974337887 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3c00e070 con 0x7fac44071840 2023-07-12T02:02:34.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.404+0000 7fac41ffb700 1 -- 172.21.15.60:0/1974337887 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac3c00bbd0 con 0x7fac44071840 2023-07-12T02:02:34.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.404+0000 7fac41ffb700 1 -- 172.21.15.60:0/1974337887 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3c012430 con 0x7fac44071840 2023-07-12T02:02:34.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.405+0000 7fac49369700 1 -- 172.21.15.60:0/1974337887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac44071840 msgr2=0x7fac44156000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:34.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.405+0000 7fac49369700 1 --2- 172.21.15.60:0/1974337887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac44071840 0x7fac44156000 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fac3c009d90 tx=0x7fac3c00b330 comp rx=0 tx=0).stop 2023-07-12T02:02:34.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.405+0000 7fac49369700 1 -- 172.21.15.60:0/1974337887 shutdown_connections 2023-07-12T02:02:34.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.405+0000 7fac49369700 1 --2- 172.21.15.60:0/1974337887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac44071840 0x7fac44156000 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:34.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.405+0000 7fac49369700 1 -- 172.21.15.60:0/1974337887 >> 172.21.15.60:0/1974337887 conn(0x7fac4406d0e0 msgr2=0x7fac4406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:34.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.405+0000 7fac49369700 1 -- 172.21.15.60:0/1974337887 shutdown_connections 2023-07-12T02:02:34.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.405+0000 7fac49369700 1 -- 172.21.15.60:0/1974337887 wait complete. 2023-07-12T02:02:34.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.406+0000 7fac49369700 1 Processor -- start 2023-07-12T02:02:34.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.406+0000 7fac49369700 1 -- start start 2023-07-12T02:02:34.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.407+0000 7fac49369700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fac44071840 0x7fac441404f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:34.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.407+0000 7fac49369700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac440721e0 0x7fac441dfec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:34.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.407+0000 7fac49369700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac44147dc0 0x7fac440b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:34.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.407+0000 7fac49369700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4413fdc0 con 0x7fac440721e0 2023-07-12T02:02:34.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.407+0000 7fac49369700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac441e0400 con 0x7fac44147dc0 2023-07-12T02:02:34.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.407+0000 7fac49369700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac440b6660 con 0x7fac44071840 2023-07-12T02:02:34.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.407+0000 7fac427fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac440721e0 0x7fac441dfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:34.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.407+0000 7fac427fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac440721e0 0x7fac441dfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47278/0 (socket says 172.21.15.60:47278) 2023-07-12T02:02:34.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.407+0000 7fac427fc700 1 -- 172.21.15.60:0/1444060107 learned_addr learned my addr 172.21.15.60:0/1444060107 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:34.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.407+0000 7fac437fe700 1 --2- 172.21.15.60:0/1444060107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac44147dc0 0x7fac440b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:34.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.407+0000 7fac42ffd700 1 --2- 172.21.15.60:0/1444060107 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fac44071840 0x7fac441404f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:34.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.407+0000 7fac427fc700 1 -- 172.21.15.60:0/1444060107 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fac44071840 msgr2=0x7fac441404f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:34.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.407+0000 7fac427fc700 1 --2- 172.21.15.60:0/1444060107 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fac44071840 0x7fac441404f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:34.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.407+0000 7fac427fc700 1 -- 172.21.15.60:0/1444060107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac44147dc0 msgr2=0x7fac440b6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:34.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.407+0000 7fac427fc700 1 --2- 172.21.15.60:0/1444060107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac44147dc0 0x7fac440b6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:34.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.407+0000 7fac427fc700 1 -- 172.21.15.60:0/1444060107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac3c009a70 con 0x7fac440721e0 2023-07-12T02:02:34.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.407+0000 7fac427fc700 1 --2- 172.21.15.60:0/1444060107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac440721e0 0x7fac441dfec0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fac3400c520 tx=0x7fac3400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:34.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.407+0000 7fac2b7fe700 1 -- 172.21.15.60:0/1444060107 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac34005d70 con 0x7fac440721e0 2023-07-12T02:02:34.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.407+0000 7fac2b7fe700 1 -- 172.21.15.60:0/1444060107 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac340070d0 con 0x7fac440721e0 2023-07-12T02:02:34.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.407+0000 7fac49369700 1 -- 172.21.15.60:0/1444060107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac440b7450 con 0x7fac440721e0 2023-07-12T02:02:34.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.407+0000 7fac2b7fe700 1 -- 172.21.15.60:0/1444060107 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac34007440 con 0x7fac440721e0 2023-07-12T02:02:34.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.407+0000 7fac49369700 1 -- 172.21.15.60:0/1444060107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac440b7070 con 0x7fac440721e0 2023-07-12T02:02:34.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.408+0000 7fac49369700 1 -- 172.21.15.60:0/1444060107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac44140210 con 0x7fac440721e0 2023-07-12T02:02:34.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.409+0000 7fac2b7fe700 1 -- 172.21.15.60:0/1444060107 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fac340075a0 con 0x7fac440721e0 2023-07-12T02:02:34.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.409+0000 7fac2b7fe700 1 --2- 172.21.15.60:0/1444060107 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fac3006ace0 0x7fac3006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:34.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.409+0000 7fac2b7fe700 1 -- 172.21.15.60:0/1444060107 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fac34088800 con 0x7fac440721e0 2023-07-12T02:02:34.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.409+0000 7fac42ffd700 1 --2- 172.21.15.60:0/1444060107 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fac3006ace0 0x7fac3006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:34.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.410+0000 7fac42ffd700 1 --2- 172.21.15.60:0/1444060107 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fac3006ace0 0x7fac3006d190 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fac38000f60 tx=0x7fac38009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:34.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.414+0000 7fac2b7fe700 1 -- 172.21.15.60:0/1444060107 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fac44140210 con 0x7fac440721e0 2023-07-12T02:02:34.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.612+0000 7fac49369700 1 -- 172.21.15.60:0/1444060107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac44140210 con 0x7fac440721e0 2023-07-12T02:02:34.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.613+0000 7fac2b7fe700 1 -- 172.21.15.60:0/1444060107 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18173 (secure 0 0 0) 0x7fac44140210 con 0x7fac440721e0 2023-07-12T02:02:34.617 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:02:34.617 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":21,"fsid":"97e7c909-e567-472e-a5aa-72fde15171f2","created":"2023-07-12T02:01:53.987086+0000","modified":"2023-07-12T02:02:14.307912+0000","last_up_change":"2023-07-12T02:02:04.031780+0000","last_in_change":"2023-07-12T02:01:56.538621+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-12T02:02:05.375042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-12T02:02:05.857441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:02:10.574633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-12T02:02:11.699872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ed8b71c2-3895-4952-a118-16ede0b4a98c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6801","nonce":2818935979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6803","nonce":2818935979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6807","nonce":2818935979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6805","nonce":2818935979}]},"public_addr":"172.21.15.60:6801/2818935979","cluster_addr":"172.21.15.60:6803/2818935979","heartbeat_back_addr":"172.21.15.60:6807/2818935979","heartbeat_front_addr":"172.21.15.60:6805/2818935979","state":["exists","up"]},{"osd":1,"uuid":"7cf4d354-78e0-43ce-8c09-4a7d2a0b57a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6817","nonce":1678864191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6819","nonce":1678864191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6823","nonce":1678864191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6821","nonce":1678864191}]},"public_addr":"172.21.15.60:6817/1678864191","cluster_addr":"172.21.15.60:6819/1678864191","heartbeat_back_addr":"172.21.15.60:6823/1678864191","heartbeat_front_addr":"172.21.15.60:6821/1678864191","state":["exists","up"]},{"osd":2,"uuid":"02c958b8-9599-4470-92cb-8f7018ec0189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6809","nonce":1459480680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6811","nonce":1459480680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6815","nonce":1459480680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6813","nonce":1459480680}]},"public_addr":"172.21.15.60:6809/1459480680","cluster_addr":"172.21.15.60:6811/1459480680","heartbeat_back_addr":"172.21.15.60:6815/1459480680","heartbeat_front_addr":"172.21.15.60:6813/1459480680","state":["exists","up"]},{"osd":3,"uuid":"bc300432-a228-4257-be5c-e42dd5f2015f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6825","nonce":3295100060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6827","nonce":3295100060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6831","nonce":3295100060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6829","nonce":3295100060}]},"public_addr":"172.21.15.60:6825/3295100060","cluster_addr":"172.21.15.60:6827/3295100060","heartbeat_back_addr":"172.21.15.60:6831/3295100060","heartbeat_front_addr":"172.21.15.60:6829/3295100060","state":["exists","up"]},{"osd":4,"uuid":"ad9f7dc4-7126-466d-a656-2844880c6060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6809","nonce":4127109138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6811","nonce":4127109138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6815","nonce":4127109138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6813","nonce":4127109138}]},"public_addr":"172.21.15.79:6809/4127109138","cluster_addr":"172.21.15.79:6811/4127109138","heartbeat_back_addr":"172.21.15.79:6815/4127109138","heartbeat_front_addr":"172.21.15.79:6813/4127109138","state":["exists","up"]},{"osd":5,"uuid":"e88d16ca-0b01-4ab9-8aa8-c4aff7f210f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6801","nonce":421449406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6803","nonce":421449406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6807","nonce":421449406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6805","nonce":421449406}]},"public_addr":"172.21.15.79:6801/421449406","cluster_addr":"172.21.15.79:6803/421449406","heartbeat_back_addr":"172.21.15.79:6807/421449406","heartbeat_front_addr":"172.21.15.79:6805/421449406","state":["exists","up"]},{"osd":6,"uuid":"6898cb84-56d1-48a9-bd45-97e4668e2fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6825","nonce":4144355139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6827","nonce":4144355139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6831","nonce":4144355139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6829","nonce":4144355139}]},"public_addr":"172.21.15.79:6825/4144355139","cluster_addr":"172.21.15.79:6827/4144355139","heartbeat_back_addr":"172.21.15.79:6831/4144355139","heartbeat_front_addr":"172.21.15.79:6829/4144355139","state":["exists","up"]},{"osd":7,"uuid":"65c10882-371e-4762-b384-9c3a48f332ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6817","nonce":2845223299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6819","nonce":2845223299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6823","nonce":2845223299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6821","nonce":2845223299}]},"public_addr":"172.21.15.79:6817/2845223299","cluster_addr":"172.21.15.79:6819/2845223299","heartbeat_back_addr":"172.21.15.79:6823/2845223299","heartbeat_front_addr":"172.21.15.79:6821/2845223299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.634716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.758349+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.728366+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.777395+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707262+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.649705+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.693021+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:02:34.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.615+0000 7fac49369700 1 -- 172.21.15.60:0/1444060107 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fac3006ace0 msgr2=0x7fac3006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:34.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.615+0000 7fac49369700 1 --2- 172.21.15.60:0/1444060107 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fac3006ace0 0x7fac3006d190 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fac38000f60 tx=0x7fac38009040 comp rx=0 tx=0).stop 2023-07-12T02:02:34.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.616+0000 7fac49369700 1 -- 172.21.15.60:0/1444060107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac440721e0 msgr2=0x7fac441dfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:34.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.616+0000 7fac49369700 1 --2- 172.21.15.60:0/1444060107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac440721e0 0x7fac441dfec0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fac3400c520 tx=0x7fac3400c8e0 comp rx=0 tx=0).stop 2023-07-12T02:02:34.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.616+0000 7fac49369700 1 -- 172.21.15.60:0/1444060107 shutdown_connections 2023-07-12T02:02:34.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.616+0000 7fac49369700 1 --2- 172.21.15.60:0/1444060107 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fac3006ace0 0x7fac3006d190 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:34.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.616+0000 7fac49369700 1 --2- 172.21.15.60:0/1444060107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac44147dc0 0x7fac440b6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:34.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.616+0000 7fac49369700 1 --2- 172.21.15.60:0/1444060107 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fac44071840 0x7fac441404f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:34.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.616+0000 7fac49369700 1 --2- 172.21.15.60:0/1444060107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac440721e0 0x7fac441dfec0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:34.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.616+0000 7fac49369700 1 -- 172.21.15.60:0/1444060107 >> 172.21.15.60:0/1444060107 conn(0x7fac4406d0e0 msgr2=0x7fac44143f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:34.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.616+0000 7fac49369700 1 -- 172.21.15.60:0/1444060107 shutdown_connections 2023-07-12T02:02:34.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.616+0000 7fac49369700 1 -- 172.21.15.60:0/1444060107 wait complete. 2023-07-12T02:02:34.631 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-12T02:02:05.375042+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-12T02:02:05.857441+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-12T02:02:10.574633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-12T02:02:11.699872+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-12T02:02:34.632 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-12T02:02:34.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.757+0000 7f9944e85700 1 Processor -- start 2023-07-12T02:02:34.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.757+0000 7f9944e85700 1 -- start start 2023-07-12T02:02:34.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.759+0000 7f9944e85700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9940071ab0 0x7f994006edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:34.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.759+0000 7f9944e85700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f994006f340 0x7f9940146b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:34.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.759+0000 7f9944e85700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99400b93e0 con 0x7f994006b120 2023-07-12T02:02:34.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.759+0000 7f9944e85700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9940071690 con 0x7f994006f340 2023-07-12T02:02:34.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.759+0000 7f9944e85700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f994006fe90 con 0x7f9940071ab0 2023-07-12T02:02:34.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.759+0000 7f993e59c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f994006b120 0x7f9940140af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49628/0 (socket says 172.21.15.60:49628) 2023-07-12T02:02:34.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.759+0000 7f993e59c700 1 -- 172.21.15.60:0/1442750900 learned_addr learned my addr 172.21.15.60:0/1442750900 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:34.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.759+0000 7f993ed9d700 1 --2- 172.21.15.60:0/1442750900 >> v2:172.21.15.60:3300/0 conn(0x7f994006f340 0x7f9940146b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:34.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.759+0000 7f993dd9b700 1 --2- 172.21.15.60:0/1442750900 >> v2:172.21.15.79:3300/0 conn(0x7f9940071ab0 0x7f994006edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:34.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.759+0000 7f993ed9d700 1 -- 172.21.15.60:0/1442750900 >> v2:172.21.15.79:3300/0 conn(0x7f9940071ab0 msgr2=0x7f994006edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:34.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.759+0000 7f993ed9d700 1 --2- 172.21.15.60:0/1442750900 >> v2:172.21.15.79:3300/0 conn(0x7f9940071ab0 0x7f994006edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:34.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.759+0000 7f993ed9d700 1 -- 172.21.15.60:0/1442750900 >> v1:172.21.15.60:6789/0 conn(0x7f994006b120 legacy=0x7f9940140af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:34.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.759+0000 7f993ed9d700 1 -- 172.21.15.60:0/1442750900 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9940147060 con 0x7f994006f340 2023-07-12T02:02:34.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.759+0000 7f993ed9d700 1 --2- 172.21.15.60:0/1442750900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f994006f340 0x7f9940146b20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9940070470 tx=0x7f993800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45b915915d8abd07 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:34.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.760+0000 7f993d59a700 1 -- 172.21.15.60:0/1442750900 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993800e070 con 0x7f994006f340 2023-07-12T02:02:34.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.760+0000 7f993d59a700 1 -- 172.21.15.60:0/1442750900 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993800bb20 con 0x7f994006f340 2023-07-12T02:02:34.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.760+0000 7f993d59a700 1 -- 172.21.15.60:0/1442750900 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9938012430 con 0x7f994006f340 2023-07-12T02:02:34.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.760+0000 7f9944e85700 1 -- 172.21.15.60:0/1442750900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f994006f340 msgr2=0x7f9940146b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:34.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.760+0000 7f9944e85700 1 --2- 172.21.15.60:0/1442750900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f994006f340 0x7f9940146b20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9940070470 tx=0x7f993800b330 comp rx=0 tx=0).stop 2023-07-12T02:02:34.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.760+0000 7f9944e85700 1 -- 172.21.15.60:0/1442750900 shutdown_connections 2023-07-12T02:02:34.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.760+0000 7f9944e85700 1 --2- 172.21.15.60:0/1442750900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f994006f340 0x7f9940146b20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:34.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.760+0000 7f9944e85700 1 --2- 172.21.15.60:0/1442750900 >> v2:172.21.15.79:3300/0 conn(0x7f9940071ab0 0x7f994006edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:34.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.760+0000 7f9944e85700 1 -- 172.21.15.60:0/1442750900 >> 172.21.15.60:0/1442750900 conn(0x7f99400bd980 msgr2=0x7f99400b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:34.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.760+0000 7f9944e85700 1 -- 172.21.15.60:0/1442750900 shutdown_connections 2023-07-12T02:02:34.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.760+0000 7f9944e85700 1 -- 172.21.15.60:0/1442750900 wait complete. 2023-07-12T02:02:34.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.762+0000 7f9944e85700 1 Processor -- start 2023-07-12T02:02:34.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.762+0000 7f9944e85700 1 -- start start 2023-07-12T02:02:34.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.762+0000 7f9944e85700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f994006b120 0x7f9940133160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:34.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.762+0000 7f9944e85700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f994006f340 0x7f99401e13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:34.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.762+0000 7f9944e85700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9940071ab0 0x7f99401525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:34.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.762+0000 7f9944e85700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99401336a0 con 0x7f994006b120 2023-07-12T02:02:34.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.762+0000 7f9944e85700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9940135e20 con 0x7f994006f340 2023-07-12T02:02:34.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.762+0000 7f9944e85700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99401350f0 con 0x7f9940071ab0 2023-07-12T02:02:34.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.762+0000 7f993e59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f994006b120 0x7f9940133160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:34.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.762+0000 7f993e59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f994006b120 0x7f9940133160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47292/0 (socket says 172.21.15.60:47292) 2023-07-12T02:02:34.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.762+0000 7f993e59c700 1 -- 172.21.15.60:0/708703160 learned_addr learned my addr 172.21.15.60:0/708703160 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:34.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.763+0000 7f993dd9b700 1 --2- 172.21.15.60:0/708703160 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f994006f340 0x7f99401e13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:34.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.763+0000 7f993ed9d700 1 --2- 172.21.15.60:0/708703160 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9940071ab0 0x7f99401525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:34.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.763+0000 7f993e59c700 1 -- 172.21.15.60:0/708703160 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9940071ab0 msgr2=0x7f99401525c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:34.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.763+0000 7f993e59c700 1 --2- 172.21.15.60:0/708703160 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9940071ab0 0x7f99401525c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:34.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.763+0000 7f993e59c700 1 -- 172.21.15.60:0/708703160 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f994006f340 msgr2=0x7f99401e13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:34.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.763+0000 7f993e59c700 1 --2- 172.21.15.60:0/708703160 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f994006f340 0x7f99401e13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:34.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.763+0000 7f993e59c700 1 -- 172.21.15.60:0/708703160 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9938009a70 con 0x7f994006b120 2023-07-12T02:02:34.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.763+0000 7f993e59c700 1 --2- 172.21.15.60:0/708703160 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f994006b120 0x7f9940133160 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f993000c550 tx=0x7f993000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:34.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.763+0000 7f992effd700 1 -- 172.21.15.60:0/708703160 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9930005d70 con 0x7f994006b120 2023-07-12T02:02:34.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.763+0000 7f992effd700 1 -- 172.21.15.60:0/708703160 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99300070d0 con 0x7f994006b120 2023-07-12T02:02:34.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.763+0000 7f9944e85700 1 -- 172.21.15.60:0/708703160 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99401343f0 con 0x7f994006b120 2023-07-12T02:02:34.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.763+0000 7f992effd700 1 -- 172.21.15.60:0/708703160 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9930007440 con 0x7f994006b120 2023-07-12T02:02:34.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.763+0000 7f9944e85700 1 -- 172.21.15.60:0/708703160 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99401e18e0 con 0x7f994006b120 2023-07-12T02:02:34.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.764+0000 7f9944e85700 1 -- 172.21.15.60:0/708703160 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9940074360 con 0x7f994006b120 2023-07-12T02:02:34.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.765+0000 7f992effd700 1 -- 172.21.15.60:0/708703160 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f99300075a0 con 0x7f994006b120 2023-07-12T02:02:34.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.765+0000 7f992effd700 1 --2- 172.21.15.60:0/708703160 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f992006ad10 0x7f992006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:34.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.765+0000 7f992effd700 1 -- 172.21.15.60:0/708703160 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f99300886e0 con 0x7f994006b120 2023-07-12T02:02:34.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.765+0000 7f993dd9b700 1 --2- 172.21.15.60:0/708703160 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f992006ad10 0x7f992006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:34.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.766+0000 7f993dd9b700 1 --2- 172.21.15.60:0/708703160 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f992006ad10 0x7f992006d1c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9940140630 tx=0x7f9934009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:34.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.770+0000 7f992effd700 1 -- 172.21.15.60:0/708703160 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f9930053840 con 0x7f994006b120 2023-07-12T02:02:34.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.966+0000 7f9944e85700 1 -- 172.21.15.60:0/708703160 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f994006f8a0 con 0x7f994006b120 2023-07-12T02:02:34.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.966+0000 7f992effd700 1 -- 172.21.15.60:0/708703160 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9930056e60 con 0x7f994006b120 2023-07-12T02:02:34.969 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2023-07-12T02:02:34.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.968+0000 7f9944e85700 1 -- 172.21.15.60:0/708703160 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f992006ad10 msgr2=0x7f992006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:34.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.968+0000 7f9944e85700 1 --2- 172.21.15.60:0/708703160 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f992006ad10 0x7f992006d1c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9940140630 tx=0x7f9934009210 comp rx=0 tx=0).stop 2023-07-12T02:02:34.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.968+0000 7f9944e85700 1 -- 172.21.15.60:0/708703160 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f994006b120 msgr2=0x7f9940133160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:34.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.968+0000 7f9944e85700 1 --2- 172.21.15.60:0/708703160 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f994006b120 0x7f9940133160 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f993000c550 tx=0x7f993000c860 comp rx=0 tx=0).stop 2023-07-12T02:02:34.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.968+0000 7f9944e85700 1 -- 172.21.15.60:0/708703160 shutdown_connections 2023-07-12T02:02:34.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.968+0000 7f9944e85700 1 --2- 172.21.15.60:0/708703160 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f992006ad10 0x7f992006d1c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:34.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.968+0000 7f9944e85700 1 --2- 172.21.15.60:0/708703160 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f994006b120 0x7f9940133160 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:34.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.968+0000 7f9944e85700 1 --2- 172.21.15.60:0/708703160 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9940071ab0 0x7f99401525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:34.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.968+0000 7f9944e85700 1 --2- 172.21.15.60:0/708703160 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f994006f340 0x7f99401e13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:34.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.968+0000 7f9944e85700 1 -- 172.21.15.60:0/708703160 >> 172.21.15.60:0/708703160 conn(0x7f99400bd980 msgr2=0x7f9940143cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:34.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.968+0000 7f9944e85700 1 -- 172.21.15.60:0/708703160 shutdown_connections 2023-07-12T02:02:34.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:34.968+0000 7f9944e85700 1 -- 172.21.15.60:0/708703160 wait complete. 2023-07-12T02:02:34.983 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-12T02:02:35.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.108+0000 7f02834ba700 1 Processor -- start 2023-07-12T02:02:35.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.108+0000 7f02834ba700 1 -- start start 2023-07-12T02:02:35.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.109+0000 7f02834ba700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f027c0bc810 0x7f027c0ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:35.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.109+0000 7f02834ba700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f027c0b8d90 0x7f027c06ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:35.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.109+0000 7f02834ba700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f027c0b8620 con 0x7f027c1449d0 2023-07-12T02:02:35.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.109+0000 7f02834ba700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f027c0b97a0 con 0x7f027c0bc810 2023-07-12T02:02:35.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.109+0000 7f02834ba700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f027c144da0 con 0x7f027c0b8d90 2023-07-12T02:02:35.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.109+0000 7f0281a57700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f027c0b8d90 0x7f027c06ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:35.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.109+0000 7f0281a57700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f027c0b8d90 0x7f027c06ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.60:33660/0 (socket says 172.21.15.60:33660) 2023-07-12T02:02:35.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.109+0000 7f0281a57700 1 -- 172.21.15.60:0/3468876730 learned_addr learned my addr 172.21.15.60:0/3468876730 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:35.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.109+0000 7f0280a55700 1 --2- 172.21.15.60:0/3468876730 >> v2:172.21.15.79:3300/0 conn(0x7f027c0bc810 0x7f027c0ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:35.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.110+0000 7f0281a57700 1 -- 172.21.15.60:0/3468876730 >> v2:172.21.15.79:3300/0 conn(0x7f027c0bc810 msgr2=0x7f027c0ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:35.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.110+0000 7f0281a57700 1 --2- 172.21.15.60:0/3468876730 >> v2:172.21.15.79:3300/0 conn(0x7f027c0bc810 0x7f027c0ba530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:35.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.110+0000 7f0281a57700 1 -- 172.21.15.60:0/3468876730 >> v1:172.21.15.79:6789/0 conn(0x7f027c1449d0 legacy=0x7f027c14db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:35.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.110+0000 7f0281a57700 1 -- 172.21.15.60:0/3468876730 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f027c0b8900 con 0x7f027c0b8d90 2023-07-12T02:02:35.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.110+0000 7f0280a55700 1 --2- 172.21.15.60:0/3468876730 >> v2:172.21.15.79:3300/0 conn(0x7f027c0bc810 0x7f027c0ba530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:02:35.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.110+0000 7f0281a57700 1 --2- 172.21.15.60:0/3468876730 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f027c0b8d90 0x7f027c06ade0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0274009e50 tx=0x7f027400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0977402cc287852 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:35.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.110+0000 7f026ffff700 1 -- 172.21.15.60:0/3468876730 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027400e070 con 0x7f027c0b8d90 2023-07-12T02:02:35.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.110+0000 7f026ffff700 1 -- 172.21.15.60:0/3468876730 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027400b910 con 0x7f027c0b8d90 2023-07-12T02:02:35.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.110+0000 7f026ffff700 1 -- 172.21.15.60:0/3468876730 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027400bcc0 con 0x7f027c0b8d90 2023-07-12T02:02:35.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.111+0000 7f02834ba700 1 -- 172.21.15.60:0/3468876730 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f027c0b8d90 msgr2=0x7f027c06ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:35.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.111+0000 7f02834ba700 1 --2- 172.21.15.60:0/3468876730 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f027c0b8d90 0x7f027c06ade0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0274009e50 tx=0x7f027400b330 comp rx=0 tx=0).stop 2023-07-12T02:02:35.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.111+0000 7f02834ba700 1 -- 172.21.15.60:0/3468876730 shutdown_connections 2023-07-12T02:02:35.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.111+0000 7f02834ba700 1 --2- 172.21.15.60:0/3468876730 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f027c0b8d90 0x7f027c06ade0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:35.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.111+0000 7f02834ba700 1 --2- 172.21.15.60:0/3468876730 >> v2:172.21.15.79:3300/0 conn(0x7f027c0bc810 0x7f027c0ba530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:35.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.111+0000 7f02834ba700 1 -- 172.21.15.60:0/3468876730 >> 172.21.15.60:0/3468876730 conn(0x7f027c0c0860 msgr2=0x7f027c0c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:35.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.111+0000 7f02834ba700 1 -- 172.21.15.60:0/3468876730 shutdown_connections 2023-07-12T02:02:35.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.111+0000 7f02834ba700 1 -- 172.21.15.60:0/3468876730 wait complete. 2023-07-12T02:02:35.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.112+0000 7f02834ba700 1 Processor -- start 2023-07-12T02:02:35.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.112+0000 7f02834ba700 1 -- start start 2023-07-12T02:02:35.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.112+0000 7f02834ba700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f027c0b8d90 0x7f027c0b3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:35.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.113+0000 7f02834ba700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f027c0bc810 0x7f027c1dfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:35.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.113+0000 7f02834ba700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f027c1449d0 0x7f027c0b2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:35.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.113+0000 7f02834ba700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027c0b40d0 con 0x7f027c0b8d90 2023-07-12T02:02:35.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.113+0000 7f02834ba700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027c14ab00 con 0x7f027c1449d0 2023-07-12T02:02:35.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.113+0000 7f02834ba700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f027c0a5d00 con 0x7f027c0bc810 2023-07-12T02:02:35.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.113+0000 7f0281256700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f027c0b8d90 0x7f027c0b3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:35.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.113+0000 7f0281256700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f027c0b8d90 0x7f027c0b3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47306/0 (socket says 172.21.15.60:47306) 2023-07-12T02:02:35.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.113+0000 7f0281256700 1 -- 172.21.15.60:0/4063948429 learned_addr learned my addr 172.21.15.60:0/4063948429 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:35.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.113+0000 7f0280a55700 1 --2- 172.21.15.60:0/4063948429 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f027c0bc810 0x7f027c1dfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:35.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.113+0000 7f0281a57700 1 --2- 172.21.15.60:0/4063948429 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f027c1449d0 0x7f027c0b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:35.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.113+0000 7f0281256700 1 -- 172.21.15.60:0/4063948429 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f027c0bc810 msgr2=0x7f027c1dfcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:35.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.113+0000 7f0281256700 1 --2- 172.21.15.60:0/4063948429 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f027c0bc810 0x7f027c1dfcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:35.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.113+0000 7f0281256700 1 -- 172.21.15.60:0/4063948429 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f027c1449d0 msgr2=0x7f027c0b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:35.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.113+0000 7f0281256700 1 --2- 172.21.15.60:0/4063948429 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f027c1449d0 0x7f027c0b2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:35.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.113+0000 7f0281256700 1 -- 172.21.15.60:0/4063948429 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02780094a0 con 0x7f027c0b8d90 2023-07-12T02:02:35.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.113+0000 7f0280a55700 1 --2- 172.21.15.60:0/4063948429 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f027c0bc810 0x7f027c1dfcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:35.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.113+0000 7f0281256700 1 --2- 172.21.15.60:0/4063948429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f027c0b8d90 0x7f027c0b3b90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f027000c480 tx=0x7f027000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:35.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.113+0000 7f026dffb700 1 -- 172.21.15.60:0/4063948429 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02700052d0 con 0x7f027c0b8d90 2023-07-12T02:02:35.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.113+0000 7f026dffb700 1 -- 172.21.15.60:0/4063948429 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0270005430 con 0x7f027c0b8d90 2023-07-12T02:02:35.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.113+0000 7f026dffb700 1 -- 172.21.15.60:0/4063948429 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02700038c0 con 0x7f027c0b8d90 2023-07-12T02:02:35.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.113+0000 7f02834ba700 1 -- 172.21.15.60:0/4063948429 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0274009b30 con 0x7f027c0b8d90 2023-07-12T02:02:35.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.114+0000 7f02834ba700 1 -- 172.21.15.60:0/4063948429 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f027c14a020 con 0x7f027c0b8d90 2023-07-12T02:02:35.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.114+0000 7f02834ba700 1 -- 172.21.15.60:0/4063948429 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f027c074360 con 0x7f027c0b8d90 2023-07-12T02:02:35.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.115+0000 7f026dffb700 1 -- 172.21.15.60:0/4063948429 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0270003a20 con 0x7f027c0b8d90 2023-07-12T02:02:35.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.115+0000 7f026dffb700 1 --2- 172.21.15.60:0/4063948429 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f026006ace0 0x7f026006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:35.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.115+0000 7f026dffb700 1 -- 172.21.15.60:0/4063948429 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f02700889b0 con 0x7f027c0b8d90 2023-07-12T02:02:35.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.115+0000 7f0280a55700 1 --2- 172.21.15.60:0/4063948429 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f026006ace0 0x7f026006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:35.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.116+0000 7f0280a55700 1 --2- 172.21.15.60:0/4063948429 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f026006ace0 0x7f026006d190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f027c0a6610 tx=0x7f0278008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:35.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.120+0000 7f026dffb700 1 -- 172.21.15.60:0/4063948429 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f02700539d0 con 0x7f027c0b8d90 2023-07-12T02:02:35.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.313+0000 7f02834ba700 1 -- 172.21.15.60:0/4063948429 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f027c144010 con 0x7f027c0b8d90 2023-07-12T02:02:35.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.314+0000 7f026dffb700 1 -- 172.21.15.60:0/4063948429 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0270017020 con 0x7f027c0b8d90 2023-07-12T02:02:35.317 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-07-12T02:02:35.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.316+0000 7f02834ba700 1 -- 172.21.15.60:0/4063948429 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f026006ace0 msgr2=0x7f026006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:35.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.316+0000 7f02834ba700 1 --2- 172.21.15.60:0/4063948429 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f026006ace0 0x7f026006d190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f027c0a6610 tx=0x7f0278008040 comp rx=0 tx=0).stop 2023-07-12T02:02:35.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.316+0000 7f02834ba700 1 -- 172.21.15.60:0/4063948429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f027c0b8d90 msgr2=0x7f027c0b3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:35.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.316+0000 7f02834ba700 1 --2- 172.21.15.60:0/4063948429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f027c0b8d90 0x7f027c0b3b90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f027000c480 tx=0x7f027000c840 comp rx=0 tx=0).stop 2023-07-12T02:02:35.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.316+0000 7f02834ba700 1 -- 172.21.15.60:0/4063948429 shutdown_connections 2023-07-12T02:02:35.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.316+0000 7f02834ba700 1 --2- 172.21.15.60:0/4063948429 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f026006ace0 0x7f026006d190 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:35.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.316+0000 7f02834ba700 1 --2- 172.21.15.60:0/4063948429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f027c0b8d90 0x7f027c0b3b90 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:35.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.316+0000 7f02834ba700 1 --2- 172.21.15.60:0/4063948429 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f027c1449d0 0x7f027c0b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:35.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.316+0000 7f02834ba700 1 --2- 172.21.15.60:0/4063948429 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f027c0bc810 0x7f027c1dfcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:35.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.316+0000 7f02834ba700 1 -- 172.21.15.60:0/4063948429 >> 172.21.15.60:0/4063948429 conn(0x7f027c0c0860 msgr2=0x7f027c0baeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:35.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.316+0000 7f02834ba700 1 -- 172.21.15.60:0/4063948429 shutdown_connections 2023-07-12T02:02:35.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.316+0000 7f02834ba700 1 -- 172.21.15.60:0/4063948429 wait complete. 2023-07-12T02:02:35.331 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-12T02:02:35.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.456+0000 7f7831e50700 1 Processor -- start 2023-07-12T02:02:35.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.456+0000 7f7831e50700 1 -- start start 2023-07-12T02:02:35.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.457+0000 7f7831e50700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f782c1449d0 0x7f782c14db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:35.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.457+0000 7f7831e50700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f782c0bc810 0x7f782c0ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:35.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.457+0000 7f7831e50700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f782c0b8620 con 0x7f782c0b8d90 2023-07-12T02:02:35.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.457+0000 7f7831e50700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f782c0b97a0 con 0x7f782c0bc810 2023-07-12T02:02:35.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.457+0000 7f7831e50700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f782c144da0 con 0x7f782c1449d0 2023-07-12T02:02:35.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.457+0000 7f782affd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f782c0bc810 0x7f782c0ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:35.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.457+0000 7f782bfff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f782c0b8d90 0x7f782c06ade0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49642/0 (socket says 172.21.15.60:49642) 2023-07-12T02:02:35.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.457+0000 7f782bfff700 1 -- 172.21.15.60:0/1084720958 learned_addr learned my addr 172.21.15.60:0/1084720958 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:35.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.457+0000 7f782b7fe700 1 --2- 172.21.15.60:0/1084720958 >> v2:172.21.15.79:3300/0 conn(0x7f782c1449d0 0x7f782c14db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:35.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.457+0000 7f782affd700 1 -- 172.21.15.60:0/1084720958 >> v2:172.21.15.79:3300/0 conn(0x7f782c1449d0 msgr2=0x7f782c14db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:35.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.457+0000 7f782affd700 1 --2- 172.21.15.60:0/1084720958 >> v2:172.21.15.79:3300/0 conn(0x7f782c1449d0 0x7f782c14db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:35.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.457+0000 7f782affd700 1 -- 172.21.15.60:0/1084720958 >> v1:172.21.15.60:6789/0 conn(0x7f782c0b8d90 legacy=0x7f782c06ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:35.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.457+0000 7f782a7fc700 1 -- 172.21.15.60:0/1084720958 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 820364396 0 0) 0x7f782c0b8620 con 0x7f782c0b8d90 2023-07-12T02:02:35.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.457+0000 7f782affd700 1 -- 172.21.15.60:0/1084720958 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f782c0b8900 con 0x7f782c0bc810 2023-07-12T02:02:35.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.457+0000 7f782b7fe700 1 --2- 172.21.15.60:0/1084720958 >> v2:172.21.15.79:3300/0 conn(0x7f782c1449d0 0x7f782c14db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:35.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.457+0000 7f782affd700 1 --2- 172.21.15.60:0/1084720958 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f782c0bc810 0x7f782c0ba530 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f782c06cbe0 tx=0x7f7814009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d73b44b18b4c1d12 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:35.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.458+0000 7f782a7fc700 1 -- 172.21.15.60:0/1084720958 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7814011830 con 0x7f782c0bc810 2023-07-12T02:02:35.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.458+0000 7f782a7fc700 1 -- 172.21.15.60:0/1084720958 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7814011990 con 0x7f782c0bc810 2023-07-12T02:02:35.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.458+0000 7f782a7fc700 1 -- 172.21.15.60:0/1084720958 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7814011d20 con 0x7f782c0bc810 2023-07-12T02:02:35.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.458+0000 7f7831e50700 1 -- 172.21.15.60:0/1084720958 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f782c0bc810 msgr2=0x7f782c0ba530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:35.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.458+0000 7f7831e50700 1 --2- 172.21.15.60:0/1084720958 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f782c0bc810 0x7f782c0ba530 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f782c06cbe0 tx=0x7f7814009b20 comp rx=0 tx=0).stop 2023-07-12T02:02:35.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.458+0000 7f7831e50700 1 -- 172.21.15.60:0/1084720958 shutdown_connections 2023-07-12T02:02:35.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.458+0000 7f7831e50700 1 --2- 172.21.15.60:0/1084720958 >> v2:172.21.15.79:3300/0 conn(0x7f782c1449d0 0x7f782c14db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:35.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.458+0000 7f7831e50700 1 --2- 172.21.15.60:0/1084720958 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f782c0bc810 0x7f782c0ba530 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:35.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.458+0000 7f7831e50700 1 -- 172.21.15.60:0/1084720958 >> 172.21.15.60:0/1084720958 conn(0x7f782c0c0860 msgr2=0x7f782c0c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:35.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.458+0000 7f7831e50700 1 -- 172.21.15.60:0/1084720958 shutdown_connections 2023-07-12T02:02:35.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.458+0000 7f7831e50700 1 -- 172.21.15.60:0/1084720958 wait complete. 2023-07-12T02:02:35.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.459+0000 7f7831e50700 1 Processor -- start 2023-07-12T02:02:35.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.459+0000 7f7831e50700 1 -- start start 2023-07-12T02:02:35.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.460+0000 7f7831e50700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f782c0b8d90 0x7f782c14d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:35.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.460+0000 7f7831e50700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f782c0bc810 0x7f782c0b2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:35.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.460+0000 7f7831e50700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f782c1449d0 0x7f782c0a5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:35.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.460+0000 7f7831e50700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c14d7a0 con 0x7f782c1449d0 2023-07-12T02:02:35.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.460+0000 7f7831e50700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c144ef0 con 0x7f782c0bc810 2023-07-12T02:02:35.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.460+0000 7f7831e50700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f782c1454b0 con 0x7f782c0b8d90 2023-07-12T02:02:35.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.460+0000 7f782bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f782c1449d0 0x7f782c0a5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:35.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.460+0000 7f782bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f782c1449d0 0x7f782c0a5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47326/0 (socket says 172.21.15.60:47326) 2023-07-12T02:02:35.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.460+0000 7f782bfff700 1 -- 172.21.15.60:0/2969584628 learned_addr learned my addr 172.21.15.60:0/2969584628 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:35.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.460+0000 7f782affd700 1 --2- 172.21.15.60:0/2969584628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f782c0bc810 0x7f782c0b2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:35.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.460+0000 7f782b7fe700 1 --2- 172.21.15.60:0/2969584628 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f782c0b8d90 0x7f782c14d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:35.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.460+0000 7f782bfff700 1 -- 172.21.15.60:0/2969584628 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f782c0b8d90 msgr2=0x7f782c14d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:35.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.460+0000 7f782bfff700 1 --2- 172.21.15.60:0/2969584628 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f782c0b8d90 0x7f782c14d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:35.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.460+0000 7f782bfff700 1 -- 172.21.15.60:0/2969584628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f782c0bc810 msgr2=0x7f782c0b2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:35.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.460+0000 7f782bfff700 1 --2- 172.21.15.60:0/2969584628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f782c0bc810 0x7f782c0b2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:35.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.460+0000 7f782bfff700 1 -- 172.21.15.60:0/2969584628 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78140094a0 con 0x7f782c1449d0 2023-07-12T02:02:35.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.461+0000 7f782bfff700 1 --2- 172.21.15.60:0/2969584628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f782c1449d0 0x7f782c0a5500 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f782400cc70 tx=0x7f782400cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:35.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.461+0000 7f7823fff700 1 -- 172.21.15.60:0/2969584628 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782400aac0 con 0x7f782c1449d0 2023-07-12T02:02:35.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.461+0000 7f7823fff700 1 -- 172.21.15.60:0/2969584628 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f782400ac40 con 0x7f782c1449d0 2023-07-12T02:02:35.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.461+0000 7f7823fff700 1 -- 172.21.15.60:0/2969584628 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78240070d0 con 0x7f782c1449d0 2023-07-12T02:02:35.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.461+0000 7f7831e50700 1 -- 172.21.15.60:0/2969584628 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f782c0b2970 con 0x7f782c1449d0 2023-07-12T02:02:35.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.461+0000 7f7831e50700 1 -- 172.21.15.60:0/2969584628 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f782c0b4280 con 0x7f782c1449d0 2023-07-12T02:02:35.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.462+0000 7f7831e50700 1 -- 172.21.15.60:0/2969584628 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f782c06c2f0 con 0x7f782c1449d0 2023-07-12T02:02:35.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.462+0000 7f7823fff700 1 -- 172.21.15.60:0/2969584628 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7824007250 con 0x7f782c1449d0 2023-07-12T02:02:35.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.463+0000 7f7823fff700 1 --2- 172.21.15.60:0/2969584628 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f780c06ace0 0x7f780c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:35.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.463+0000 7f7823fff700 1 -- 172.21.15.60:0/2969584628 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7824088fa0 con 0x7f782c1449d0 2023-07-12T02:02:35.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.463+0000 7f782b7fe700 1 --2- 172.21.15.60:0/2969584628 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f780c06ace0 0x7f780c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:35.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.463+0000 7f782b7fe700 1 --2- 172.21.15.60:0/2969584628 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f780c06ace0 0x7f780c06d190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f781c00c940 tx=0x7f781c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:35.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.467+0000 7f7823fff700 1 -- 172.21.15.60:0/2969584628 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f78240bb380 con 0x7f782c1449d0 2023-07-12T02:02:35.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.663+0000 7f7831e50700 1 -- 172.21.15.60:0/2969584628 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f782c074360 con 0x7f782c1449d0 2023-07-12T02:02:35.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.663+0000 7f7823fff700 1 -- 172.21.15.60:0/2969584628 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7824053fd0 con 0x7f782c1449d0 2023-07-12T02:02:35.668 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-07-12T02:02:35.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.665+0000 7f7831e50700 1 -- 172.21.15.60:0/2969584628 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f780c06ace0 msgr2=0x7f780c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:35.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.665+0000 7f7831e50700 1 --2- 172.21.15.60:0/2969584628 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f780c06ace0 0x7f780c06d190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f781c00c940 tx=0x7f781c008040 comp rx=0 tx=0).stop 2023-07-12T02:02:35.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.665+0000 7f7831e50700 1 -- 172.21.15.60:0/2969584628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f782c1449d0 msgr2=0x7f782c0a5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:35.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.665+0000 7f7831e50700 1 --2- 172.21.15.60:0/2969584628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f782c1449d0 0x7f782c0a5500 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f782400cc70 tx=0x7f782400cf80 comp rx=0 tx=0).stop 2023-07-12T02:02:35.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.665+0000 7f7831e50700 1 -- 172.21.15.60:0/2969584628 shutdown_connections 2023-07-12T02:02:35.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.665+0000 7f7831e50700 1 --2- 172.21.15.60:0/2969584628 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f780c06ace0 0x7f780c06d190 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:35.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.665+0000 7f7831e50700 1 --2- 172.21.15.60:0/2969584628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f782c1449d0 0x7f782c0a5500 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:35.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.665+0000 7f7831e50700 1 --2- 172.21.15.60:0/2969584628 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f782c0b8d90 0x7f782c14d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:35.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.665+0000 7f7831e50700 1 --2- 172.21.15.60:0/2969584628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f782c0bc810 0x7f782c0b2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:35.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.665+0000 7f7831e50700 1 -- 172.21.15.60:0/2969584628 >> 172.21.15.60:0/2969584628 conn(0x7f782c0c0860 msgr2=0x7f782c143960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:35.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.665+0000 7f7831e50700 1 -- 172.21.15.60:0/2969584628 shutdown_connections 2023-07-12T02:02:35.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.665+0000 7f7831e50700 1 -- 172.21.15.60:0/2969584628 wait complete. 2023-07-12T02:02:35.681 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-12T02:02:35.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.806+0000 7f33a14f5700 1 Processor -- start 2023-07-12T02:02:35.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.807+0000 7f33a14f5700 1 -- start start 2023-07-12T02:02:35.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.807+0000 7f33a14f5700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f339c0b7f80 0x7f339c0ba3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:35.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.807+0000 7f33a14f5700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f339c0ba010 con 0x7f339c0717f0 2023-07-12T02:02:35.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.807+0000 7f33a14f5700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f339c0b85a0 con 0x7f339c071bc0 2023-07-12T02:02:35.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.807+0000 7f33a14f5700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f339c0b83c0 con 0x7f339c0b7f80 2023-07-12T02:02:35.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.807+0000 7f339affd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f339c0717f0 0x7f339c0b8e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49654/0 (socket says 172.21.15.60:49654) 2023-07-12T02:02:35.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.807+0000 7f339affd700 1 -- 172.21.15.60:0/245888860 learned_addr learned my addr 172.21.15.60:0/245888860 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:35.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.807+0000 7f339b7fe700 1 --2- 172.21.15.60:0/245888860 >> v2:172.21.15.60:3300/0 conn(0x7f339c0b7f80 0x7f339c0ba3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:35.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.808+0000 7f3399ffb700 1 -- 172.21.15.60:0/245888860 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1782657899 0 0) 0x7f339c0ba010 con 0x7f339c0717f0 2023-07-12T02:02:35.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.808+0000 7f3399ffb700 1 -- 172.21.15.60:0/245888860 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33840035b0 con 0x7f339c0717f0 2023-07-12T02:02:35.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.808+0000 7f339b7fe700 1 -- 172.21.15.60:0/245888860 >> v1:172.21.15.79:6789/0 conn(0x7f339c071bc0 legacy=0x7f339c142410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:35.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.808+0000 7f339b7fe700 1 -- 172.21.15.60:0/245888860 >> v1:172.21.15.60:6789/0 conn(0x7f339c0717f0 legacy=0x7f339c0b8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:35.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.808+0000 7f339b7fe700 1 -- 172.21.15.60:0/245888860 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f339c0b7470 con 0x7f339c0b7f80 2023-07-12T02:02:35.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.808+0000 7f339b7fe700 1 --2- 172.21.15.60:0/245888860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f339c0b7f80 0x7f339c0ba3e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f338c009d90 tx=0x7f338c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18440ed7d7452cfb server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:35.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.808+0000 7f3399ffb700 1 -- 172.21.15.60:0/245888860 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c00e070 con 0x7f339c0b7f80 2023-07-12T02:02:35.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.808+0000 7f3399ffb700 1 -- 172.21.15.60:0/245888860 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338c00bae0 con 0x7f339c0b7f80 2023-07-12T02:02:35.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.808+0000 7f3399ffb700 1 -- 172.21.15.60:0/245888860 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c00be50 con 0x7f339c0b7f80 2023-07-12T02:02:35.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.808+0000 7f33a14f5700 1 -- 172.21.15.60:0/245888860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f339c0b7f80 msgr2=0x7f339c0ba3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:35.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.808+0000 7f33a14f5700 1 --2- 172.21.15.60:0/245888860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f339c0b7f80 0x7f339c0ba3e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f338c009d90 tx=0x7f338c00b330 comp rx=0 tx=0).stop 2023-07-12T02:02:35.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.809+0000 7f33a14f5700 1 -- 172.21.15.60:0/245888860 shutdown_connections 2023-07-12T02:02:35.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.809+0000 7f33a14f5700 1 --2- 172.21.15.60:0/245888860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f339c0b7f80 0x7f339c0ba3e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:35.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.809+0000 7f33a14f5700 1 -- 172.21.15.60:0/245888860 >> 172.21.15.60:0/245888860 conn(0x7f339c06d0e0 msgr2=0x7f339c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:35.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.809+0000 7f33a14f5700 1 -- 172.21.15.60:0/245888860 shutdown_connections 2023-07-12T02:02:35.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.809+0000 7f33a14f5700 1 -- 172.21.15.60:0/245888860 wait complete. 2023-07-12T02:02:35.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.810+0000 7f33a14f5700 1 Processor -- start 2023-07-12T02:02:35.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.810+0000 7f33a14f5700 1 -- start start 2023-07-12T02:02:35.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.810+0000 7f33a14f5700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f339c0717f0 0x7f339c1d2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:35.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.810+0000 7f33a14f5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f339c071bc0 0x7f339c146c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:35.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.811+0000 7f33a14f5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f339c0b7f80 0x7f339c13c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:35.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.811+0000 7f33a14f5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339c1d2750 con 0x7f339c071bc0 2023-07-12T02:02:35.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.811+0000 7f33a14f5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339c13bc30 con 0x7f339c0b7f80 2023-07-12T02:02:35.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.811+0000 7f33a14f5700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f339c13b950 con 0x7f339c0717f0 2023-07-12T02:02:35.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.811+0000 7f339a7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f339c071bc0 0x7f339c146c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:35.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.811+0000 7f339a7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f339c071bc0 0x7f339c146c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47336/0 (socket says 172.21.15.60:47336) 2023-07-12T02:02:35.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.811+0000 7f339a7fc700 1 -- 172.21.15.60:0/3126788195 learned_addr learned my addr 172.21.15.60:0/3126788195 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:35.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.811+0000 7f339affd700 1 --2- 172.21.15.60:0/3126788195 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f339c0717f0 0x7f339c1d2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:35.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.811+0000 7f339b7fe700 1 --2- 172.21.15.60:0/3126788195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f339c0b7f80 0x7f339c13c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:35.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.811+0000 7f339a7fc700 1 -- 172.21.15.60:0/3126788195 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f339c0717f0 msgr2=0x7f339c1d2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:35.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.811+0000 7f339a7fc700 1 --2- 172.21.15.60:0/3126788195 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f339c0717f0 0x7f339c1d2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:35.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.811+0000 7f339a7fc700 1 -- 172.21.15.60:0/3126788195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f339c0b7f80 msgr2=0x7f339c13c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:35.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.811+0000 7f339a7fc700 1 --2- 172.21.15.60:0/3126788195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f339c0b7f80 0x7f339c13c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:35.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.811+0000 7f339a7fc700 1 -- 172.21.15.60:0/3126788195 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f338c009a70 con 0x7f339c071bc0 2023-07-12T02:02:35.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.811+0000 7f339a7fc700 1 --2- 172.21.15.60:0/3126788195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f339c071bc0 0x7f339c146c70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f339000c500 tx=0x7f339000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:35.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.811+0000 7f33837fe700 1 -- 172.21.15.60:0/3126788195 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3390011790 con 0x7f339c071bc0 2023-07-12T02:02:35.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.811+0000 7f33837fe700 1 -- 172.21.15.60:0/3126788195 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33900118f0 con 0x7f339c071bc0 2023-07-12T02:02:35.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.811+0000 7f33a14f5700 1 -- 172.21.15.60:0/3126788195 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f339c1cfae0 con 0x7f339c071bc0 2023-07-12T02:02:35.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.811+0000 7f33837fe700 1 -- 172.21.15.60:0/3126788195 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3390011ca0 con 0x7f339c071bc0 2023-07-12T02:02:35.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.811+0000 7f33a14f5700 1 -- 172.21.15.60:0/3126788195 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f339c0bcfc0 con 0x7f339c071bc0 2023-07-12T02:02:35.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.812+0000 7f33a14f5700 1 -- 172.21.15.60:0/3126788195 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f339c074360 con 0x7f339c071bc0 2023-07-12T02:02:35.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.813+0000 7f33837fe700 1 -- 172.21.15.60:0/3126788195 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f339001c460 con 0x7f339c071bc0 2023-07-12T02:02:35.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.813+0000 7f33837fe700 1 --2- 172.21.15.60:0/3126788195 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f338806ace0 0x7f338806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:35.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.813+0000 7f33837fe700 1 -- 172.21.15.60:0/3126788195 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f33900892c0 con 0x7f339c071bc0 2023-07-12T02:02:35.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.813+0000 7f339affd700 1 --2- 172.21.15.60:0/3126788195 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f338806ace0 0x7f338806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:35.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.814+0000 7f339affd700 1 --2- 172.21.15.60:0/3126788195 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f338806ace0 0x7f338806d190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3394005910 tx=0x7f3394009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:35.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:35.818+0000 7f33837fe700 1 -- 172.21.15.60:0/3126788195 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f3390054370 con 0x7f339c071bc0 2023-07-12T02:02:36.018 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.014+0000 7f33a14f5700 1 -- 172.21.15.60:0/3126788195 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f339c0b6d30 con 0x7f339c071bc0 2023-07-12T02:02:36.019 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.015+0000 7f33837fe700 1 -- 172.21.15.60:0/3126788195 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3390057990 con 0x7f339c071bc0 2023-07-12T02:02:36.019 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-07-12T02:02:36.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.017+0000 7f33a14f5700 1 -- 172.21.15.60:0/3126788195 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f338806ace0 msgr2=0x7f338806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:36.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.017+0000 7f33a14f5700 1 --2- 172.21.15.60:0/3126788195 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f338806ace0 0x7f338806d190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3394005910 tx=0x7f3394009040 comp rx=0 tx=0).stop 2023-07-12T02:02:36.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.017+0000 7f33a14f5700 1 -- 172.21.15.60:0/3126788195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f339c071bc0 msgr2=0x7f339c146c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:36.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.017+0000 7f33a14f5700 1 --2- 172.21.15.60:0/3126788195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f339c071bc0 0x7f339c146c70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f339000c500 tx=0x7f339000c8c0 comp rx=0 tx=0).stop 2023-07-12T02:02:36.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.017+0000 7f33a14f5700 1 -- 172.21.15.60:0/3126788195 shutdown_connections 2023-07-12T02:02:36.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.017+0000 7f33a14f5700 1 --2- 172.21.15.60:0/3126788195 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f338806ace0 0x7f338806d190 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:36.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.017+0000 7f33a14f5700 1 --2- 172.21.15.60:0/3126788195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f339c0b7f80 0x7f339c13c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:36.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.017+0000 7f33a14f5700 1 --2- 172.21.15.60:0/3126788195 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f339c0717f0 0x7f339c1d2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:36.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.017+0000 7f33a14f5700 1 --2- 172.21.15.60:0/3126788195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f339c071bc0 0x7f339c146c70 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:36.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.017+0000 7f33a14f5700 1 -- 172.21.15.60:0/3126788195 >> 172.21.15.60:0/3126788195 conn(0x7f339c06d0e0 msgr2=0x7f339c06d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:36.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.017+0000 7f33a14f5700 1 -- 172.21.15.60:0/3126788195 shutdown_connections 2023-07-12T02:02:36.022 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.017+0000 7f33a14f5700 1 -- 172.21.15.60:0/3126788195 wait complete. 2023-07-12T02:02:36.033 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:02:36.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.155+0000 7f55a658c700 1 Processor -- start 2023-07-12T02:02:36.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.155+0000 7f55a658c700 1 -- start start 2023-07-12T02:02:36.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.155+0000 7f55a658c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f55a00bc810 0x7f55a00ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:36.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.155+0000 7f55a658c700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55a00b8620 con 0x7f55a00b8d90 2023-07-12T02:02:36.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.156+0000 7f55a658c700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55a00b8900 con 0x7f55a01449d0 2023-07-12T02:02:36.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.156+0000 7f55a658c700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55a00b97a0 con 0x7f55a00bc810 2023-07-12T02:02:36.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.156+0000 7f559f7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f55a00bc810 0x7f55a00ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:36.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.156+0000 7f55a4b29700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f55a00b8d90 0x7f55a006ade0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49670/0 (socket says 172.21.15.60:49670) 2023-07-12T02:02:36.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.156+0000 7f55a4b29700 1 -- 172.21.15.60:0/3017732837 learned_addr learned my addr 172.21.15.60:0/3017732837 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:36.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.156+0000 7f559f7fe700 1 -- 172.21.15.60:0/3017732837 >> v1:172.21.15.79:6789/0 conn(0x7f55a01449d0 legacy=0x7f55a014db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:36.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.156+0000 7f559f7fe700 1 -- 172.21.15.60:0/3017732837 >> v1:172.21.15.60:6789/0 conn(0x7f55a00b8d90 legacy=0x7f55a006ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:36.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.156+0000 7f559f7fe700 1 -- 172.21.15.60:0/3017732837 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a006b4f0 con 0x7f55a00bc810 2023-07-12T02:02:36.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.156+0000 7f559effd700 1 -- 172.21.15.60:0/3017732837 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4073938943 0 0) 0x7f55a00b8620 con 0x7f55a00b8d90 2023-07-12T02:02:36.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.156+0000 7f559f7fe700 1 --2- 172.21.15.60:0/3017732837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55a00bc810 0x7f55a00ba530 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5590009840 tx=0x7f5590009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f43384a2f5f87 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:36.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.156+0000 7f559effd700 1 -- 172.21.15.60:0/3017732837 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5590011830 con 0x7f55a00bc810 2023-07-12T02:02:36.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.156+0000 7f559effd700 1 -- 172.21.15.60:0/3017732837 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5590011990 con 0x7f55a00bc810 2023-07-12T02:02:36.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.156+0000 7f559effd700 1 -- 172.21.15.60:0/3017732837 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5590011d20 con 0x7f55a00bc810 2023-07-12T02:02:36.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.157+0000 7f55a658c700 1 -- 172.21.15.60:0/3017732837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55a00bc810 msgr2=0x7f55a00ba530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:36.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.157+0000 7f55a658c700 1 --2- 172.21.15.60:0/3017732837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55a00bc810 0x7f55a00ba530 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5590009840 tx=0x7f5590009b50 comp rx=0 tx=0).stop 2023-07-12T02:02:36.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.157+0000 7f55a658c700 1 -- 172.21.15.60:0/3017732837 shutdown_connections 2023-07-12T02:02:36.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.157+0000 7f55a658c700 1 --2- 172.21.15.60:0/3017732837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55a00bc810 0x7f55a00ba530 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:36.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.157+0000 7f55a658c700 1 -- 172.21.15.60:0/3017732837 >> 172.21.15.60:0/3017732837 conn(0x7f55a00c0860 msgr2=0x7f55a00c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:36.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.157+0000 7f55a658c700 1 -- 172.21.15.60:0/3017732837 shutdown_connections 2023-07-12T02:02:36.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.157+0000 7f55a658c700 1 -- 172.21.15.60:0/3017732837 wait complete. 2023-07-12T02:02:36.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.158+0000 7f55a658c700 1 Processor -- start 2023-07-12T02:02:36.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.158+0000 7f55a658c700 1 -- start start 2023-07-12T02:02:36.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.159+0000 7f55a658c700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55a00b8d90 0x7f55a00b2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:36.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.159+0000 7f55a658c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55a00bc810 0x7f55a00b4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:36.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.159+0000 7f55a658c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55a01449d0 0x7f55a00b6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:36.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.159+0000 7f55a658c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a00b6590 con 0x7f55a01449d0 2023-07-12T02:02:36.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.159+0000 7f55a658c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a00b1e20 con 0x7f55a00bc810 2023-07-12T02:02:36.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.159+0000 7f55a658c700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a014cbc0 con 0x7f55a00b8d90 2023-07-12T02:02:36.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.159+0000 7f55a4b29700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55a01449d0 0x7f55a00b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:36.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.159+0000 7f55a4b29700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55a01449d0 0x7f55a00b6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47358/0 (socket says 172.21.15.60:47358) 2023-07-12T02:02:36.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.159+0000 7f55a4b29700 1 -- 172.21.15.60:0/2289829085 learned_addr learned my addr 172.21.15.60:0/2289829085 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:36.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.159+0000 7f559ffff700 1 --2- 172.21.15.60:0/2289829085 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55a00b8d90 0x7f55a00b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:36.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.159+0000 7f559f7fe700 1 --2- 172.21.15.60:0/2289829085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55a00bc810 0x7f55a00b4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:36.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.159+0000 7f55a4b29700 1 -- 172.21.15.60:0/2289829085 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55a00b8d90 msgr2=0x7f55a00b2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:36.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.159+0000 7f55a4b29700 1 --2- 172.21.15.60:0/2289829085 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55a00b8d90 0x7f55a00b2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:36.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.159+0000 7f55a4b29700 1 -- 172.21.15.60:0/2289829085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55a00bc810 msgr2=0x7f55a00b4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:36.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.159+0000 7f55a4b29700 1 --2- 172.21.15.60:0/2289829085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55a00bc810 0x7f55a00b4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:36.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.159+0000 7f55a4b29700 1 -- 172.21.15.60:0/2289829085 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55900094a0 con 0x7f55a01449d0 2023-07-12T02:02:36.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.159+0000 7f559ffff700 1 --2- 172.21.15.60:0/2289829085 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55a00b8d90 0x7f55a00b2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:02:36.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.159+0000 7f55a4b29700 1 --2- 172.21.15.60:0/2289829085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55a01449d0 0x7f55a00b6050 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f559800cc70 tx=0x7f559800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:36.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.160+0000 7f559cff9700 1 -- 172.21.15.60:0/2289829085 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559800ada0 con 0x7f55a01449d0 2023-07-12T02:02:36.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.160+0000 7f559cff9700 1 -- 172.21.15.60:0/2289829085 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559800ce70 con 0x7f55a01449d0 2023-07-12T02:02:36.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.160+0000 7f55a658c700 1 -- 172.21.15.60:0/2289829085 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55a014ce10 con 0x7f55a01449d0 2023-07-12T02:02:36.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.160+0000 7f559cff9700 1 -- 172.21.15.60:0/2289829085 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55980072f0 con 0x7f55a01449d0 2023-07-12T02:02:36.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.160+0000 7f55a658c700 1 -- 172.21.15.60:0/2289829085 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a014d650 con 0x7f55a01449d0 2023-07-12T02:02:36.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.160+0000 7f55a658c700 1 -- 172.21.15.60:0/2289829085 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55a00b2fa0 con 0x7f55a01449d0 2023-07-12T02:02:36.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.161+0000 7f559cff9700 1 -- 172.21.15.60:0/2289829085 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5598007450 con 0x7f55a01449d0 2023-07-12T02:02:36.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.161+0000 7f559cff9700 1 --2- 172.21.15.60:0/2289829085 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f558006ace0 0x7f558006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:36.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.162+0000 7f559cff9700 1 -- 172.21.15.60:0/2289829085 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f55980892f0 con 0x7f55a01449d0 2023-07-12T02:02:36.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.162+0000 7f559ffff700 1 --2- 172.21.15.60:0/2289829085 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f558006ace0 0x7f558006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:36.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.162+0000 7f559ffff700 1 --2- 172.21.15.60:0/2289829085 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f558006ace0 0x7f558006d190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5588000f60 tx=0x7f5588009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:36.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.166+0000 7f559cff9700 1 -- 172.21.15.60:0/2289829085 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f55a00b2fa0 con 0x7f55a01449d0 2023-07-12T02:02:36.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.364+0000 7f55a658c700 1 -- 172.21.15.60:0/2289829085 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f55a00b2fa0 con 0x7f55a01449d0 2023-07-12T02:02:36.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.365+0000 7f559cff9700 1 -- 172.21.15.60:0/2289829085 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18173 (secure 0 0 0) 0x7f55a00b2fa0 con 0x7f55a01449d0 2023-07-12T02:02:36.369 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:02:36.370 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":21,"fsid":"97e7c909-e567-472e-a5aa-72fde15171f2","created":"2023-07-12T02:01:53.987086+0000","modified":"2023-07-12T02:02:14.307912+0000","last_up_change":"2023-07-12T02:02:04.031780+0000","last_in_change":"2023-07-12T02:01:56.538621+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-12T02:02:05.375042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-12T02:02:05.857441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:02:10.574633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-12T02:02:11.699872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ed8b71c2-3895-4952-a118-16ede0b4a98c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6801","nonce":2818935979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6803","nonce":2818935979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6807","nonce":2818935979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6805","nonce":2818935979}]},"public_addr":"172.21.15.60:6801/2818935979","cluster_addr":"172.21.15.60:6803/2818935979","heartbeat_back_addr":"172.21.15.60:6807/2818935979","heartbeat_front_addr":"172.21.15.60:6805/2818935979","state":["exists","up"]},{"osd":1,"uuid":"7cf4d354-78e0-43ce-8c09-4a7d2a0b57a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6817","nonce":1678864191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6819","nonce":1678864191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6823","nonce":1678864191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6821","nonce":1678864191}]},"public_addr":"172.21.15.60:6817/1678864191","cluster_addr":"172.21.15.60:6819/1678864191","heartbeat_back_addr":"172.21.15.60:6823/1678864191","heartbeat_front_addr":"172.21.15.60:6821/1678864191","state":["exists","up"]},{"osd":2,"uuid":"02c958b8-9599-4470-92cb-8f7018ec0189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6809","nonce":1459480680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6811","nonce":1459480680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6815","nonce":1459480680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6813","nonce":1459480680}]},"public_addr":"172.21.15.60:6809/1459480680","cluster_addr":"172.21.15.60:6811/1459480680","heartbeat_back_addr":"172.21.15.60:6815/1459480680","heartbeat_front_addr":"172.21.15.60:6813/1459480680","state":["exists","up"]},{"osd":3,"uuid":"bc300432-a228-4257-be5c-e42dd5f2015f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6825","nonce":3295100060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6827","nonce":3295100060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6831","nonce":3295100060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6829","nonce":3295100060}]},"public_addr":"172.21.15.60:6825/3295100060","cluster_addr":"172.21.15.60:6827/3295100060","heartbeat_back_addr":"172.21.15.60:6831/3295100060","heartbeat_front_addr":"172.21.15.60:6829/3295100060","state":["exists","up"]},{"osd":4,"uuid":"ad9f7dc4-7126-466d-a656-2844880c6060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6809","nonce":4127109138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6811","nonce":4127109138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6815","nonce":4127109138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6813","nonce":4127109138}]},"public_addr":"172.21.15.79:6809/4127109138","cluster_addr":"172.21.15.79:6811/4127109138","heartbeat_back_addr":"172.21.15.79:6815/4127109138","heartbeat_front_addr":"172.21.15.79:6813/4127109138","state":["exists","up"]},{"osd":5,"uuid":"e88d16ca-0b01-4ab9-8aa8-c4aff7f210f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6801","nonce":421449406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6803","nonce":421449406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6807","nonce":421449406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6805","nonce":421449406}]},"public_addr":"172.21.15.79:6801/421449406","cluster_addr":"172.21.15.79:6803/421449406","heartbeat_back_addr":"172.21.15.79:6807/421449406","heartbeat_front_addr":"172.21.15.79:6805/421449406","state":["exists","up"]},{"osd":6,"uuid":"6898cb84-56d1-48a9-bd45-97e4668e2fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6825","nonce":4144355139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6827","nonce":4144355139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6831","nonce":4144355139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6829","nonce":4144355139}]},"public_addr":"172.21.15.79:6825/4144355139","cluster_addr":"172.21.15.79:6827/4144355139","heartbeat_back_addr":"172.21.15.79:6831/4144355139","heartbeat_front_addr":"172.21.15.79:6829/4144355139","state":["exists","up"]},{"osd":7,"uuid":"65c10882-371e-4762-b384-9c3a48f332ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6817","nonce":2845223299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6819","nonce":2845223299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6823","nonce":2845223299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6821","nonce":2845223299}]},"public_addr":"172.21.15.79:6817/2845223299","cluster_addr":"172.21.15.79:6819/2845223299","heartbeat_back_addr":"172.21.15.79:6823/2845223299","heartbeat_front_addr":"172.21.15.79:6821/2845223299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.634716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.758349+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.728366+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.777395+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707262+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.649705+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.693021+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:02:36.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.367+0000 7f55a658c700 1 -- 172.21.15.60:0/2289829085 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f558006ace0 msgr2=0x7f558006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:36.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.367+0000 7f55a658c700 1 --2- 172.21.15.60:0/2289829085 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f558006ace0 0x7f558006d190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5588000f60 tx=0x7f5588009040 comp rx=0 tx=0).stop 2023-07-12T02:02:36.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.367+0000 7f55a658c700 1 -- 172.21.15.60:0/2289829085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55a01449d0 msgr2=0x7f55a00b6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:36.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.367+0000 7f55a658c700 1 --2- 172.21.15.60:0/2289829085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55a01449d0 0x7f55a00b6050 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f559800cc70 tx=0x7f559800a340 comp rx=0 tx=0).stop 2023-07-12T02:02:36.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.367+0000 7f55a658c700 1 -- 172.21.15.60:0/2289829085 shutdown_connections 2023-07-12T02:02:36.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.367+0000 7f55a658c700 1 --2- 172.21.15.60:0/2289829085 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f558006ace0 0x7f558006d190 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:36.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.367+0000 7f55a658c700 1 --2- 172.21.15.60:0/2289829085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55a01449d0 0x7f55a00b6050 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:36.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.367+0000 7f55a658c700 1 --2- 172.21.15.60:0/2289829085 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55a00b8d90 0x7f55a00b2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:36.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.367+0000 7f55a658c700 1 --2- 172.21.15.60:0/2289829085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55a00bc810 0x7f55a00b4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:36.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.367+0000 7f55a658c700 1 -- 172.21.15.60:0/2289829085 >> 172.21.15.60:0/2289829085 conn(0x7f55a00c0860 msgr2=0x7f55a00bef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:36.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.367+0000 7f55a658c700 1 -- 172.21.15.60:0/2289829085 shutdown_connections 2023-07-12T02:02:36.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.367+0000 7f55a658c700 1 -- 172.21.15.60:0/2289829085 wait complete. 2023-07-12T02:02:36.383 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-12T02:02:05.375042+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-12T02:02:05.857441+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-12T02:02:10.574633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-12T02:02:11.699872+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-12T02:02:36.384 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-12T02:02:36.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.508+0000 7f4f19d57700 1 Processor -- start 2023-07-12T02:02:36.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.508+0000 7f4f19d57700 1 -- start start 2023-07-12T02:02:36.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.509+0000 7f4f19d57700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4f141449d0 0x7f4f1414db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:36.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.509+0000 7f4f19d57700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4f140bc810 0x7f4f140ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:36.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.509+0000 7f4f19d57700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f140b8d90 0x7f4f1406ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:36.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.509+0000 7f4f19d57700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f140b97a0 con 0x7f4f141449d0 2023-07-12T02:02:36.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.509+0000 7f4f19d57700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f14144da0 con 0x7f4f140bc810 2023-07-12T02:02:36.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.509+0000 7f4f19d57700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f140b8620 con 0x7f4f140b8d90 2023-07-12T02:02:36.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.509+0000 7f4f137fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4f141449d0 0x7f4f1414db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:36.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.509+0000 7f4f137fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4f141449d0 0x7f4f1414db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47360/0 (socket says 172.21.15.60:47360) 2023-07-12T02:02:36.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.509+0000 7f4f137fe700 1 -- 172.21.15.60:0/1176273882 learned_addr learned my addr 172.21.15.60:0/1176273882 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:36.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.509+0000 7f4f13fff700 1 --2- 172.21.15.60:0/1176273882 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f140b8d90 0x7f4f1406ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:36.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.509+0000 7f4f12ffd700 1 --2- 172.21.15.60:0/1176273882 >> v2:172.21.15.79:3300/0 conn(0x7f4f140bc810 0x7f4f140ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:36.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.509+0000 7f4f137fe700 1 -- 172.21.15.60:0/1176273882 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f140b8d90 msgr2=0x7f4f1406ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:36.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.509+0000 7f4f137fe700 1 --2- 172.21.15.60:0/1176273882 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f140b8d90 0x7f4f1406ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:36.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.509+0000 7f4f137fe700 1 -- 172.21.15.60:0/1176273882 >> v2:172.21.15.79:3300/0 conn(0x7f4f140bc810 msgr2=0x7f4f140ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:36.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.509+0000 7f4f137fe700 1 --2- 172.21.15.60:0/1176273882 >> v2:172.21.15.79:3300/0 conn(0x7f4f140bc810 0x7f4f140ba530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:36.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.509+0000 7f4f137fe700 1 -- 172.21.15.60:0/1176273882 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f140b8900 con 0x7f4f141449d0 2023-07-12T02:02:36.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.509+0000 7f4f13fff700 1 --2- 172.21.15.60:0/1176273882 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f140b8d90 0x7f4f1406ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:02:36.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.509+0000 7f4f137fe700 1 --2- 172.21.15.60:0/1176273882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f141449d0 0x7f4f1414db50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4f1406ce40 tx=0x7f4f04009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4d538e6c1c31c65 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:36.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.510+0000 7f4f127fc700 1 -- 172.21.15.60:0/1176273882 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0400b870 con 0x7f4f141449d0 2023-07-12T02:02:36.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.510+0000 7f4f127fc700 1 -- 172.21.15.60:0/1176273882 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f0400b9d0 con 0x7f4f141449d0 2023-07-12T02:02:36.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.510+0000 7f4f127fc700 1 -- 172.21.15.60:0/1176273882 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0400bd60 con 0x7f4f141449d0 2023-07-12T02:02:36.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.510+0000 7f4f19d57700 1 -- 172.21.15.60:0/1176273882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f141449d0 msgr2=0x7f4f1414db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:36.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.510+0000 7f4f19d57700 1 --2- 172.21.15.60:0/1176273882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f141449d0 0x7f4f1414db50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4f1406ce40 tx=0x7f4f04009bd0 comp rx=0 tx=0).stop 2023-07-12T02:02:36.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.510+0000 7f4f19d57700 1 -- 172.21.15.60:0/1176273882 shutdown_connections 2023-07-12T02:02:36.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.510+0000 7f4f19d57700 1 --2- 172.21.15.60:0/1176273882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f141449d0 0x7f4f1414db50 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:36.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.510+0000 7f4f19d57700 1 --2- 172.21.15.60:0/1176273882 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f140b8d90 0x7f4f1406ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:36.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.510+0000 7f4f19d57700 1 --2- 172.21.15.60:0/1176273882 >> v2:172.21.15.79:3300/0 conn(0x7f4f140bc810 0x7f4f140ba530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:36.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.510+0000 7f4f19d57700 1 -- 172.21.15.60:0/1176273882 >> 172.21.15.60:0/1176273882 conn(0x7f4f140c0860 msgr2=0x7f4f140c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:36.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.510+0000 7f4f19d57700 1 -- 172.21.15.60:0/1176273882 shutdown_connections 2023-07-12T02:02:36.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.510+0000 7f4f19d57700 1 -- 172.21.15.60:0/1176273882 wait complete. 2023-07-12T02:02:36.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.511+0000 7f4f19d57700 1 Processor -- start 2023-07-12T02:02:36.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.512+0000 7f4f19d57700 1 -- start start 2023-07-12T02:02:36.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.512+0000 7f4f19d57700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f140b8d90 0x7f4f141d4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:36.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.512+0000 7f4f19d57700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f140bc810 0x7f4f141dff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:36.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.512+0000 7f4f19d57700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f141449d0 0x7f4f141d56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:36.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.512+0000 7f4f19d57700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f141d3c90 con 0x7f4f140bc810 2023-07-12T02:02:36.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.512+0000 7f4f19d57700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1414d560 con 0x7f4f141449d0 2023-07-12T02:02:36.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.512+0000 7f4f19d57700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f141df750 con 0x7f4f140b8d90 2023-07-12T02:02:36.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.512+0000 7f4f12ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f140bc810 0x7f4f141dff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:36.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.512+0000 7f4f12ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f140bc810 0x7f4f141dff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47368/0 (socket says 172.21.15.60:47368) 2023-07-12T02:02:36.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.512+0000 7f4f12ffd700 1 -- 172.21.15.60:0/3614621102 learned_addr learned my addr 172.21.15.60:0/3614621102 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:36.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.512+0000 7f4f137fe700 1 --2- 172.21.15.60:0/3614621102 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f140b8d90 0x7f4f141d4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:36.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.512+0000 7f4f13fff700 1 --2- 172.21.15.60:0/3614621102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f141449d0 0x7f4f141d56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:36.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.513+0000 7f4f12ffd700 1 -- 172.21.15.60:0/3614621102 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f140b8d90 msgr2=0x7f4f141d4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:36.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.513+0000 7f4f12ffd700 1 --2- 172.21.15.60:0/3614621102 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f140b8d90 0x7f4f141d4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:36.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.513+0000 7f4f12ffd700 1 -- 172.21.15.60:0/3614621102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f141449d0 msgr2=0x7f4f141d56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:36.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.513+0000 7f4f12ffd700 1 --2- 172.21.15.60:0/3614621102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f141449d0 0x7f4f141d56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:36.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.513+0000 7f4f12ffd700 1 -- 172.21.15.60:0/3614621102 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f04009550 con 0x7f4f140bc810 2023-07-12T02:02:36.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.513+0000 7f4f12ffd700 1 --2- 172.21.15.60:0/3614621102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f140bc810 0x7f4f141dff10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4efc00c7f0 tx=0x7f4efc00cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:36.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.513+0000 7f4f0bfff700 1 -- 172.21.15.60:0/3614621102 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc004220 con 0x7f4f140bc810 2023-07-12T02:02:36.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.513+0000 7f4f0bfff700 1 -- 172.21.15.60:0/3614621102 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4efc004380 con 0x7f4f140bc810 2023-07-12T02:02:36.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.513+0000 7f4f19d57700 1 -- 172.21.15.60:0/3614621102 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f141d3ee0 con 0x7f4f140bc810 2023-07-12T02:02:36.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.513+0000 7f4f0bfff700 1 -- 172.21.15.60:0/3614621102 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc0036a0 con 0x7f4f140bc810 2023-07-12T02:02:36.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.513+0000 7f4f19d57700 1 -- 172.21.15.60:0/3614621102 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f141d41c0 con 0x7f4f140bc810 2023-07-12T02:02:36.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.514+0000 7f4f19d57700 1 -- 172.21.15.60:0/3614621102 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f141dfc30 con 0x7f4f140bc810 2023-07-12T02:02:36.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.514+0000 7f4f0bfff700 1 -- 172.21.15.60:0/3614621102 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4efc003800 con 0x7f4f140bc810 2023-07-12T02:02:36.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.515+0000 7f4f0bfff700 1 --2- 172.21.15.60:0/3614621102 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f4ef406ace0 0x7f4ef406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:36.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.515+0000 7f4f0bfff700 1 -- 172.21.15.60:0/3614621102 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4efc089010 con 0x7f4f140bc810 2023-07-12T02:02:36.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.515+0000 7f4f137fe700 1 --2- 172.21.15.60:0/3614621102 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f4ef406ace0 0x7f4ef406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:36.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.516+0000 7f4f137fe700 1 --2- 172.21.15.60:0/3614621102 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f4ef406ace0 0x7f4ef406d190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4f04014040 tx=0x7f4f04008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:36.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.519+0000 7f4f0bfff700 1 -- 172.21.15.60:0/3614621102 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f4efc057ab0 con 0x7f4f140bc810 2023-07-12T02:02:36.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.717+0000 7f4f19d57700 1 -- 172.21.15.60:0/3614621102 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4f14074360 con 0x7f4f140bc810 2023-07-12T02:02:36.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.718+0000 7f4f0bfff700 1 -- 172.21.15.60:0/3614621102 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4efc01e0a0 con 0x7f4f140bc810 2023-07-12T02:02:36.723 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2023-07-12T02:02:36.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.720+0000 7f4f19d57700 1 -- 172.21.15.60:0/3614621102 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f4ef406ace0 msgr2=0x7f4ef406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:36.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.720+0000 7f4f19d57700 1 --2- 172.21.15.60:0/3614621102 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f4ef406ace0 0x7f4ef406d190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4f04014040 tx=0x7f4f04008030 comp rx=0 tx=0).stop 2023-07-12T02:02:36.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.720+0000 7f4f19d57700 1 -- 172.21.15.60:0/3614621102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f140bc810 msgr2=0x7f4f141dff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:36.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.720+0000 7f4f19d57700 1 --2- 172.21.15.60:0/3614621102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f140bc810 0x7f4f141dff10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4efc00c7f0 tx=0x7f4efc00cb00 comp rx=0 tx=0).stop 2023-07-12T02:02:36.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.720+0000 7f4f19d57700 1 -- 172.21.15.60:0/3614621102 shutdown_connections 2023-07-12T02:02:36.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.720+0000 7f4f19d57700 1 --2- 172.21.15.60:0/3614621102 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f4ef406ace0 0x7f4ef406d190 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:36.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.720+0000 7f4f19d57700 1 --2- 172.21.15.60:0/3614621102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f141449d0 0x7f4f141d56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:36.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.720+0000 7f4f19d57700 1 --2- 172.21.15.60:0/3614621102 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4f140b8d90 0x7f4f141d4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:36.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.720+0000 7f4f19d57700 1 --2- 172.21.15.60:0/3614621102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f140bc810 0x7f4f141dff10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:36.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.720+0000 7f4f19d57700 1 -- 172.21.15.60:0/3614621102 >> 172.21.15.60:0/3614621102 conn(0x7f4f140c0860 msgr2=0x7f4f1414e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:36.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.720+0000 7f4f19d57700 1 -- 172.21.15.60:0/3614621102 shutdown_connections 2023-07-12T02:02:36.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.720+0000 7f4f19d57700 1 -- 172.21.15.60:0/3614621102 wait complete. 2023-07-12T02:02:36.736 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-12T02:02:36.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.860+0000 7f6739480700 1 Processor -- start 2023-07-12T02:02:36.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.860+0000 7f6739480700 1 -- start start 2023-07-12T02:02:36.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.861+0000 7f6739480700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f67341449d0 0x7f673414db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:36.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.861+0000 7f6739480700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f67340b8d90 0x7f673406ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:36.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.861+0000 7f6739480700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67340b8620 con 0x7f67340bc810 2023-07-12T02:02:36.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.861+0000 7f6739480700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67340b97a0 con 0x7f67341449d0 2023-07-12T02:02:36.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.861+0000 7f6739480700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6734144da0 con 0x7f67340b8d90 2023-07-12T02:02:36.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.861+0000 7f6732ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f67341449d0 0x7f673414db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:36.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.861+0000 7f6732ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f67341449d0 0x7f673414db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47384/0 (socket says 172.21.15.60:47384) 2023-07-12T02:02:36.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.862+0000 7f6732ffd700 1 -- 172.21.15.60:0/2770882803 learned_addr learned my addr 172.21.15.60:0/2770882803 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:36.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.862+0000 7f67337fe700 1 --2- 172.21.15.60:0/2770882803 >> v2:172.21.15.79:3300/0 conn(0x7f67340b8d90 0x7f673406ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:36.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.862+0000 7f6732ffd700 1 -- 172.21.15.60:0/2770882803 >> v2:172.21.15.79:3300/0 conn(0x7f67340b8d90 msgr2=0x7f673406ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:36.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.862+0000 7f6732ffd700 1 --2- 172.21.15.60:0/2770882803 >> v2:172.21.15.79:3300/0 conn(0x7f67340b8d90 0x7f673406ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:36.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.862+0000 7f6732ffd700 1 -- 172.21.15.60:0/2770882803 >> v1:172.21.15.79:6789/0 conn(0x7f67340bc810 legacy=0x7f67340ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:36.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.862+0000 7f6732ffd700 1 -- 172.21.15.60:0/2770882803 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67340b8900 con 0x7f67341449d0 2023-07-12T02:02:36.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.862+0000 7f6732ffd700 1 --2- 172.21.15.60:0/2770882803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67341449d0 0x7f673414db50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f67340be710 tx=0x7f6728009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44033f4fd25747d7 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:36.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.862+0000 7f6731ffb700 1 -- 172.21.15.60:0/2770882803 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6728011830 con 0x7f67341449d0 2023-07-12T02:02:36.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.862+0000 7f6731ffb700 1 -- 172.21.15.60:0/2770882803 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6728011990 con 0x7f67341449d0 2023-07-12T02:02:36.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.862+0000 7f6731ffb700 1 -- 172.21.15.60:0/2770882803 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6728011d20 con 0x7f67341449d0 2023-07-12T02:02:36.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.863+0000 7f6739480700 1 -- 172.21.15.60:0/2770882803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67341449d0 msgr2=0x7f673414db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:36.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.863+0000 7f6739480700 1 --2- 172.21.15.60:0/2770882803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67341449d0 0x7f673414db50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f67340be710 tx=0x7f6728009bd0 comp rx=0 tx=0).stop 2023-07-12T02:02:36.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.863+0000 7f6739480700 1 -- 172.21.15.60:0/2770882803 shutdown_connections 2023-07-12T02:02:36.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.863+0000 7f6739480700 1 --2- 172.21.15.60:0/2770882803 >> v2:172.21.15.79:3300/0 conn(0x7f67340b8d90 0x7f673406ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:36.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.863+0000 7f6739480700 1 --2- 172.21.15.60:0/2770882803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67341449d0 0x7f673414db50 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:36.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.863+0000 7f6739480700 1 -- 172.21.15.60:0/2770882803 >> 172.21.15.60:0/2770882803 conn(0x7f67340c0860 msgr2=0x7f67340c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:36.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.863+0000 7f6739480700 1 -- 172.21.15.60:0/2770882803 shutdown_connections 2023-07-12T02:02:36.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.863+0000 7f6739480700 1 -- 172.21.15.60:0/2770882803 wait complete. 2023-07-12T02:02:36.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.864+0000 7f6739480700 1 Processor -- start 2023-07-12T02:02:36.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.864+0000 7f6739480700 1 -- start start 2023-07-12T02:02:36.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.865+0000 7f6739480700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67340b8d90 0x7f67341d62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:36.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.865+0000 7f6739480700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f67340bc810 0x7f67341e3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:36.871 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.865+0000 7f6739480700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67341449d0 0x7f67341e3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:36.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.865+0000 7f6739480700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67341451d0 con 0x7f67341449d0 2023-07-12T02:02:36.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.865+0000 7f6739480700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67341d6800 con 0x7f67340b8d90 2023-07-12T02:02:36.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.865+0000 7f6739480700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6734144ef0 con 0x7f67340bc810 2023-07-12T02:02:36.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.865+0000 7f6732ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67340b8d90 0x7f67341d62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:36.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.865+0000 7f6732ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67340b8d90 0x7f67341d62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.60:43708/0 (socket says 172.21.15.60:43708) 2023-07-12T02:02:36.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.865+0000 7f6732ffd700 1 -- 172.21.15.60:0/1795842928 learned_addr learned my addr 172.21.15.60:0/1795842928 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:36.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.865+0000 7f67337fe700 1 --2- 172.21.15.60:0/1795842928 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67341449d0 0x7f67341e3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:36.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.865+0000 7f67327fc700 1 --2- 172.21.15.60:0/1795842928 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f67340bc810 0x7f67341e3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:36.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.866+0000 7f67337fe700 1 -- 172.21.15.60:0/1795842928 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f67340bc810 msgr2=0x7f67341e3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:36.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.866+0000 7f67337fe700 1 --2- 172.21.15.60:0/1795842928 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f67340bc810 0x7f67341e3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:36.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.866+0000 7f67337fe700 1 -- 172.21.15.60:0/1795842928 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67340b8d90 msgr2=0x7f67341d62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:36.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.866+0000 7f67337fe700 1 --2- 172.21.15.60:0/1795842928 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67340b8d90 0x7f67341d62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:36.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.866+0000 7f67337fe700 1 -- 172.21.15.60:0/1795842928 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6728009550 con 0x7f67341449d0 2023-07-12T02:02:36.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.866+0000 7f6732ffd700 1 --2- 172.21.15.60:0/1795842928 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67340b8d90 0x7f67341d62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:02:36.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.866+0000 7f67337fe700 1 --2- 172.21.15.60:0/1795842928 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67341449d0 0x7f67341e3860 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f672c00efc0 tx=0x7f672c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:36.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.867+0000 7f671b7fe700 1 -- 172.21.15.60:0/1795842928 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c00cc90 con 0x7f67341449d0 2023-07-12T02:02:36.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.867+0000 7f6739480700 1 -- 172.21.15.60:0/1795842928 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67340b3f50 con 0x7f67341449d0 2023-07-12T02:02:36.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.867+0000 7f671b7fe700 1 -- 172.21.15.60:0/1795842928 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f672c00f040 con 0x7f67341449d0 2023-07-12T02:02:36.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.867+0000 7f671b7fe700 1 -- 172.21.15.60:0/1795842928 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c0146c0 con 0x7f67341449d0 2023-07-12T02:02:36.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.868+0000 7f6739480700 1 -- 172.21.15.60:0/1795842928 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67340b4510 con 0x7f67341449d0 2023-07-12T02:02:36.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.869+0000 7f6739480700 1 -- 172.21.15.60:0/1795842928 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67340b3db0 con 0x7f67341449d0 2023-07-12T02:02:36.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.869+0000 7f671b7fe700 1 -- 172.21.15.60:0/1795842928 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f672c014820 con 0x7f67341449d0 2023-07-12T02:02:36.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.869+0000 7f671b7fe700 1 --2- 172.21.15.60:0/1795842928 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f672006ace0 0x7f672006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:36.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.869+0000 7f671b7fe700 1 -- 172.21.15.60:0/1795842928 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f672c08a030 con 0x7f67341449d0 2023-07-12T02:02:36.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.869+0000 7f6732ffd700 1 --2- 172.21.15.60:0/1795842928 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f672006ace0 0x7f672006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:36.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.870+0000 7f6732ffd700 1 --2- 172.21.15.60:0/1795842928 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f672006ace0 0x7f672006d190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6728009fd0 tx=0x7f6728008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:36.877 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:36.874+0000 7f671b7fe700 1 -- 172.21.15.60:0/1795842928 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f67340b3db0 con 0x7f67341449d0 2023-07-12T02:02:37.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.067+0000 7f6739480700 1 -- 172.21.15.60:0/1795842928 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f67340b3db0 con 0x7f67341449d0 2023-07-12T02:02:37.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.068+0000 7f671b7fe700 1 -- 172.21.15.60:0/1795842928 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f67340b3db0 con 0x7f67341449d0 2023-07-12T02:02:37.072 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-07-12T02:02:37.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.070+0000 7f6739480700 1 -- 172.21.15.60:0/1795842928 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f672006ace0 msgr2=0x7f672006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:37.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.070+0000 7f6739480700 1 --2- 172.21.15.60:0/1795842928 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f672006ace0 0x7f672006d190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6728009fd0 tx=0x7f6728008030 comp rx=0 tx=0).stop 2023-07-12T02:02:37.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.070+0000 7f6739480700 1 -- 172.21.15.60:0/1795842928 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67341449d0 msgr2=0x7f67341e3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:37.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.070+0000 7f6739480700 1 --2- 172.21.15.60:0/1795842928 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67341449d0 0x7f67341e3860 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f672c00efc0 tx=0x7f672c00c3a0 comp rx=0 tx=0).stop 2023-07-12T02:02:37.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.070+0000 7f6739480700 1 -- 172.21.15.60:0/1795842928 shutdown_connections 2023-07-12T02:02:37.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.070+0000 7f6739480700 1 --2- 172.21.15.60:0/1795842928 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f672006ace0 0x7f672006d190 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:37.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.070+0000 7f6739480700 1 --2- 172.21.15.60:0/1795842928 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67341449d0 0x7f67341e3860 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:37.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.070+0000 7f6739480700 1 --2- 172.21.15.60:0/1795842928 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67340b8d90 0x7f67341d62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:37.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.070+0000 7f6739480700 1 --2- 172.21.15.60:0/1795842928 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f67340bc810 0x7f67341e3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:37.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.070+0000 7f6739480700 1 -- 172.21.15.60:0/1795842928 >> 172.21.15.60:0/1795842928 conn(0x7f67340c0860 msgr2=0x7f67340bfa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:37.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.070+0000 7f6739480700 1 -- 172.21.15.60:0/1795842928 shutdown_connections 2023-07-12T02:02:37.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.070+0000 7f6739480700 1 -- 172.21.15.60:0/1795842928 wait complete. 2023-07-12T02:02:37.086 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-12T02:02:37.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.211+0000 7f184033c700 1 Processor -- start 2023-07-12T02:02:37.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.211+0000 7f184033c700 1 -- start start 2023-07-12T02:02:37.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.212+0000 7f184033c700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f18380b9340 0x7f1838071410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:37.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.212+0000 7f184033c700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f183806fb30 con 0x7f183806b120 2023-07-12T02:02:37.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.212+0000 7f184033c700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f183806f4e0 con 0x7f18380b3b50 2023-07-12T02:02:37.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.212+0000 7f184033c700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f183806f7c0 con 0x7f18380b9340 2023-07-12T02:02:37.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.212+0000 7f183e0d8700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f183806b120 0x7f1838140ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48564/0 (socket says 172.21.15.60:48564) 2023-07-12T02:02:37.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.212+0000 7f183e0d8700 1 -- 172.21.15.60:0/1787193503 learned_addr learned my addr 172.21.15.60:0/1787193503 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:37.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.212+0000 7f183d0d6700 1 -- 172.21.15.60:0/1787193503 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1955455747 0 0) 0x7f183806fb30 con 0x7f183806b120 2023-07-12T02:02:37.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.212+0000 7f183d8d7700 1 --2- 172.21.15.60:0/1787193503 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f18380b9340 0x7f1838071410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:37.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.212+0000 7f183d0d6700 1 -- 172.21.15.60:0/1787193503 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18240035b0 con 0x7f183806b120 2023-07-12T02:02:37.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.212+0000 7f183d0d6700 1 -- 172.21.15.60:0/1787193503 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3609384008 0 0) 0x7f18240035b0 con 0x7f183806b120 2023-07-12T02:02:37.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.212+0000 7f183d0d6700 1 -- 172.21.15.60:0/1787193503 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f18380b9340 msgr2=0x7f1838071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:37.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.212+0000 7f183d0d6700 1 --2- 172.21.15.60:0/1787193503 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f18380b9340 0x7f1838071410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:37.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.212+0000 7f183d0d6700 1 -- 172.21.15.60:0/1787193503 >> v1:172.21.15.79:6789/0 conn(0x7f18380b3b50 legacy=0x7f1838151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:37.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.213+0000 7f183d0d6700 1 -- 172.21.15.60:0/1787193503 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18381411e0 con 0x7f183806b120 2023-07-12T02:02:37.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.213+0000 7f183d0d6700 1 -- 172.21.15.60:0/1787193503 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1141905739 0 0) 0x7f1834001670 con 0x7f183806b120 2023-07-12T02:02:37.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.213+0000 7f183d0d6700 1 -- 172.21.15.60:0/1787193503 >> v1:172.21.15.60:6789/0 conn(0x7f183806b120 legacy=0x7f1838140ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:37.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.213+0000 7f183d0d6700 1 --2- 172.21.15.60:0/1787193503 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1824003a30 0x7f1824003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:37.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.213+0000 7f183d0d6700 1 --2- 172.21.15.60:0/1787193503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1824004850 0x7f1824004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:37.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.213+0000 7f183d0d6700 1 --2- 172.21.15.60:0/1787193503 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f18380b9340 0x7f1824005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:37.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.213+0000 7f183d0d6700 1 -- 172.21.15.60:0/1787193503 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183806f7c0 con 0x7f1824003a30 2023-07-12T02:02:37.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.213+0000 7f183d0d6700 1 -- 172.21.15.60:0/1787193503 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182400baf0 con 0x7f1824004850 2023-07-12T02:02:37.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.213+0000 7f183d0d6700 1 -- 172.21.15.60:0/1787193503 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f182400bcb0 con 0x7f18380b9340 2023-07-12T02:02:37.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.213+0000 7f183e0d8700 1 --2- 172.21.15.60:0/1787193503 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1824003a30 0x7f1824003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:37.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.213+0000 7f183d8d7700 1 --2- 172.21.15.60:0/1787193503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1824004850 0x7f1824004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:37.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.213+0000 7f183e8d9700 1 --2- 172.21.15.60:0/1787193503 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f18380b9340 0x7f1824005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:37.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.213+0000 7f183e0d8700 1 -- 172.21.15.60:0/1787193503 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f18380b9340 msgr2=0x7f1824005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:37.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.213+0000 7f183e0d8700 1 --2- 172.21.15.60:0/1787193503 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f18380b9340 0x7f1824005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:37.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.213+0000 7f183e0d8700 1 -- 172.21.15.60:0/1787193503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1824004850 msgr2=0x7f1824004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:37.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.213+0000 7f183e0d8700 1 --2- 172.21.15.60:0/1787193503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1824004850 0x7f1824004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:37.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.213+0000 7f183e0d8700 1 -- 172.21.15.60:0/1787193503 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18240035b0 con 0x7f1824003a30 2023-07-12T02:02:37.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.213+0000 7f183e0d8700 1 --2- 172.21.15.60:0/1787193503 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1824003a30 0x7f1824003e40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1834007c90 tx=0x7f1824005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c30cc2dbe969fe82 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:37.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.213+0000 7f183d0d6700 1 -- 172.21.15.60:0/1787193503 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183400ccd0 con 0x7f1824003a30 2023-07-12T02:02:37.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.213+0000 7f183d0d6700 1 -- 172.21.15.60:0/1787193503 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183400ce50 con 0x7f1824003a30 2023-07-12T02:02:37.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.213+0000 7f183d0d6700 1 -- 172.21.15.60:0/1787193503 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1834005ba0 con 0x7f1824003a30 2023-07-12T02:02:37.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.214+0000 7f184033c700 1 -- 172.21.15.60:0/1787193503 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1824003a30 msgr2=0x7f1824003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:37.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.214+0000 7f184033c700 1 --2- 172.21.15.60:0/1787193503 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1824003a30 0x7f1824003e40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1834007c90 tx=0x7f1824005880 comp rx=0 tx=0).stop 2023-07-12T02:02:37.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.214+0000 7f183e8d9700 1 -- 172.21.15.60:0/1787193503 reap_dead start 2023-07-12T02:02:37.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.214+0000 7f184033c700 1 -- 172.21.15.60:0/1787193503 shutdown_connections 2023-07-12T02:02:37.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.214+0000 7f184033c700 1 -- 172.21.15.60:0/1787193503 >> 172.21.15.60:0/1787193503 conn(0x7f18380bd980 msgr2=0x7f18380b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:37.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.214+0000 7f184033c700 1 -- 172.21.15.60:0/1787193503 shutdown_connections 2023-07-12T02:02:37.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.214+0000 7f184033c700 1 -- 172.21.15.60:0/1787193503 wait complete. 2023-07-12T02:02:37.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.215+0000 7f184033c700 1 Processor -- start 2023-07-12T02:02:37.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.215+0000 7f184033c700 1 -- start start 2023-07-12T02:02:37.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.216+0000 7f184033c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1824003a30 0x7f1838147510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:37.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.216+0000 7f184033c700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f18380b5cb0 0x7f18381df920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:37.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.216+0000 7f184033c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18381d0fd0 0x7f183812fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:37.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.216+0000 7f184033c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18380b6770 con 0x7f1824003a30 2023-07-12T02:02:37.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.216+0000 7f184033c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18381e2e70 con 0x7f18381d0fd0 2023-07-12T02:02:37.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.216+0000 7f184033c700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18381e3150 con 0x7f18380b5cb0 2023-07-12T02:02:37.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.216+0000 7f183e0d8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1824003a30 0x7f1838147510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:37.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.216+0000 7f183e0d8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1824003a30 0x7f1838147510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40730/0 (socket says 172.21.15.60:40730) 2023-07-12T02:02:37.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.216+0000 7f183e0d8700 1 -- 172.21.15.60:0/2118739567 learned_addr learned my addr 172.21.15.60:0/2118739567 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:37.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.216+0000 7f183e8d9700 1 --2- 172.21.15.60:0/2118739567 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18381d0fd0 0x7f183812fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:37.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.216+0000 7f183d8d7700 1 --2- 172.21.15.60:0/2118739567 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f18380b5cb0 0x7f18381df920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:37.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.216+0000 7f183e0d8700 1 -- 172.21.15.60:0/2118739567 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f18380b5cb0 msgr2=0x7f18381df920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:37.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.216+0000 7f183e0d8700 1 --2- 172.21.15.60:0/2118739567 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f18380b5cb0 0x7f18381df920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:37.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.216+0000 7f183e0d8700 1 -- 172.21.15.60:0/2118739567 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18381d0fd0 msgr2=0x7f183812fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:37.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.216+0000 7f183e0d8700 1 --2- 172.21.15.60:0/2118739567 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18381d0fd0 0x7f183812fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:37.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.216+0000 7f183e0d8700 1 -- 172.21.15.60:0/2118739567 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f183806f2b0 con 0x7f1824003a30 2023-07-12T02:02:37.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.216+0000 7f183d8d7700 1 --2- 172.21.15.60:0/2118739567 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f18380b5cb0 0x7f18381df920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:37.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.216+0000 7f183e0d8700 1 --2- 172.21.15.60:0/2118739567 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1824003a30 0x7f1838147510 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f183400c720 tx=0x7f1834001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:37.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.216+0000 7f182effd700 1 -- 172.21.15.60:0/2118739567 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1834004d40 con 0x7f1824003a30 2023-07-12T02:02:37.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.216+0000 7f182effd700 1 -- 172.21.15.60:0/2118739567 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18340070d0 con 0x7f1824003a30 2023-07-12T02:02:37.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.216+0000 7f184033c700 1 -- 172.21.15.60:0/2118739567 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18381e3430 con 0x7f1824003a30 2023-07-12T02:02:37.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.216+0000 7f182effd700 1 -- 172.21.15.60:0/2118739567 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1834004ea0 con 0x7f1824003a30 2023-07-12T02:02:37.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.216+0000 7f184033c700 1 -- 172.21.15.60:0/2118739567 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18380b4000 con 0x7f1824003a30 2023-07-12T02:02:37.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.217+0000 7f184033c700 1 -- 172.21.15.60:0/2118739567 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1838074360 con 0x7f1824003a30 2023-07-12T02:02:37.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.218+0000 7f182effd700 1 -- 172.21.15.60:0/2118739567 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1834007480 con 0x7f1824003a30 2023-07-12T02:02:37.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.218+0000 7f182effd700 1 --2- 172.21.15.60:0/2118739567 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f181c06ace0 0x7f181c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:37.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.218+0000 7f182effd700 1 -- 172.21.15.60:0/2118739567 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f183408a470 con 0x7f1824003a30 2023-07-12T02:02:37.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.218+0000 7f183d8d7700 1 --2- 172.21.15.60:0/2118739567 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f181c06ace0 0x7f181c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:37.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.219+0000 7f183d8d7700 1 --2- 172.21.15.60:0/2118739567 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f181c06ace0 0x7f181c06d190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1838130bc0 tx=0x7f1828008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:37.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.223+0000 7f182effd700 1 -- 172.21.15.60:0/2118739567 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f18340555b0 con 0x7f1824003a30 2023-07-12T02:02:37.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.419+0000 7f184033c700 1 -- 172.21.15.60:0/2118739567 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f18380ba620 con 0x7f1824003a30 2023-07-12T02:02:37.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.419+0000 7f182effd700 1 -- 172.21.15.60:0/2118739567 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1834007730 con 0x7f1824003a30 2023-07-12T02:02:37.424 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-07-12T02:02:37.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.421+0000 7f184033c700 1 -- 172.21.15.60:0/2118739567 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f181c06ace0 msgr2=0x7f181c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:37.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.421+0000 7f184033c700 1 --2- 172.21.15.60:0/2118739567 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f181c06ace0 0x7f181c06d190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1838130bc0 tx=0x7f1828008040 comp rx=0 tx=0).stop 2023-07-12T02:02:37.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.421+0000 7f184033c700 1 -- 172.21.15.60:0/2118739567 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1824003a30 msgr2=0x7f1838147510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:37.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.421+0000 7f184033c700 1 --2- 172.21.15.60:0/2118739567 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1824003a30 0x7f1838147510 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f183400c720 tx=0x7f1834001930 comp rx=0 tx=0).stop 2023-07-12T02:02:37.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.421+0000 7f184033c700 1 -- 172.21.15.60:0/2118739567 shutdown_connections 2023-07-12T02:02:37.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.421+0000 7f184033c700 1 --2- 172.21.15.60:0/2118739567 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f181c06ace0 0x7f181c06d190 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:37.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.421+0000 7f184033c700 1 --2- 172.21.15.60:0/2118739567 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1824003a30 0x7f1838147510 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:37.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.421+0000 7f184033c700 1 --2- 172.21.15.60:0/2118739567 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18381d0fd0 0x7f183812fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:37.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.421+0000 7f184033c700 1 --2- 172.21.15.60:0/2118739567 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f18380b5cb0 0x7f18381df920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:37.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.421+0000 7f184033c700 1 -- 172.21.15.60:0/2118739567 >> 172.21.15.60:0/2118739567 conn(0x7f18380bd980 msgr2=0x7f18381323f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:37.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.421+0000 7f184033c700 1 -- 172.21.15.60:0/2118739567 shutdown_connections 2023-07-12T02:02:37.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.421+0000 7f184033c700 1 -- 172.21.15.60:0/2118739567 wait complete. 2023-07-12T02:02:37.437 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-12T02:02:37.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.563+0000 7f6d13c22700 1 Processor -- start 2023-07-12T02:02:37.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.563+0000 7f6d13c22700 1 -- start start 2023-07-12T02:02:37.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.563+0000 7f6d13c22700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6d0c1449d0 0x7f6d0c14db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:37.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.564+0000 7f6d13c22700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6d0c0b8d90 0x7f6d0c06ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:37.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.564+0000 7f6d13c22700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d0c0b8620 con 0x7f6d0c0bc810 2023-07-12T02:02:37.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.564+0000 7f6d13c22700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d0c0b97a0 con 0x7f6d0c0b8d90 2023-07-12T02:02:37.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.564+0000 7f6d13c22700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c144da0 con 0x7f6d0c1449d0 2023-07-12T02:02:37.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.564+0000 7f6d121bf700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6d0c0b8d90 0x7f6d0c06ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:37.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.564+0000 7f6d111bd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f6d0c0bc810 0x7f6d0c0ba530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48570/0 (socket says 172.21.15.60:48570) 2023-07-12T02:02:37.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.564+0000 7f6d111bd700 1 -- 172.21.15.60:0/3992019482 learned_addr learned my addr 172.21.15.60:0/3992019482 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:37.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.564+0000 7f6d119be700 1 --2- 172.21.15.60:0/3992019482 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6d0c1449d0 0x7f6d0c14db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:37.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.564+0000 7f6d109bc700 1 -- 172.21.15.60:0/3992019482 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 285011245 0 0) 0x7f6d0c0b8620 con 0x7f6d0c0bc810 2023-07-12T02:02:37.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.564+0000 7f6d109bc700 1 -- 172.21.15.60:0/3992019482 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cf80035b0 con 0x7f6d0c0bc810 2023-07-12T02:02:37.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.564+0000 7f6d121bf700 1 -- 172.21.15.60:0/3992019482 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6d0c1449d0 msgr2=0x7f6d0c14db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:37.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.564+0000 7f6d121bf700 1 --2- 172.21.15.60:0/3992019482 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6d0c1449d0 0x7f6d0c14db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:37.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.564+0000 7f6d121bf700 1 -- 172.21.15.60:0/3992019482 >> v1:172.21.15.60:6789/0 conn(0x7f6d0c0bc810 legacy=0x7f6d0c0ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:37.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.564+0000 7f6d121bf700 1 -- 172.21.15.60:0/3992019482 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d0c0b8900 con 0x7f6d0c0b8d90 2023-07-12T02:02:37.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.564+0000 7f6d121bf700 1 --2- 172.21.15.60:0/3992019482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d0c0b8d90 0x7f6d0c06ade0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6d04009d90 tx=0x7f6d0400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28ed2492ae443720 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:37.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.564+0000 7f6d109bc700 1 -- 172.21.15.60:0/3992019482 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0400e070 con 0x7f6d0c0b8d90 2023-07-12T02:02:37.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.564+0000 7f6d109bc700 1 -- 172.21.15.60:0/3992019482 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d0400bb20 con 0x7f6d0c0b8d90 2023-07-12T02:02:37.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.564+0000 7f6d109bc700 1 -- 172.21.15.60:0/3992019482 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0400be90 con 0x7f6d0c0b8d90 2023-07-12T02:02:37.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.565+0000 7f6d13c22700 1 -- 172.21.15.60:0/3992019482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d0c0b8d90 msgr2=0x7f6d0c06ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:37.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.565+0000 7f6d13c22700 1 --2- 172.21.15.60:0/3992019482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d0c0b8d90 0x7f6d0c06ade0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6d04009d90 tx=0x7f6d0400b330 comp rx=0 tx=0).stop 2023-07-12T02:02:37.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.565+0000 7f6d13c22700 1 -- 172.21.15.60:0/3992019482 shutdown_connections 2023-07-12T02:02:37.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.565+0000 7f6d13c22700 1 --2- 172.21.15.60:0/3992019482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d0c0b8d90 0x7f6d0c06ade0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:37.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.565+0000 7f6d13c22700 1 --2- 172.21.15.60:0/3992019482 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6d0c1449d0 0x7f6d0c14db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:37.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.565+0000 7f6d13c22700 1 -- 172.21.15.60:0/3992019482 >> 172.21.15.60:0/3992019482 conn(0x7f6d0c0c0860 msgr2=0x7f6d0c0c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:37.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.565+0000 7f6d13c22700 1 -- 172.21.15.60:0/3992019482 shutdown_connections 2023-07-12T02:02:37.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.565+0000 7f6d13c22700 1 -- 172.21.15.60:0/3992019482 wait complete. 2023-07-12T02:02:37.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.566+0000 7f6d13c22700 1 Processor -- start 2023-07-12T02:02:37.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.566+0000 7f6d13c22700 1 -- start start 2023-07-12T02:02:37.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.567+0000 7f6d13c22700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6d0c0b8d90 0x7f6d0c1d3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:37.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.567+0000 7f6d13c22700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d0c0bc810 0x7f6d0c0b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:37.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.567+0000 7f6d13c22700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d0c1449d0 0x7f6d0c1d4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:37.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.567+0000 7f6d13c22700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c0b6d90 con 0x7f6d0c1449d0 2023-07-12T02:02:37.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.567+0000 7f6d13c22700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c140df0 con 0x7f6d0c0bc810 2023-07-12T02:02:37.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.567+0000 7f6d13c22700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c0b72e0 con 0x7f6d0c0b8d90 2023-07-12T02:02:37.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.567+0000 7f6d121bf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d0c1449d0 0x7f6d0c1d4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:37.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.567+0000 7f6d121bf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d0c1449d0 0x7f6d0c1d4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40746/0 (socket says 172.21.15.60:40746) 2023-07-12T02:02:37.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.567+0000 7f6d121bf700 1 -- 172.21.15.60:0/3899346041 learned_addr learned my addr 172.21.15.60:0/3899346041 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:37.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.567+0000 7f6d111bd700 1 --2- 172.21.15.60:0/3899346041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d0c0bc810 0x7f6d0c0b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:37.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.567+0000 7f6d119be700 1 --2- 172.21.15.60:0/3899346041 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6d0c0b8d90 0x7f6d0c1d3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:37.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.567+0000 7f6d121bf700 1 -- 172.21.15.60:0/3899346041 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6d0c0b8d90 msgr2=0x7f6d0c1d3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:37.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.567+0000 7f6d121bf700 1 --2- 172.21.15.60:0/3899346041 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6d0c0b8d90 0x7f6d0c1d3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:37.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.567+0000 7f6d121bf700 1 -- 172.21.15.60:0/3899346041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d0c0bc810 msgr2=0x7f6d0c0b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:37.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.567+0000 7f6d121bf700 1 --2- 172.21.15.60:0/3899346041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d0c0bc810 0x7f6d0c0b5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:37.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.567+0000 7f6d121bf700 1 -- 172.21.15.60:0/3899346041 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d04009a70 con 0x7f6d0c1449d0 2023-07-12T02:02:37.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.567+0000 7f6d121bf700 1 --2- 172.21.15.60:0/3899346041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d0c1449d0 0x7f6d0c1d4450 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6d04014040 tx=0x7f6d04004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:37.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.568+0000 7f6d027fc700 1 -- 172.21.15.60:0/3899346041 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d04004840 con 0x7f6d0c1449d0 2023-07-12T02:02:37.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.568+0000 7f6d027fc700 1 -- 172.21.15.60:0/3899346041 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d04020070 con 0x7f6d0c1449d0 2023-07-12T02:02:37.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.568+0000 7f6d13c22700 1 -- 172.21.15.60:0/3899346041 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d0c1d3f80 con 0x7f6d0c1449d0 2023-07-12T02:02:37.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.568+0000 7f6d027fc700 1 -- 172.21.15.60:0/3899346041 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d040276c0 con 0x7f6d0c1449d0 2023-07-12T02:02:37.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.568+0000 7f6d13c22700 1 -- 172.21.15.60:0/3899346041 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d0c141280 con 0x7f6d0c1449d0 2023-07-12T02:02:37.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.568+0000 7f6d13c22700 1 -- 172.21.15.60:0/3899346041 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d0c074360 con 0x7f6d0c1449d0 2023-07-12T02:02:37.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.569+0000 7f6d027fc700 1 -- 172.21.15.60:0/3899346041 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6d04012430 con 0x7f6d0c1449d0 2023-07-12T02:02:37.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.569+0000 7f6d027fc700 1 --2- 172.21.15.60:0/3899346041 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f6cf006ace0 0x7f6cf006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:37.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.569+0000 7f6d027fc700 1 -- 172.21.15.60:0/3899346041 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6d04022070 con 0x7f6d0c1449d0 2023-07-12T02:02:37.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.570+0000 7f6d119be700 1 --2- 172.21.15.60:0/3899346041 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f6cf006ace0 0x7f6cf006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:37.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.570+0000 7f6d119be700 1 --2- 172.21.15.60:0/3899346041 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f6cf006ace0 0x7f6cf006d190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6d08009b40 tx=0x7f6d08009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:37.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.574+0000 7f6d027fc700 1 -- 172.21.15.60:0/3899346041 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f6d04056150 con 0x7f6d0c1449d0 2023-07-12T02:02:37.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.768+0000 7f6d13c22700 1 -- 172.21.15.60:0/3899346041 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6d0c0bc330 con 0x7f6d0c1449d0 2023-07-12T02:02:37.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.768+0000 7f6d027fc700 1 -- 172.21.15.60:0/3899346041 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6d0402c0a0 con 0x7f6d0c1449d0 2023-07-12T02:02:37.773 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-07-12T02:02:37.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.771+0000 7f6d13c22700 1 -- 172.21.15.60:0/3899346041 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f6cf006ace0 msgr2=0x7f6cf006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:37.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.771+0000 7f6d13c22700 1 --2- 172.21.15.60:0/3899346041 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f6cf006ace0 0x7f6cf006d190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6d08009b40 tx=0x7f6d08009210 comp rx=0 tx=0).stop 2023-07-12T02:02:37.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.771+0000 7f6d13c22700 1 -- 172.21.15.60:0/3899346041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d0c1449d0 msgr2=0x7f6d0c1d4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:37.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.771+0000 7f6d13c22700 1 --2- 172.21.15.60:0/3899346041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d0c1449d0 0x7f6d0c1d4450 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6d04014040 tx=0x7f6d04004ad0 comp rx=0 tx=0).stop 2023-07-12T02:02:37.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.771+0000 7f6d13c22700 1 -- 172.21.15.60:0/3899346041 shutdown_connections 2023-07-12T02:02:37.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.771+0000 7f6d13c22700 1 --2- 172.21.15.60:0/3899346041 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f6cf006ace0 0x7f6cf006d190 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:37.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.771+0000 7f6d13c22700 1 --2- 172.21.15.60:0/3899346041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d0c1449d0 0x7f6d0c1d4450 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:37.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.771+0000 7f6d13c22700 1 --2- 172.21.15.60:0/3899346041 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6d0c0b8d90 0x7f6d0c1d3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:37.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.771+0000 7f6d13c22700 1 --2- 172.21.15.60:0/3899346041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d0c0bc810 0x7f6d0c0b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:37.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.771+0000 7f6d13c22700 1 -- 172.21.15.60:0/3899346041 >> 172.21.15.60:0/3899346041 conn(0x7f6d0c0c0860 msgr2=0x7f6d0c14e340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:37.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.771+0000 7f6d13c22700 1 -- 172.21.15.60:0/3899346041 shutdown_connections 2023-07-12T02:02:37.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.771+0000 7f6d13c22700 1 -- 172.21.15.60:0/3899346041 wait complete. 2023-07-12T02:02:37.787 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:02:37.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.909+0000 7f72a4fb5700 1 Processor -- start 2023-07-12T02:02:37.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.909+0000 7f72a4fb5700 1 -- start start 2023-07-12T02:02:37.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.910+0000 7f72a4fb5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f72a006b120 0x7f72a0140ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:37.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.910+0000 7f72a4fb5700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72a006fb30 con 0x7f72a00b9340 2023-07-12T02:02:37.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.910+0000 7f72a4fb5700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72a006f4e0 con 0x7f72a0071b20 2023-07-12T02:02:37.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.910+0000 7f72a4fb5700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72a006f7c0 con 0x7f72a006b120 2023-07-12T02:02:37.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.911+0000 7f729dd9b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f72a00b9340 0x7f72a0071410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48582/0 (socket says 172.21.15.60:48582) 2023-07-12T02:02:37.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.911+0000 7f729dd9b700 1 -- 172.21.15.60:0/328813411 learned_addr learned my addr 172.21.15.60:0/328813411 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:37.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.911+0000 7f729d59a700 1 -- 172.21.15.60:0/328813411 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3067821688 0 0) 0x7f72a006fb30 con 0x7f72a00b9340 2023-07-12T02:02:37.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.911+0000 7f729e59c700 1 --2- 172.21.15.60:0/328813411 >> v2:172.21.15.79:3300/0 conn(0x7f72a006b120 0x7f72a0140ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:37.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.911+0000 7f729d59a700 1 -- 172.21.15.60:0/328813411 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72880034d0 con 0x7f72a00b9340 2023-07-12T02:02:37.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.911+0000 7f729d59a700 1 -- 172.21.15.60:0/328813411 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1364797444 0 0) 0x7f72880034d0 con 0x7f72a00b9340 2023-07-12T02:02:37.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.911+0000 7f729d59a700 1 -- 172.21.15.60:0/328813411 >> v2:172.21.15.79:3300/0 conn(0x7f72a006b120 msgr2=0x7f72a0140ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:37.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.911+0000 7f729d59a700 1 --2- 172.21.15.60:0/328813411 >> v2:172.21.15.79:3300/0 conn(0x7f72a006b120 0x7f72a0140ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:37.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.911+0000 7f729d59a700 1 -- 172.21.15.60:0/328813411 >> v1:172.21.15.79:6789/0 conn(0x7f72a0071b20 legacy=0x7f72a0151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:37.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.911+0000 7f729d59a700 1 -- 172.21.15.60:0/328813411 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a006edc0 con 0x7f72a00b9340 2023-07-12T02:02:37.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.911+0000 7f729d59a700 1 -- 172.21.15.60:0/328813411 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1141905739 0 0) 0x7f7294001670 con 0x7f72a00b9340 2023-07-12T02:02:37.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.911+0000 7f729d59a700 1 -- 172.21.15.60:0/328813411 >> v1:172.21.15.60:6789/0 conn(0x7f72a00b9340 legacy=0x7f72a0071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:37.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.911+0000 7f729d59a700 1 --2- 172.21.15.60:0/328813411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7288003af0 0x7f7288003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:37.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.911+0000 7f729d59a700 1 --2- 172.21.15.60:0/328813411 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72880066d0 0x7f7288008ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:37.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.911+0000 7f729d59a700 1 --2- 172.21.15.60:0/328813411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7288009270 0x7f728800b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:37.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.911+0000 7f729d59a700 1 -- 172.21.15.60:0/328813411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a006f7c0 con 0x7f7288009270 2023-07-12T02:02:37.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.911+0000 7f729d59a700 1 -- 172.21.15.60:0/328813411 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f728800bfe0 con 0x7f7288003af0 2023-07-12T02:02:37.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.911+0000 7f729d59a700 1 -- 172.21.15.60:0/328813411 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f728800c1a0 con 0x7f72880066d0 2023-07-12T02:02:37.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.911+0000 7f729ed9d700 1 --2- 172.21.15.60:0/328813411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7288009270 0x7f728800b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:37.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.911+0000 7f729dd9b700 1 --2- 172.21.15.60:0/328813411 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72880066d0 0x7f7288008ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:37.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.911+0000 7f729e59c700 1 --2- 172.21.15.60:0/328813411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7288003af0 0x7f7288003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:37.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.912+0000 7f729ed9d700 1 -- 172.21.15.60:0/328813411 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72880066d0 msgr2=0x7f7288008ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:37.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.912+0000 7f729ed9d700 1 --2- 172.21.15.60:0/328813411 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72880066d0 0x7f7288008ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:37.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.912+0000 7f729ed9d700 1 -- 172.21.15.60:0/328813411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7288003af0 msgr2=0x7f7288003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:37.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.912+0000 7f729ed9d700 1 --2- 172.21.15.60:0/328813411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7288003af0 0x7f7288003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:37.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.912+0000 7f729ed9d700 1 -- 172.21.15.60:0/328813411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72880034d0 con 0x7f7288009270 2023-07-12T02:02:37.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.912+0000 7f729ed9d700 1 -- 172.21.15.60:0/328813411 reap_dead start 2023-07-12T02:02:37.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.912+0000 7f729ed9d700 1 --2- 172.21.15.60:0/328813411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7288009270 0x7f728800b700 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f729800c290 tx=0x7f7288003780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6d4f60653773a1c server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:37.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.912+0000 7f729d59a700 1 -- 172.21.15.60:0/328813411 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7298001e70 con 0x7f7288009270 2023-07-12T02:02:37.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.912+0000 7f729d59a700 1 -- 172.21.15.60:0/328813411 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729800ce70 con 0x7f7288009270 2023-07-12T02:02:37.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.912+0000 7f729d59a700 1 -- 172.21.15.60:0/328813411 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7298003c20 con 0x7f7288009270 2023-07-12T02:02:37.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.912+0000 7f72a4fb5700 1 -- 172.21.15.60:0/328813411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7288009270 msgr2=0x7f728800b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:37.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.912+0000 7f72a4fb5700 1 --2- 172.21.15.60:0/328813411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7288009270 0x7f728800b700 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f729800c290 tx=0x7f7288003780 comp rx=0 tx=0).stop 2023-07-12T02:02:37.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.912+0000 7f72a4fb5700 1 -- 172.21.15.60:0/328813411 shutdown_connections 2023-07-12T02:02:37.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.912+0000 7f72a4fb5700 1 --2- 172.21.15.60:0/328813411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7288009270 0x7f728800b700 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:37.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.913+0000 7f72a4fb5700 1 -- 172.21.15.60:0/328813411 >> 172.21.15.60:0/328813411 conn(0x7f72a00bd980 msgr2=0x7f72a00b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:37.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.913+0000 7f72a4fb5700 1 -- 172.21.15.60:0/328813411 shutdown_connections 2023-07-12T02:02:37.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.913+0000 7f72a4fb5700 1 -- 172.21.15.60:0/328813411 wait complete. 2023-07-12T02:02:37.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.914+0000 7f72a4fb5700 1 Processor -- start 2023-07-12T02:02:37.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.914+0000 7f72a4fb5700 1 -- start start 2023-07-12T02:02:37.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.914+0000 7f72a4fb5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7288009270 0x7f72a013bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:37.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.914+0000 7f72a4fb5700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72a013ed50 0x7f72a0142960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:37.924 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.914+0000 7f72a4fb5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72a013f1c0 0x7f72a0142ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:37.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.914+0000 7f72a4fb5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a013c4e0 con 0x7f72a013f1c0 2023-07-12T02:02:37.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.914+0000 7f72a4fb5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a013fff0 con 0x7f7288009270 2023-07-12T02:02:37.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.914+0000 7f72a4fb5700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72a0149740 con 0x7f72a013ed50 2023-07-12T02:02:37.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.915+0000 7f729ed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72a013f1c0 0x7f72a0142ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:37.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.915+0000 7f729ed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72a013f1c0 0x7f72a0142ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40770/0 (socket says 172.21.15.60:40770) 2023-07-12T02:02:37.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.915+0000 7f729ed9d700 1 -- 172.21.15.60:0/3019230480 learned_addr learned my addr 172.21.15.60:0/3019230480 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:37.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.915+0000 7f729e59c700 1 --2- 172.21.15.60:0/3019230480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7288009270 0x7f72a013bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:37.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.915+0000 7f729dd9b700 1 --2- 172.21.15.60:0/3019230480 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72a013ed50 0x7f72a0142960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:37.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.915+0000 7f729ed9d700 1 -- 172.21.15.60:0/3019230480 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72a013ed50 msgr2=0x7f72a0142960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:37.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.915+0000 7f729ed9d700 1 --2- 172.21.15.60:0/3019230480 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72a013ed50 0x7f72a0142960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:37.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.915+0000 7f729ed9d700 1 -- 172.21.15.60:0/3019230480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7288009270 msgr2=0x7f72a013bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:37.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.915+0000 7f729ed9d700 1 --2- 172.21.15.60:0/3019230480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7288009270 0x7f72a013bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:37.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.915+0000 7f729ed9d700 1 -- 172.21.15.60:0/3019230480 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a006f2b0 con 0x7f72a013f1c0 2023-07-12T02:02:37.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.915+0000 7f729dd9b700 1 --2- 172.21.15.60:0/3019230480 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72a013ed50 0x7f72a0142960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:37.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.915+0000 7f729e59c700 1 --2- 172.21.15.60:0/3019230480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7288009270 0x7f72a013bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:37.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.915+0000 7f729ed9d700 1 --2- 172.21.15.60:0/3019230480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72a013f1c0 0x7f72a0142ea0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f72a00b3910 tx=0x7f72980015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:37.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.915+0000 7f728effd700 1 -- 172.21.15.60:0/3019230480 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7298017070 con 0x7f72a013f1c0 2023-07-12T02:02:37.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.915+0000 7f728effd700 1 -- 172.21.15.60:0/3019230480 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7298001250 con 0x7f72a013f1c0 2023-07-12T02:02:37.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.915+0000 7f72a4fb5700 1 -- 172.21.15.60:0/3019230480 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72a01df690 con 0x7f72a013f1c0 2023-07-12T02:02:37.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.915+0000 7f728effd700 1 -- 172.21.15.60:0/3019230480 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72980054e0 con 0x7f72a013f1c0 2023-07-12T02:02:37.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.915+0000 7f72a4fb5700 1 -- 172.21.15.60:0/3019230480 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72a01df930 con 0x7f72a013f1c0 2023-07-12T02:02:37.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.916+0000 7f72a4fb5700 1 -- 172.21.15.60:0/3019230480 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72a0074360 con 0x7f72a013f1c0 2023-07-12T02:02:37.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.917+0000 7f728effd700 1 -- 172.21.15.60:0/3019230480 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7298005640 con 0x7f72a013f1c0 2023-07-12T02:02:37.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.917+0000 7f728effd700 1 --2- 172.21.15.60:0/3019230480 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f728006ace0 0x7f728006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:37.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.917+0000 7f728effd700 1 -- 172.21.15.60:0/3019230480 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f729801a040 con 0x7f72a013f1c0 2023-07-12T02:02:37.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.917+0000 7f729e59c700 1 --2- 172.21.15.60:0/3019230480 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f728006ace0 0x7f728006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:37.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.918+0000 7f729e59c700 1 --2- 172.21.15.60:0/3019230480 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f728006ace0 0x7f728006d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7290005c10 tx=0x7f729000d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:37.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:37.922+0000 7f728effd700 1 -- 172.21.15.60:0/3019230480 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f7298054fc0 con 0x7f72a013f1c0 2023-07-12T02:02:38.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.118+0000 7f72a4fb5700 1 -- 172.21.15.60:0/3019230480 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f72a00ba620 con 0x7f72a013f1c0 2023-07-12T02:02:38.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.119+0000 7f728effd700 1 -- 172.21.15.60:0/3019230480 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18173 (secure 0 0 0) 0x7f72980585e0 con 0x7f72a013f1c0 2023-07-12T02:02:38.123 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:02:38.123 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":21,"fsid":"97e7c909-e567-472e-a5aa-72fde15171f2","created":"2023-07-12T02:01:53.987086+0000","modified":"2023-07-12T02:02:14.307912+0000","last_up_change":"2023-07-12T02:02:04.031780+0000","last_in_change":"2023-07-12T02:01:56.538621+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-12T02:02:05.375042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-12T02:02:05.857441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:02:10.574633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-12T02:02:11.699872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ed8b71c2-3895-4952-a118-16ede0b4a98c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6801","nonce":2818935979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6803","nonce":2818935979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6807","nonce":2818935979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6805","nonce":2818935979}]},"public_addr":"172.21.15.60:6801/2818935979","cluster_addr":"172.21.15.60:6803/2818935979","heartbeat_back_addr":"172.21.15.60:6807/2818935979","heartbeat_front_addr":"172.21.15.60:6805/2818935979","state":["exists","up"]},{"osd":1,"uuid":"7cf4d354-78e0-43ce-8c09-4a7d2a0b57a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6817","nonce":1678864191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6819","nonce":1678864191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6823","nonce":1678864191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6821","nonce":1678864191}]},"public_addr":"172.21.15.60:6817/1678864191","cluster_addr":"172.21.15.60:6819/1678864191","heartbeat_back_addr":"172.21.15.60:6823/1678864191","heartbeat_front_addr":"172.21.15.60:6821/1678864191","state":["exists","up"]},{"osd":2,"uuid":"02c958b8-9599-4470-92cb-8f7018ec0189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6809","nonce":1459480680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6811","nonce":1459480680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6815","nonce":1459480680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6813","nonce":1459480680}]},"public_addr":"172.21.15.60:6809/1459480680","cluster_addr":"172.21.15.60:6811/1459480680","heartbeat_back_addr":"172.21.15.60:6815/1459480680","heartbeat_front_addr":"172.21.15.60:6813/1459480680","state":["exists","up"]},{"osd":3,"uuid":"bc300432-a228-4257-be5c-e42dd5f2015f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6825","nonce":3295100060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6827","nonce":3295100060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6831","nonce":3295100060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6829","nonce":3295100060}]},"public_addr":"172.21.15.60:6825/3295100060","cluster_addr":"172.21.15.60:6827/3295100060","heartbeat_back_addr":"172.21.15.60:6831/3295100060","heartbeat_front_addr":"172.21.15.60:6829/3295100060","state":["exists","up"]},{"osd":4,"uuid":"ad9f7dc4-7126-466d-a656-2844880c6060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6809","nonce":4127109138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6811","nonce":4127109138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6815","nonce":4127109138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6813","nonce":4127109138}]},"public_addr":"172.21.15.79:6809/4127109138","cluster_addr":"172.21.15.79:6811/4127109138","heartbeat_back_addr":"172.21.15.79:6815/4127109138","heartbeat_front_addr":"172.21.15.79:6813/4127109138","state":["exists","up"]},{"osd":5,"uuid":"e88d16ca-0b01-4ab9-8aa8-c4aff7f210f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6801","nonce":421449406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6803","nonce":421449406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6807","nonce":421449406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6805","nonce":421449406}]},"public_addr":"172.21.15.79:6801/421449406","cluster_addr":"172.21.15.79:6803/421449406","heartbeat_back_addr":"172.21.15.79:6807/421449406","heartbeat_front_addr":"172.21.15.79:6805/421449406","state":["exists","up"]},{"osd":6,"uuid":"6898cb84-56d1-48a9-bd45-97e4668e2fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6825","nonce":4144355139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6827","nonce":4144355139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6831","nonce":4144355139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6829","nonce":4144355139}]},"public_addr":"172.21.15.79:6825/4144355139","cluster_addr":"172.21.15.79:6827/4144355139","heartbeat_back_addr":"172.21.15.79:6831/4144355139","heartbeat_front_addr":"172.21.15.79:6829/4144355139","state":["exists","up"]},{"osd":7,"uuid":"65c10882-371e-4762-b384-9c3a48f332ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6817","nonce":2845223299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6819","nonce":2845223299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6823","nonce":2845223299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6821","nonce":2845223299}]},"public_addr":"172.21.15.79:6817/2845223299","cluster_addr":"172.21.15.79:6819/2845223299","heartbeat_back_addr":"172.21.15.79:6823/2845223299","heartbeat_front_addr":"172.21.15.79:6821/2845223299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.634716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.758349+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.728366+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.777395+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707262+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.649705+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.693021+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:02:38.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.121+0000 7f72a4fb5700 1 -- 172.21.15.60:0/3019230480 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f728006ace0 msgr2=0x7f728006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:38.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.121+0000 7f72a4fb5700 1 --2- 172.21.15.60:0/3019230480 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f728006ace0 0x7f728006d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7290005c10 tx=0x7f729000d040 comp rx=0 tx=0).stop 2023-07-12T02:02:38.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.121+0000 7f72a4fb5700 1 -- 172.21.15.60:0/3019230480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72a013f1c0 msgr2=0x7f72a0142ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:38.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.121+0000 7f72a4fb5700 1 --2- 172.21.15.60:0/3019230480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72a013f1c0 0x7f72a0142ea0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f72a00b3910 tx=0x7f72980015b0 comp rx=0 tx=0).stop 2023-07-12T02:02:38.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.121+0000 7f72a4fb5700 1 -- 172.21.15.60:0/3019230480 shutdown_connections 2023-07-12T02:02:38.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.121+0000 7f72a4fb5700 1 --2- 172.21.15.60:0/3019230480 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f728006ace0 0x7f728006d190 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:38.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.121+0000 7f72a4fb5700 1 --2- 172.21.15.60:0/3019230480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72a013f1c0 0x7f72a0142ea0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:38.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.121+0000 7f72a4fb5700 1 --2- 172.21.15.60:0/3019230480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7288009270 0x7f72a013bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:38.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.121+0000 7f72a4fb5700 1 --2- 172.21.15.60:0/3019230480 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72a013ed50 0x7f72a0142960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:38.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.121+0000 7f72a4fb5700 1 -- 172.21.15.60:0/3019230480 >> 172.21.15.60:0/3019230480 conn(0x7f72a00bd980 msgr2=0x7f72a014a140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:38.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.121+0000 7f72a4fb5700 1 -- 172.21.15.60:0/3019230480 shutdown_connections 2023-07-12T02:02:38.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.121+0000 7f72a4fb5700 1 -- 172.21.15.60:0/3019230480 wait complete. 2023-07-12T02:02:38.137 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-12T02:02:05.375042+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-12T02:02:05.857441+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-12T02:02:10.574633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-12T02:02:11.699872+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-12T02:02:38.138 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-12T02:02:38.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.262+0000 7fbad48fd700 1 Processor -- start 2023-07-12T02:02:38.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.262+0000 7fbad48fd700 1 -- start start 2023-07-12T02:02:38.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.263+0000 7fbad48fd700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbad0147dc0 0x7fbad00721e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:38.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.263+0000 7fbad48fd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbad0069f30 0x7fbad0071130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:38.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.263+0000 7fbad48fd700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbad006f680 con 0x7fbad006a380 2023-07-12T02:02:38.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.263+0000 7fbad48fd700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbad0070950 con 0x7fbad0069f30 2023-07-12T02:02:38.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.263+0000 7fbad48fd700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad006f920 con 0x7fbad0147dc0 2023-07-12T02:02:38.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.263+0000 7fbaced9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fbad006a380 0x7fbad014dc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48596/0 (socket says 172.21.15.60:48596) 2023-07-12T02:02:38.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.263+0000 7fbaced9d700 1 -- 172.21.15.60:0/2974501789 learned_addr learned my addr 172.21.15.60:0/2974501789 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:38.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.264+0000 7fbacdd9b700 1 --2- 172.21.15.60:0/2974501789 >> v2:172.21.15.79:3300/0 conn(0x7fbad0069f30 0x7fbad0071130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:38.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.264+0000 7fbace59c700 1 --2- 172.21.15.60:0/2974501789 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbad0147dc0 0x7fbad00721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:38.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.264+0000 7fbacd59a700 1 -- 172.21.15.60:0/2974501789 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 902732920 0 0) 0x7fbad006f680 con 0x7fbad006a380 2023-07-12T02:02:38.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.264+0000 7fbacd59a700 1 -- 172.21.15.60:0/2974501789 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbab80035b0 con 0x7fbad006a380 2023-07-12T02:02:38.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.264+0000 7fbacd59a700 1 -- 172.21.15.60:0/2974501789 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2529019461 0 0) 0x7fbab80035b0 con 0x7fbad006a380 2023-07-12T02:02:38.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.264+0000 7fbacdd9b700 1 -- 172.21.15.60:0/2974501789 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbad0147dc0 msgr2=0x7fbad00721e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:38.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.264+0000 7fbacdd9b700 1 --2- 172.21.15.60:0/2974501789 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbad0147dc0 0x7fbad00721e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:38.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.264+0000 7fbacdd9b700 1 -- 172.21.15.60:0/2974501789 >> v1:172.21.15.60:6789/0 conn(0x7fbad006a380 legacy=0x7fbad014dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:38.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.264+0000 7fbacdd9b700 1 -- 172.21.15.60:0/2974501789 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad00b9660 con 0x7fbad0069f30 2023-07-12T02:02:38.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.264+0000 7fbacdd9b700 1 --2- 172.21.15.60:0/2974501789 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbad0069f30 0x7fbad0071130 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbac4009840 tx=0x7fbac4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6cb443f5ab1018c server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:38.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.264+0000 7fbacd59a700 1 -- 172.21.15.60:0/2974501789 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac80019f0 con 0x7fbad0069f30 2023-07-12T02:02:38.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.264+0000 7fbacd59a700 1 -- 172.21.15.60:0/2974501789 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac4004030 con 0x7fbad0069f30 2023-07-12T02:02:38.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.264+0000 7fbacd59a700 1 -- 172.21.15.60:0/2974501789 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac40043c0 con 0x7fbad0069f30 2023-07-12T02:02:38.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.265+0000 7fbad48fd700 1 -- 172.21.15.60:0/2974501789 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbad0069f30 msgr2=0x7fbad0071130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:38.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.265+0000 7fbad48fd700 1 --2- 172.21.15.60:0/2974501789 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbad0069f30 0x7fbad0071130 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbac4009840 tx=0x7fbac4009b50 comp rx=0 tx=0).stop 2023-07-12T02:02:38.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.265+0000 7fbad48fd700 1 -- 172.21.15.60:0/2974501789 shutdown_connections 2023-07-12T02:02:38.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.265+0000 7fbad48fd700 1 --2- 172.21.15.60:0/2974501789 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbad0147dc0 0x7fbad00721e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:38.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.265+0000 7fbad48fd700 1 --2- 172.21.15.60:0/2974501789 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbad0069f30 0x7fbad0071130 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:38.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.265+0000 7fbad48fd700 1 -- 172.21.15.60:0/2974501789 >> 172.21.15.60:0/2974501789 conn(0x7fbad006d0e0 msgr2=0x7fbad006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:38.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.265+0000 7fbad48fd700 1 -- 172.21.15.60:0/2974501789 shutdown_connections 2023-07-12T02:02:38.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.265+0000 7fbad48fd700 1 -- 172.21.15.60:0/2974501789 wait complete. 2023-07-12T02:02:38.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.266+0000 7fbad48fd700 1 Processor -- start 2023-07-12T02:02:38.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.266+0000 7fbad48fd700 1 -- start start 2023-07-12T02:02:38.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.267+0000 7fbad48fd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbad0069f30 0x7fbad014e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:38.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.267+0000 7fbad48fd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbad006a380 0x7fbad00b5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:38.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.267+0000 7fbad48fd700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbad0147dc0 0x7fbad0140410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:38.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.267+0000 7fbad48fd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad014e7d0 con 0x7fbad006a380 2023-07-12T02:02:38.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.267+0000 7fbad48fd700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad014b630 con 0x7fbad0069f30 2023-07-12T02:02:38.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.267+0000 7fbad48fd700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad00b5b80 con 0x7fbad0147dc0 2023-07-12T02:02:38.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.267+0000 7fbacdd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbad006a380 0x7fbad00b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:38.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.267+0000 7fbacdd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbad006a380 0x7fbad00b5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40784/0 (socket says 172.21.15.60:40784) 2023-07-12T02:02:38.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.267+0000 7fbacdd9b700 1 -- 172.21.15.60:0/147259892 learned_addr learned my addr 172.21.15.60:0/147259892 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:38.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.267+0000 7fbaced9d700 1 --2- 172.21.15.60:0/147259892 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbad0147dc0 0x7fbad0140410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:38.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.267+0000 7fbace59c700 1 --2- 172.21.15.60:0/147259892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbad0069f30 0x7fbad014e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:38.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.267+0000 7fbacdd9b700 1 -- 172.21.15.60:0/147259892 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbad0147dc0 msgr2=0x7fbad0140410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:38.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.267+0000 7fbacdd9b700 1 --2- 172.21.15.60:0/147259892 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbad0147dc0 0x7fbad0140410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:38.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.267+0000 7fbacdd9b700 1 -- 172.21.15.60:0/147259892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbad0069f30 msgr2=0x7fbad014e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:38.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.267+0000 7fbacdd9b700 1 --2- 172.21.15.60:0/147259892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbad0069f30 0x7fbad014e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:38.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.267+0000 7fbacdd9b700 1 -- 172.21.15.60:0/147259892 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac40094a0 con 0x7fbad006a380 2023-07-12T02:02:38.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.267+0000 7fbace59c700 1 --2- 172.21.15.60:0/147259892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbad0069f30 0x7fbad014e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:02:38.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.267+0000 7fbacdd9b700 1 --2- 172.21.15.60:0/147259892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbad006a380 0x7fbad00b5350 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbac400a010 tx=0x7fbac4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:38.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.268+0000 7fbabeffd700 1 -- 172.21.15.60:0/147259892 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac4003c00 con 0x7fbad006a380 2023-07-12T02:02:38.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.268+0000 7fbabeffd700 1 -- 172.21.15.60:0/147259892 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac401f070 con 0x7fbad006a380 2023-07-12T02:02:38.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.268+0000 7fbabeffd700 1 -- 172.21.15.60:0/147259892 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac4011630 con 0x7fbad006a380 2023-07-12T02:02:38.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.268+0000 7fbad48fd700 1 -- 172.21.15.60:0/147259892 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbad014e9b0 con 0x7fbad006a380 2023-07-12T02:02:38.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.268+0000 7fbad48fd700 1 -- 172.21.15.60:0/147259892 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbad00b5890 con 0x7fbad006a380 2023-07-12T02:02:38.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.269+0000 7fbad48fd700 1 -- 172.21.15.60:0/147259892 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbad0140130 con 0x7fbad006a380 2023-07-12T02:02:38.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.269+0000 7fbabeffd700 1 -- 172.21.15.60:0/147259892 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbac4021030 con 0x7fbad006a380 2023-07-12T02:02:38.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.269+0000 7fbabeffd700 1 --2- 172.21.15.60:0/147259892 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fbab006ace0 0x7fbab006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:38.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.270+0000 7fbabeffd700 1 -- 172.21.15.60:0/147259892 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbac408a680 con 0x7fbad006a380 2023-07-12T02:02:38.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.270+0000 7fbace59c700 1 --2- 172.21.15.60:0/147259892 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fbab006ace0 0x7fbab006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:38.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.270+0000 7fbace59c700 1 --2- 172.21.15.60:0/147259892 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fbab006ace0 0x7fbab006d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbac0009ac0 tx=0x7fbac0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:38.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.274+0000 7fbabeffd700 1 -- 172.21.15.60:0/147259892 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fbad0140130 con 0x7fbad006a380 2023-07-12T02:02:38.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.468+0000 7fbad48fd700 1 -- 172.21.15.60:0/147259892 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbad0074360 con 0x7fbad006a380 2023-07-12T02:02:38.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.468+0000 7fbabeffd700 1 -- 172.21.15.60:0/147259892 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbac40557c0 con 0x7fbad006a380 2023-07-12T02:02:38.472 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2023-07-12T02:02:38.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.470+0000 7fbad48fd700 1 -- 172.21.15.60:0/147259892 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fbab006ace0 msgr2=0x7fbab006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:38.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.470+0000 7fbad48fd700 1 --2- 172.21.15.60:0/147259892 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fbab006ace0 0x7fbab006d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbac0009ac0 tx=0x7fbac0008040 comp rx=0 tx=0).stop 2023-07-12T02:02:38.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.470+0000 7fbad48fd700 1 -- 172.21.15.60:0/147259892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbad006a380 msgr2=0x7fbad00b5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:38.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.470+0000 7fbad48fd700 1 --2- 172.21.15.60:0/147259892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbad006a380 0x7fbad00b5350 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbac400a010 tx=0x7fbac4004750 comp rx=0 tx=0).stop 2023-07-12T02:02:38.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.470+0000 7fbad48fd700 1 -- 172.21.15.60:0/147259892 shutdown_connections 2023-07-12T02:02:38.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.470+0000 7fbad48fd700 1 --2- 172.21.15.60:0/147259892 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fbab006ace0 0x7fbab006d190 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:38.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.470+0000 7fbad48fd700 1 --2- 172.21.15.60:0/147259892 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbad0147dc0 0x7fbad0140410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:38.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.470+0000 7fbad48fd700 1 --2- 172.21.15.60:0/147259892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbad0069f30 0x7fbad014e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:38.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.470+0000 7fbad48fd700 1 --2- 172.21.15.60:0/147259892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbad006a380 0x7fbad00b5350 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:38.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.470+0000 7fbad48fd700 1 -- 172.21.15.60:0/147259892 >> 172.21.15.60:0/147259892 conn(0x7fbad006d0e0 msgr2=0x7fbad0145890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:38.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.470+0000 7fbad48fd700 1 -- 172.21.15.60:0/147259892 shutdown_connections 2023-07-12T02:02:38.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.470+0000 7fbad48fd700 1 -- 172.21.15.60:0/147259892 wait complete. 2023-07-12T02:02:38.487 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-12T02:02:38.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.611+0000 7f7f3047a700 1 Processor -- start 2023-07-12T02:02:38.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.611+0000 7f7f3047a700 1 -- start start 2023-07-12T02:02:38.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.613+0000 7f7f3047a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7f2806b120 0x7f7f28071350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:38.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.613+0000 7f7f3047a700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f280ba160 0x7f7f281485e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:38.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.613+0000 7f7f3047a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7f280b5fc0 0x7f7f280b6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:38.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.613+0000 7f7f3047a700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f280b90b0 con 0x7f7f280b5fc0 2023-07-12T02:02:38.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.613+0000 7f7f3047a700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f280b7180 con 0x7f7f2806b120 2023-07-12T02:02:38.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.613+0000 7f7f3047a700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f28148b20 con 0x7f7f280ba160 2023-07-12T02:02:38.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.613+0000 7f7f2ea17700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7f280b5fc0 0x7f7f280b6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:38.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.613+0000 7f7f2ea17700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7f280b5fc0 0x7f7f280b6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40800/0 (socket says 172.21.15.60:40800) 2023-07-12T02:02:38.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.613+0000 7f7f2ea17700 1 -- 172.21.15.60:0/3233552124 learned_addr learned my addr 172.21.15.60:0/3233552124 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:38.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.613+0000 7f7f2e216700 1 --2- 172.21.15.60:0/3233552124 >> v2:172.21.15.79:3300/0 conn(0x7f7f2806b120 0x7f7f28071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:38.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.613+0000 7f7f2da15700 1 --2- 172.21.15.60:0/3233552124 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f280ba160 0x7f7f281485e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:38.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.613+0000 7f7f2ea17700 1 -- 172.21.15.60:0/3233552124 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f280ba160 msgr2=0x7f7f281485e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:38.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.613+0000 7f7f2ea17700 1 --2- 172.21.15.60:0/3233552124 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f280ba160 0x7f7f281485e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:38.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.613+0000 7f7f2ea17700 1 -- 172.21.15.60:0/3233552124 >> v2:172.21.15.79:3300/0 conn(0x7f7f2806b120 msgr2=0x7f7f28071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:38.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.613+0000 7f7f2ea17700 1 --2- 172.21.15.60:0/3233552124 >> v2:172.21.15.79:3300/0 conn(0x7f7f2806b120 0x7f7f28071350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:38.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.613+0000 7f7f2ea17700 1 -- 172.21.15.60:0/3233552124 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f280b6980 con 0x7f7f280b5fc0 2023-07-12T02:02:38.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.613+0000 7f7f2da15700 1 --2- 172.21.15.60:0/3233552124 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f280ba160 0x7f7f281485e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:38.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.613+0000 7f7f2ea17700 1 --2- 172.21.15.60:0/3233552124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f280b5fc0 0x7f7f280b6440 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7f280660a0 tx=0x7f7f2000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7882f217d7be06cc server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:38.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.613+0000 7f7f2d214700 1 -- 172.21.15.60:0/3233552124 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2000e070 con 0x7f7f280b5fc0 2023-07-12T02:02:38.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.614+0000 7f7f2d214700 1 -- 172.21.15.60:0/3233552124 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f2000b910 con 0x7f7f280b5fc0 2023-07-12T02:02:38.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.614+0000 7f7f2d214700 1 -- 172.21.15.60:0/3233552124 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2000bcc0 con 0x7f7f280b5fc0 2023-07-12T02:02:38.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.614+0000 7f7f3047a700 1 -- 172.21.15.60:0/3233552124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f280b5fc0 msgr2=0x7f7f280b6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:38.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.614+0000 7f7f3047a700 1 --2- 172.21.15.60:0/3233552124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f280b5fc0 0x7f7f280b6440 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7f280660a0 tx=0x7f7f2000b330 comp rx=0 tx=0).stop 2023-07-12T02:02:38.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.614+0000 7f7f3047a700 1 -- 172.21.15.60:0/3233552124 shutdown_connections 2023-07-12T02:02:38.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.614+0000 7f7f3047a700 1 --2- 172.21.15.60:0/3233552124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f280b5fc0 0x7f7f280b6440 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:38.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.614+0000 7f7f3047a700 1 --2- 172.21.15.60:0/3233552124 >> v2:172.21.15.79:3300/0 conn(0x7f7f2806b120 0x7f7f28071350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:38.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.614+0000 7f7f3047a700 1 --2- 172.21.15.60:0/3233552124 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f280ba160 0x7f7f281485e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:38.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.614+0000 7f7f3047a700 1 -- 172.21.15.60:0/3233552124 >> 172.21.15.60:0/3233552124 conn(0x7f7f280bd980 msgr2=0x7f7f280b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:38.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.614+0000 7f7f3047a700 1 -- 172.21.15.60:0/3233552124 shutdown_connections 2023-07-12T02:02:38.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.614+0000 7f7f3047a700 1 -- 172.21.15.60:0/3233552124 wait complete. 2023-07-12T02:02:38.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.615+0000 7f7f3047a700 1 Processor -- start 2023-07-12T02:02:38.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.615+0000 7f7f3047a700 1 -- start start 2023-07-12T02:02:38.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.616+0000 7f7f3047a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f2806b120 0x7f7f281d1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:38.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.616+0000 7f7f3047a700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f280b5fc0 0x7f7f2813ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:38.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.616+0000 7f7f3047a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f280ba160 0x7f7f281e0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:38.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.616+0000 7f7f3047a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2813e4a0 con 0x7f7f2806b120 2023-07-12T02:02:38.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.616+0000 7f7f3047a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2813dcd0 con 0x7f7f280ba160 2023-07-12T02:02:38.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.616+0000 7f7f3047a700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f281d2150 con 0x7f7f280b5fc0 2023-07-12T02:02:38.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.616+0000 7f7f2e216700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f2806b120 0x7f7f281d1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:38.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.616+0000 7f7f2e216700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f2806b120 0x7f7f281d1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40814/0 (socket says 172.21.15.60:40814) 2023-07-12T02:02:38.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.616+0000 7f7f2e216700 1 -- 172.21.15.60:0/858497139 learned_addr learned my addr 172.21.15.60:0/858497139 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:38.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.616+0000 7f7f2da15700 1 --2- 172.21.15.60:0/858497139 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f280b5fc0 0x7f7f2813ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:38.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.616+0000 7f7f2ea17700 1 --2- 172.21.15.60:0/858497139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f280ba160 0x7f7f281e0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:38.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.616+0000 7f7f2e216700 1 -- 172.21.15.60:0/858497139 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f280b5fc0 msgr2=0x7f7f2813ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:38.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.616+0000 7f7f2e216700 1 --2- 172.21.15.60:0/858497139 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f280b5fc0 0x7f7f2813ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:38.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.616+0000 7f7f2e216700 1 -- 172.21.15.60:0/858497139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f280ba160 msgr2=0x7f7f281e0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:38.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.616+0000 7f7f2e216700 1 --2- 172.21.15.60:0/858497139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f280ba160 0x7f7f281e0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:38.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.616+0000 7f7f2e216700 1 -- 172.21.15.60:0/858497139 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f20009b30 con 0x7f7f2806b120 2023-07-12T02:02:38.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.616+0000 7f7f2ea17700 1 --2- 172.21.15.60:0/858497139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f280ba160 0x7f7f281e0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:02:38.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.616+0000 7f7f2e216700 1 --2- 172.21.15.60:0/858497139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f2806b120 0x7f7f281d1c10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7f2400e930 tx=0x7f7f2400ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:38.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.617+0000 7f7f1effd700 1 -- 172.21.15.60:0/858497139 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f24009690 con 0x7f7f2806b120 2023-07-12T02:02:38.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.617+0000 7f7f1effd700 1 -- 172.21.15.60:0/858497139 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f2400c850 con 0x7f7f2806b120 2023-07-12T02:02:38.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.617+0000 7f7f1effd700 1 -- 172.21.15.60:0/858497139 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2400cbe0 con 0x7f7f2806b120 2023-07-12T02:02:38.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.617+0000 7f7f3047a700 1 -- 172.21.15.60:0/858497139 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f2813f110 con 0x7f7f2806b120 2023-07-12T02:02:38.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.617+0000 7f7f3047a700 1 -- 172.21.15.60:0/858497139 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f2813e1c0 con 0x7f7f2806b120 2023-07-12T02:02:38.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.618+0000 7f7f3047a700 1 -- 172.21.15.60:0/858497139 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f2813f3f0 con 0x7f7f2806b120 2023-07-12T02:02:38.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.618+0000 7f7f1effd700 1 -- 172.21.15.60:0/858497139 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7f2400cd40 con 0x7f7f2806b120 2023-07-12T02:02:38.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.618+0000 7f7f1effd700 1 --2- 172.21.15.60:0/858497139 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f7f0c06ace0 0x7f7f0c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:38.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.619+0000 7f7f1effd700 1 -- 172.21.15.60:0/858497139 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7f24089520 con 0x7f7f2806b120 2023-07-12T02:02:38.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.619+0000 7f7f2da15700 1 --2- 172.21.15.60:0/858497139 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f7f0c06ace0 0x7f7f0c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:38.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.619+0000 7f7f2da15700 1 --2- 172.21.15.60:0/858497139 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f7f0c06ace0 0x7f7f0c06d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7f28146120 tx=0x7f7f18008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:38.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.623+0000 7f7f1effd700 1 -- 172.21.15.60:0/858497139 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f7f240545d0 con 0x7f7f2806b120 2023-07-12T02:02:38.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.817+0000 7f7f3047a700 1 -- 172.21.15.60:0/858497139 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7f2813eee0 con 0x7f7f2806b120 2023-07-12T02:02:38.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.817+0000 7f7f1effd700 1 -- 172.21.15.60:0/858497139 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7f2813eee0 con 0x7f7f2806b120 2023-07-12T02:02:38.822 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-07-12T02:02:38.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.819+0000 7f7f3047a700 1 -- 172.21.15.60:0/858497139 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f7f0c06ace0 msgr2=0x7f7f0c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:38.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.819+0000 7f7f3047a700 1 --2- 172.21.15.60:0/858497139 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f7f0c06ace0 0x7f7f0c06d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7f28146120 tx=0x7f7f18008040 comp rx=0 tx=0).stop 2023-07-12T02:02:38.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.819+0000 7f7f3047a700 1 -- 172.21.15.60:0/858497139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f2806b120 msgr2=0x7f7f281d1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:38.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.819+0000 7f7f3047a700 1 --2- 172.21.15.60:0/858497139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f2806b120 0x7f7f281d1c10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7f2400e930 tx=0x7f7f2400ecf0 comp rx=0 tx=0).stop 2023-07-12T02:02:38.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.819+0000 7f7f3047a700 1 -- 172.21.15.60:0/858497139 shutdown_connections 2023-07-12T02:02:38.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.819+0000 7f7f3047a700 1 --2- 172.21.15.60:0/858497139 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f7f0c06ace0 0x7f7f0c06d190 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:38.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.819+0000 7f7f3047a700 1 --2- 172.21.15.60:0/858497139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f2806b120 0x7f7f281d1c10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:38.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.819+0000 7f7f3047a700 1 --2- 172.21.15.60:0/858497139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f280ba160 0x7f7f281e0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:38.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.819+0000 7f7f3047a700 1 --2- 172.21.15.60:0/858497139 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7f280b5fc0 0x7f7f2813ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:38.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.819+0000 7f7f3047a700 1 -- 172.21.15.60:0/858497139 >> 172.21.15.60:0/858497139 conn(0x7f7f280bd980 msgr2=0x7f7f280b7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:38.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.819+0000 7f7f3047a700 1 -- 172.21.15.60:0/858497139 shutdown_connections 2023-07-12T02:02:38.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.819+0000 7f7f3047a700 1 -- 172.21.15.60:0/858497139 wait complete. 2023-07-12T02:02:38.835 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-12T02:02:38.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.960+0000 7f1719b61700 1 Processor -- start 2023-07-12T02:02:38.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.960+0000 7f1719b61700 1 -- start start 2023-07-12T02:02:38.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.960+0000 7f1719b61700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f17141449d0 0x7f171414db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:38.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.960+0000 7f1719b61700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f17140b8d90 0x7f171406ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:38.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.960+0000 7f1719b61700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17140b8620 con 0x7f17140bc810 2023-07-12T02:02:38.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.960+0000 7f1719b61700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17140b97a0 con 0x7f17141449d0 2023-07-12T02:02:38.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.960+0000 7f1719b61700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1714144da0 con 0x7f17140b8d90 2023-07-12T02:02:38.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.960+0000 7f1712ffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f17140bc810 0x7f17140ba530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48608/0 (socket says 172.21.15.60:48608) 2023-07-12T02:02:38.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.960+0000 7f1712ffd700 1 -- 172.21.15.60:0/86086387 learned_addr learned my addr 172.21.15.60:0/86086387 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:38.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.960+0000 7f17137fe700 1 --2- 172.21.15.60:0/86086387 >> v2:172.21.15.79:3300/0 conn(0x7f17141449d0 0x7f171414db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:38.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.960+0000 7f1713fff700 1 --2- 172.21.15.60:0/86086387 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f17140b8d90 0x7f171406ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:38.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.961+0000 7f17127fc700 1 -- 172.21.15.60:0/86086387 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 657425287 0 0) 0x7f17140b8620 con 0x7f17140bc810 2023-07-12T02:02:38.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.961+0000 7f17127fc700 1 -- 172.21.15.60:0/86086387 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16fc0035b0 con 0x7f17140bc810 2023-07-12T02:02:38.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.961+0000 7f17137fe700 1 -- 172.21.15.60:0/86086387 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f17140b8d90 msgr2=0x7f171406ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:38.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.961+0000 7f17137fe700 1 --2- 172.21.15.60:0/86086387 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f17140b8d90 0x7f171406ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:38.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.961+0000 7f17137fe700 1 -- 172.21.15.60:0/86086387 >> v1:172.21.15.60:6789/0 conn(0x7f17140bc810 legacy=0x7f17140ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:38.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.961+0000 7f17137fe700 1 -- 172.21.15.60:0/86086387 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17140b8900 con 0x7f17141449d0 2023-07-12T02:02:38.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.961+0000 7f1713fff700 1 --2- 172.21.15.60:0/86086387 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f17140b8d90 0x7f171406ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:02:38.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.961+0000 7f17137fe700 1 --2- 172.21.15.60:0/86086387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17141449d0 0x7f171414db50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1704009840 tx=0x7f1704009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ae5a00e07482dc2 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:38.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.961+0000 7f17127fc700 1 -- 172.21.15.60:0/86086387 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1704011830 con 0x7f17141449d0 2023-07-12T02:02:38.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.961+0000 7f17127fc700 1 -- 172.21.15.60:0/86086387 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1704011990 con 0x7f17141449d0 2023-07-12T02:02:38.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.961+0000 7f17127fc700 1 -- 172.21.15.60:0/86086387 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1704011d20 con 0x7f17141449d0 2023-07-12T02:02:38.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.962+0000 7f1719b61700 1 -- 172.21.15.60:0/86086387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17141449d0 msgr2=0x7f171414db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:38.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.962+0000 7f1719b61700 1 --2- 172.21.15.60:0/86086387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17141449d0 0x7f171414db50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1704009840 tx=0x7f1704009b50 comp rx=0 tx=0).stop 2023-07-12T02:02:38.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.962+0000 7f1719b61700 1 -- 172.21.15.60:0/86086387 shutdown_connections 2023-07-12T02:02:38.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.962+0000 7f1719b61700 1 --2- 172.21.15.60:0/86086387 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f17140b8d90 0x7f171406ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:38.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.962+0000 7f1719b61700 1 --2- 172.21.15.60:0/86086387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17141449d0 0x7f171414db50 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:38.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.962+0000 7f1719b61700 1 -- 172.21.15.60:0/86086387 >> 172.21.15.60:0/86086387 conn(0x7f17140c0860 msgr2=0x7f17140c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:38.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.962+0000 7f1719b61700 1 -- 172.21.15.60:0/86086387 shutdown_connections 2023-07-12T02:02:38.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.962+0000 7f1719b61700 1 -- 172.21.15.60:0/86086387 wait complete. 2023-07-12T02:02:38.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.963+0000 7f1719b61700 1 Processor -- start 2023-07-12T02:02:38.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.963+0000 7f1719b61700 1 -- start start 2023-07-12T02:02:38.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.964+0000 7f1719b61700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17140b8d90 0x7f17140b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:38.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.964+0000 7f1719b61700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f17140bc810 0x7f171414d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:38.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.964+0000 7f1719b61700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17141449d0 0x7f17141e34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:38.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.964+0000 7f1719b61700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17140b45f0 con 0x7f17140b8d90 2023-07-12T02:02:38.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.964+0000 7f1719b61700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f171414d6e0 con 0x7f17141449d0 2023-07-12T02:02:38.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.964+0000 7f1719b61700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17140b38c0 con 0x7f17140bc810 2023-07-12T02:02:38.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.964+0000 7f17137fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17140b8d90 0x7f17140b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:38.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.964+0000 7f17137fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17140b8d90 0x7f17140b31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40830/0 (socket says 172.21.15.60:40830) 2023-07-12T02:02:38.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.964+0000 7f17137fe700 1 -- 172.21.15.60:0/875560672 learned_addr learned my addr 172.21.15.60:0/875560672 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:38.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.964+0000 7f17137fe700 1 -- 172.21.15.60:0/875560672 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f17140bc810 msgr2=0x7f171414d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:38.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.964+0000 7f17137fe700 1 --2- 172.21.15.60:0/875560672 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f17140bc810 0x7f171414d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:38.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.964+0000 7f17137fe700 1 -- 172.21.15.60:0/875560672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17141449d0 msgr2=0x7f17141e34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:38.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.964+0000 7f1713fff700 1 --2- 172.21.15.60:0/875560672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17141449d0 0x7f17141e34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:38.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.964+0000 7f17137fe700 1 --2- 172.21.15.60:0/875560672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17141449d0 0x7f17141e34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:38.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.964+0000 7f17137fe700 1 -- 172.21.15.60:0/875560672 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f170c009a70 con 0x7f17140b8d90 2023-07-12T02:02:38.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.964+0000 7f17137fe700 1 --2- 172.21.15.60:0/875560672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17140b8d90 0x7f17140b31e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1704009fd0 tx=0x7f1704004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:38.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.964+0000 7f16fbfff700 1 -- 172.21.15.60:0/875560672 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17040036a0 con 0x7f17140b8d90 2023-07-12T02:02:38.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.964+0000 7f16fbfff700 1 -- 172.21.15.60:0/875560672 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f170401e070 con 0x7f17140b8d90 2023-07-12T02:02:38.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.964+0000 7f1719b61700 1 -- 172.21.15.60:0/875560672 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17040094a0 con 0x7f17140b8d90 2023-07-12T02:02:38.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.964+0000 7f16fbfff700 1 -- 172.21.15.60:0/875560672 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1704003a20 con 0x7f17140b8d90 2023-07-12T02:02:38.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.964+0000 7f1719b61700 1 -- 172.21.15.60:0/875560672 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17140b4030 con 0x7f17140b8d90 2023-07-12T02:02:38.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.965+0000 7f1719b61700 1 -- 172.21.15.60:0/875560672 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1714074360 con 0x7f17140b8d90 2023-07-12T02:02:38.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.966+0000 7f16fbfff700 1 -- 172.21.15.60:0/875560672 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1704003b80 con 0x7f17140b8d90 2023-07-12T02:02:38.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.966+0000 7f16fbfff700 1 --2- 172.21.15.60:0/875560672 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f170006ace0 0x7f170006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:38.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.966+0000 7f16fbfff700 1 -- 172.21.15.60:0/875560672 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f170408a400 con 0x7f17140b8d90 2023-07-12T02:02:38.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.966+0000 7f1712ffd700 1 --2- 172.21.15.60:0/875560672 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f170006ace0 0x7f170006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:38.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.967+0000 7f1712ffd700 1 --2- 172.21.15.60:0/875560672 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f170006ace0 0x7f170006d190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f17140b13e0 tx=0x7f17080079c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:38.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:38.971+0000 7f16fbfff700 1 -- 172.21.15.60:0/875560672 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f1704055540 con 0x7f17140b8d90 2023-07-12T02:02:39.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.163+0000 7f1719b61700 1 -- 172.21.15.60:0/875560672 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f17140bc330 con 0x7f17140b8d90 2023-07-12T02:02:39.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.164+0000 7f16fbfff700 1 -- 172.21.15.60:0/875560672 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1704058b60 con 0x7f17140b8d90 2023-07-12T02:02:39.168 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-07-12T02:02:39.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.166+0000 7f1719b61700 1 -- 172.21.15.60:0/875560672 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f170006ace0 msgr2=0x7f170006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:39.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.166+0000 7f1719b61700 1 --2- 172.21.15.60:0/875560672 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f170006ace0 0x7f170006d190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f17140b13e0 tx=0x7f17080079c0 comp rx=0 tx=0).stop 2023-07-12T02:02:39.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.166+0000 7f1719b61700 1 -- 172.21.15.60:0/875560672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17140b8d90 msgr2=0x7f17140b31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:39.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.166+0000 7f1719b61700 1 --2- 172.21.15.60:0/875560672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17140b8d90 0x7f17140b31e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1704009fd0 tx=0x7f1704004750 comp rx=0 tx=0).stop 2023-07-12T02:02:39.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.166+0000 7f1719b61700 1 -- 172.21.15.60:0/875560672 shutdown_connections 2023-07-12T02:02:39.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.166+0000 7f1719b61700 1 --2- 172.21.15.60:0/875560672 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f170006ace0 0x7f170006d190 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:39.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.166+0000 7f1719b61700 1 --2- 172.21.15.60:0/875560672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17140b8d90 0x7f17140b31e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:39.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.166+0000 7f1719b61700 1 --2- 172.21.15.60:0/875560672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17141449d0 0x7f17141e34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:39.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.166+0000 7f1719b61700 1 --2- 172.21.15.60:0/875560672 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f17140bc810 0x7f171414d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:39.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.166+0000 7f1719b61700 1 -- 172.21.15.60:0/875560672 >> 172.21.15.60:0/875560672 conn(0x7f17140c0860 msgr2=0x7f17140baeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:39.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.166+0000 7f1719b61700 1 -- 172.21.15.60:0/875560672 shutdown_connections 2023-07-12T02:02:39.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.166+0000 7f1719b61700 1 -- 172.21.15.60:0/875560672 wait complete. 2023-07-12T02:02:39.182 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-12T02:02:39.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.306+0000 7f770e19d700 1 Processor -- start 2023-07-12T02:02:39.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.306+0000 7f770e19d700 1 -- start start 2023-07-12T02:02:39.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.307+0000 7f770e19d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7708141780 0x7f77080ba010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:39.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.307+0000 7f770e19d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7708070e70 con 0x7f77080b96b0 2023-07-12T02:02:39.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.307+0000 7f770e19d700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7708071ea0 con 0x7f7708071a30 2023-07-12T02:02:39.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.307+0000 7f770e19d700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77080b9b40 con 0x7f7708141780 2023-07-12T02:02:39.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.307+0000 7f7707fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f77080b96b0 0x7f7708151eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48624/0 (socket says 172.21.15.60:48624) 2023-07-12T02:02:39.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.307+0000 7f7707fff700 1 -- 172.21.15.60:0/1155354998 learned_addr learned my addr 172.21.15.60:0/1155354998 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:39.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.308+0000 7f77077fe700 1 --2- 172.21.15.60:0/1155354998 >> v2:172.21.15.79:3300/0 conn(0x7f7708141780 0x7f77080ba010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:39.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.308+0000 7f77067fc700 1 -- 172.21.15.60:0/1155354998 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3631764735 0 0) 0x7f7708070e70 con 0x7f77080b96b0 2023-07-12T02:02:39.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.308+0000 7f77067fc700 1 -- 172.21.15.60:0/1155354998 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76f40035b0 con 0x7f77080b96b0 2023-07-12T02:02:39.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.308+0000 7f77067fc700 1 -- 172.21.15.60:0/1155354998 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3749150701 0 0) 0x7f7708071ea0 con 0x7f7708071a30 2023-07-12T02:02:39.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.308+0000 7f77067fc700 1 -- 172.21.15.60:0/1155354998 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7708070e70 con 0x7f7708071a30 2023-07-12T02:02:39.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.308+0000 7f77067fc700 1 -- 172.21.15.60:0/1155354998 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1216195893 0 0) 0x7f76f40035b0 con 0x7f77080b96b0 2023-07-12T02:02:39.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.308+0000 7f77077fe700 1 -- 172.21.15.60:0/1155354998 >> v1:172.21.15.79:6789/0 conn(0x7f7708071a30 legacy=0x7f770814ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:39.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.308+0000 7f77077fe700 1 -- 172.21.15.60:0/1155354998 >> v1:172.21.15.60:6789/0 conn(0x7f77080b96b0 legacy=0x7f7708151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:39.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.308+0000 7f77077fe700 1 -- 172.21.15.60:0/1155354998 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7708070670 con 0x7f7708141780 2023-07-12T02:02:39.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.308+0000 7f77077fe700 1 --2- 172.21.15.60:0/1155354998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7708141780 0x7f77080ba010 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f76f8009840 tx=0x7f76f8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aaa5651df69050e7 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:39.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.308+0000 7f77067fc700 1 -- 172.21.15.60:0/1155354998 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77000019f0 con 0x7f7708141780 2023-07-12T02:02:39.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.308+0000 7f77067fc700 1 -- 172.21.15.60:0/1155354998 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f8004030 con 0x7f7708141780 2023-07-12T02:02:39.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.308+0000 7f77067fc700 1 -- 172.21.15.60:0/1155354998 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f80043c0 con 0x7f7708141780 2023-07-12T02:02:39.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.309+0000 7f770e19d700 1 -- 172.21.15.60:0/1155354998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7708141780 msgr2=0x7f77080ba010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:39.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.309+0000 7f770e19d700 1 --2- 172.21.15.60:0/1155354998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7708141780 0x7f77080ba010 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f76f8009840 tx=0x7f76f8009b50 comp rx=0 tx=0).stop 2023-07-12T02:02:39.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.309+0000 7f770e19d700 1 -- 172.21.15.60:0/1155354998 shutdown_connections 2023-07-12T02:02:39.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.309+0000 7f770e19d700 1 --2- 172.21.15.60:0/1155354998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7708141780 0x7f77080ba010 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:39.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.309+0000 7f770e19d700 1 -- 172.21.15.60:0/1155354998 >> 172.21.15.60:0/1155354998 conn(0x7f770806d0e0 msgr2=0x7f770806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:39.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.309+0000 7f770e19d700 1 -- 172.21.15.60:0/1155354998 shutdown_connections 2023-07-12T02:02:39.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.309+0000 7f770e19d700 1 -- 172.21.15.60:0/1155354998 wait complete. 2023-07-12T02:02:39.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.310+0000 7f770e19d700 1 Processor -- start 2023-07-12T02:02:39.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.310+0000 7f770e19d700 1 -- start start 2023-07-12T02:02:39.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.311+0000 7f770e19d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7708071a30 0x7f7708137de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:39.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.311+0000 7f770e19d700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77080b96b0 0x7f77081d2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:39.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.311+0000 7f770e19d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7708141780 0x7f770813d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:39.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.311+0000 7f770e19d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77081d2b90 con 0x7f7708071a30 2023-07-12T02:02:39.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.311+0000 7f770e19d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77081d1540 con 0x7f7708141780 2023-07-12T02:02:39.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.311+0000 7f770e19d700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77081d3720 con 0x7f77080b96b0 2023-07-12T02:02:39.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.311+0000 7f77077fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7708071a30 0x7f7708137de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:39.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.311+0000 7f77077fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7708071a30 0x7f7708137de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40836/0 (socket says 172.21.15.60:40836) 2023-07-12T02:02:39.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.311+0000 7f77077fe700 1 -- 172.21.15.60:0/2108904233 learned_addr learned my addr 172.21.15.60:0/2108904233 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:39.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.311+0000 7f7707fff700 1 --2- 172.21.15.60:0/2108904233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7708141780 0x7f770813d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:39.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.311+0000 7f7706ffd700 1 --2- 172.21.15.60:0/2108904233 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77080b96b0 0x7f77081d2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:39.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.311+0000 7f77077fe700 1 -- 172.21.15.60:0/2108904233 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77080b96b0 msgr2=0x7f77081d2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:39.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.311+0000 7f77077fe700 1 --2- 172.21.15.60:0/2108904233 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77080b96b0 0x7f77081d2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:39.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.311+0000 7f77077fe700 1 -- 172.21.15.60:0/2108904233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7708141780 msgr2=0x7f770813d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:39.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.311+0000 7f77077fe700 1 --2- 172.21.15.60:0/2108904233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7708141780 0x7f770813d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:39.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.311+0000 7f77077fe700 1 -- 172.21.15.60:0/2108904233 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f80094a0 con 0x7f7708071a30 2023-07-12T02:02:39.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.311+0000 7f7707fff700 1 --2- 172.21.15.60:0/2108904233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7708141780 0x7f770813d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:39.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.311+0000 7f77077fe700 1 --2- 172.21.15.60:0/2108904233 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7708071a30 0x7f7708137de0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f76f800a010 tx=0x7f76f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:39.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.312+0000 7f76fffff700 1 -- 172.21.15.60:0/2108904233 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f8003db0 con 0x7f7708071a30 2023-07-12T02:02:39.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.312+0000 7f76fffff700 1 -- 172.21.15.60:0/2108904233 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f801f070 con 0x7f7708071a30 2023-07-12T02:02:39.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.312+0000 7f770e19d700 1 -- 172.21.15.60:0/2108904233 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77081d1800 con 0x7f7708071a30 2023-07-12T02:02:39.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.312+0000 7f76fffff700 1 -- 172.21.15.60:0/2108904233 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f8011870 con 0x7f7708071a30 2023-07-12T02:02:39.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.312+0000 7f770e19d700 1 -- 172.21.15.60:0/2108904233 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77080b5d60 con 0x7f7708071a30 2023-07-12T02:02:39.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.313+0000 7f770e19d700 1 -- 172.21.15.60:0/2108904233 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77080b5ef0 con 0x7f7708071a30 2023-07-12T02:02:39.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.313+0000 7f76fffff700 1 -- 172.21.15.60:0/2108904233 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f76f8021030 con 0x7f7708071a30 2023-07-12T02:02:39.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.313+0000 7f76fffff700 1 --2- 172.21.15.60:0/2108904233 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f76e806ace0 0x7f76e806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:39.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.314+0000 7f76fffff700 1 -- 172.21.15.60:0/2108904233 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f76f808a7b0 con 0x7f7708071a30 2023-07-12T02:02:39.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.314+0000 7f7706ffd700 1 --2- 172.21.15.60:0/2108904233 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f76e806ace0 0x7f76e806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:39.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.314+0000 7f7706ffd700 1 --2- 172.21.15.60:0/2108904233 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f76e806ace0 0x7f76e806d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f77081d09f0 tx=0x7f76f0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:39.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.318+0000 7f76fffff700 1 -- 172.21.15.60:0/2108904233 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f76f8055a10 con 0x7f7708071a30 2023-07-12T02:02:39.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.517+0000 7f770e19d700 1 -- 172.21.15.60:0/2108904233 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f77080b8590 con 0x7f7708071a30 2023-07-12T02:02:39.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.517+0000 7f76fffff700 1 -- 172.21.15.60:0/2108904233 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f76f8059030 con 0x7f7708071a30 2023-07-12T02:02:39.521 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-07-12T02:02:39.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.519+0000 7f770e19d700 1 -- 172.21.15.60:0/2108904233 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f76e806ace0 msgr2=0x7f76e806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:39.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.519+0000 7f770e19d700 1 --2- 172.21.15.60:0/2108904233 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f76e806ace0 0x7f76e806d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f77081d09f0 tx=0x7f76f0009040 comp rx=0 tx=0).stop 2023-07-12T02:02:39.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.519+0000 7f770e19d700 1 -- 172.21.15.60:0/2108904233 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7708071a30 msgr2=0x7f7708137de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:39.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.519+0000 7f770e19d700 1 --2- 172.21.15.60:0/2108904233 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7708071a30 0x7f7708137de0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f76f800a010 tx=0x7f76f8004750 comp rx=0 tx=0).stop 2023-07-12T02:02:39.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.519+0000 7f770e19d700 1 -- 172.21.15.60:0/2108904233 shutdown_connections 2023-07-12T02:02:39.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.519+0000 7f770e19d700 1 --2- 172.21.15.60:0/2108904233 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f76e806ace0 0x7f76e806d190 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:39.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.519+0000 7f770e19d700 1 --2- 172.21.15.60:0/2108904233 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7708071a30 0x7f7708137de0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:39.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.519+0000 7f770e19d700 1 --2- 172.21.15.60:0/2108904233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7708141780 0x7f770813d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:39.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.519+0000 7f770e19d700 1 --2- 172.21.15.60:0/2108904233 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f77080b96b0 0x7f77081d2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:39.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.519+0000 7f770e19d700 1 -- 172.21.15.60:0/2108904233 >> 172.21.15.60:0/2108904233 conn(0x7f770806d0e0 msgr2=0x7f77080b7e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:39.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.519+0000 7f770e19d700 1 -- 172.21.15.60:0/2108904233 shutdown_connections 2023-07-12T02:02:39.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.519+0000 7f770e19d700 1 -- 172.21.15.60:0/2108904233 wait complete. 2023-07-12T02:02:39.546 INFO:tasks.cephfs_test_runner:Starting test: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2023-07-12T02:02:39.547 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group' 2023-07-12T02:02:39.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.669+0000 7f83bbe53700 1 Processor -- start 2023-07-12T02:02:39.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.669+0000 7f83bbe53700 1 -- start start 2023-07-12T02:02:39.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.670+0000 7f83bbe53700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f83b414bf30 0x7f83b40b8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:39.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.670+0000 7f83bbe53700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83b4070130 con 0x7f83b4145fc0 2023-07-12T02:02:39.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.670+0000 7f83bbe53700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83b4070f80 con 0x7f83b4071d20 2023-07-12T02:02:39.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.670+0000 7f83bbe53700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83b4071260 con 0x7f83b414bf30 2023-07-12T02:02:39.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.670+0000 7f83ba3f0700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f83b4145fc0 0x7f83b4153080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48632/0 (socket says 172.21.15.60:48632) 2023-07-12T02:02:39.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.670+0000 7f83ba3f0700 1 -- 172.21.15.60:0/3265361027 learned_addr learned my addr 172.21.15.60:0/3265361027 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:39.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.670+0000 7f83b9bef700 1 --2- 172.21.15.60:0/3265361027 >> v2:172.21.15.79:3300/0 conn(0x7f83b414bf30 0x7f83b40b8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:39.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.670+0000 7f83b8bed700 1 -- 172.21.15.60:0/3265361027 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2782658439 0 0) 0x7f83b4070130 con 0x7f83b4145fc0 2023-07-12T02:02:39.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.670+0000 7f83b8bed700 1 -- 172.21.15.60:0/3265361027 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83a00035b0 con 0x7f83b4145fc0 2023-07-12T02:02:39.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.670+0000 7f83b8bed700 1 -- 172.21.15.60:0/3265361027 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 398175605 0 0) 0x7f83b4070f80 con 0x7f83b4071d20 2023-07-12T02:02:39.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.670+0000 7f83b8bed700 1 -- 172.21.15.60:0/3265361027 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83b4070130 con 0x7f83b4071d20 2023-07-12T02:02:39.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.670+0000 7f83b9bef700 1 -- 172.21.15.60:0/3265361027 >> v1:172.21.15.79:6789/0 conn(0x7f83b4071d20 legacy=0x7f83b41458b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:39.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.670+0000 7f83b9bef700 1 -- 172.21.15.60:0/3265361027 >> v1:172.21.15.60:6789/0 conn(0x7f83b4145fc0 legacy=0x7f83b4153080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:39.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.670+0000 7f83b9bef700 1 -- 172.21.15.60:0/3265361027 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b4071540 con 0x7f83b414bf30 2023-07-12T02:02:39.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.671+0000 7f83b9bef700 1 --2- 172.21.15.60:0/3265361027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83b414bf30 0x7f83b40b8ff0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f83a4009840 tx=0x7f83a4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3531f5eff18074e server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:39.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.671+0000 7f83b8bed700 1 -- 172.21.15.60:0/3265361027 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a4011830 con 0x7f83b414bf30 2023-07-12T02:02:39.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.671+0000 7f83b8bed700 1 -- 172.21.15.60:0/3265361027 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a4011990 con 0x7f83b414bf30 2023-07-12T02:02:39.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.671+0000 7f83b8bed700 1 -- 172.21.15.60:0/3265361027 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a4011d20 con 0x7f83b414bf30 2023-07-12T02:02:39.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.671+0000 7f83bbe53700 1 -- 172.21.15.60:0/3265361027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83b414bf30 msgr2=0x7f83b40b8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:39.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.671+0000 7f83bbe53700 1 --2- 172.21.15.60:0/3265361027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83b414bf30 0x7f83b40b8ff0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f83a4009840 tx=0x7f83a4009b50 comp rx=0 tx=0).stop 2023-07-12T02:02:39.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.671+0000 7f83bbe53700 1 -- 172.21.15.60:0/3265361027 shutdown_connections 2023-07-12T02:02:39.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.671+0000 7f83bbe53700 1 --2- 172.21.15.60:0/3265361027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83b414bf30 0x7f83b40b8ff0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:39.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.671+0000 7f83bbe53700 1 -- 172.21.15.60:0/3265361027 >> 172.21.15.60:0/3265361027 conn(0x7f83b40be670 msgr2=0x7f83b40bea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:39.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.671+0000 7f83bbe53700 1 -- 172.21.15.60:0/3265361027 shutdown_connections 2023-07-12T02:02:39.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.671+0000 7f83bbe53700 1 -- 172.21.15.60:0/3265361027 wait complete. 2023-07-12T02:02:39.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.672+0000 7f83bbe53700 1 Processor -- start 2023-07-12T02:02:39.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.673+0000 7f83bbe53700 1 -- start start 2023-07-12T02:02:39.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.673+0000 7f83bbe53700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83b4071d20 0x7f83b41e4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:39.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.673+0000 7f83bbe53700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f83b4145fc0 0x7f83b41466c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:39.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.673+0000 7f83bbe53700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83b414bf30 0x7f83b4148f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:39.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.673+0000 7f83bbe53700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b41e3bf0 con 0x7f83b414bf30 2023-07-12T02:02:39.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.673+0000 7f83bbe53700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b41e35a0 con 0x7f83b4071d20 2023-07-12T02:02:39.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.673+0000 7f83bbe53700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b41e3880 con 0x7f83b4145fc0 2023-07-12T02:02:39.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.673+0000 7f83ba3f0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83b414bf30 0x7f83b4148f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:39.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.673+0000 7f83ba3f0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83b414bf30 0x7f83b4148f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40850/0 (socket says 172.21.15.60:40850) 2023-07-12T02:02:39.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.673+0000 7f83ba3f0700 1 -- 172.21.15.60:0/1288924711 learned_addr learned my addr 172.21.15.60:0/1288924711 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:39.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.673+0000 7f83b9bef700 1 --2- 172.21.15.60:0/1288924711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83b4071d20 0x7f83b41e4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:39.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.673+0000 7f83b93ee700 1 --2- 172.21.15.60:0/1288924711 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f83b4145fc0 0x7f83b41466c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:39.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.674+0000 7f83ba3f0700 1 -- 172.21.15.60:0/1288924711 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f83b4145fc0 msgr2=0x7f83b41466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:39.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.674+0000 7f83ba3f0700 1 --2- 172.21.15.60:0/1288924711 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f83b4145fc0 0x7f83b41466c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:39.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.674+0000 7f83ba3f0700 1 -- 172.21.15.60:0/1288924711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83b4071d20 msgr2=0x7f83b41e4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:39.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.674+0000 7f83ba3f0700 1 --2- 172.21.15.60:0/1288924711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83b4071d20 0x7f83b41e4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:39.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.674+0000 7f83ba3f0700 1 -- 172.21.15.60:0/1288924711 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a40094a0 con 0x7f83b414bf30 2023-07-12T02:02:39.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.674+0000 7f83b9bef700 1 --2- 172.21.15.60:0/1288924711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83b4071d20 0x7f83b41e4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:39.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.674+0000 7f83ba3f0700 1 --2- 172.21.15.60:0/1288924711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83b414bf30 0x7f83b4148f40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f83ac00cba0 tx=0x7f83ac00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:39.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.674+0000 7f83aa7fc700 1 -- 172.21.15.60:0/1288924711 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac00ab20 con 0x7f83b414bf30 2023-07-12T02:02:39.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.674+0000 7f83aa7fc700 1 -- 172.21.15.60:0/1288924711 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ac00ac80 con 0x7f83b414bf30 2023-07-12T02:02:39.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.674+0000 7f83aa7fc700 1 -- 172.21.15.60:0/1288924711 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac012400 con 0x7f83b414bf30 2023-07-12T02:02:39.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.674+0000 7f83bbe53700 1 -- 172.21.15.60:0/1288924711 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b41498c0 con 0x7f83b414bf30 2023-07-12T02:02:39.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.674+0000 7f83bbe53700 1 -- 172.21.15.60:0/1288924711 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b406c0e0 con 0x7f83b414bf30 2023-07-12T02:02:39.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.675+0000 7f83bbe53700 1 -- 172.21.15.60:0/1288924711 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83b41e3d60 con 0x7f83b414bf30 2023-07-12T02:02:39.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.676+0000 7f83aa7fc700 1 -- 172.21.15.60:0/1288924711 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f83ac01b3b0 con 0x7f83b414bf30 2023-07-12T02:02:39.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.676+0000 7f83aa7fc700 1 --2- 172.21.15.60:0/1288924711 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f839806ace0 0x7f839806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:39.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.676+0000 7f83aa7fc700 1 -- 172.21.15.60:0/1288924711 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f83ac0892e0 con 0x7f83b414bf30 2023-07-12T02:02:39.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.677+0000 7f83b9bef700 1 --2- 172.21.15.60:0/1288924711 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f839806ace0 0x7f839806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:39.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.677+0000 7f83b9bef700 1 --2- 172.21.15.60:0/1288924711 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f839806ace0 0x7f839806d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f83a4009fd0 tx=0x7f83a401c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:39.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.681+0000 7f83aa7fc700 1 -- 172.21.15.60:0/1288924711 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f83ac057e10 con 0x7f83b414bf30 2023-07-12T02:02:39.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:39.959+0000 7f83bbe53700 1 -- 172.21.15.60:0/1288924711 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]} v 0) v1 -- 0x7f83b4074360 con 0x7f83b414bf30 2023-07-12T02:02:40.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:40.879+0000 7f83aa7fc700 1 -- 172.21.15.60:0/1288924711 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]}]=0 v45) v1 ==== 166+0+0 (secure 0 0 0) 0x7f83ac0579a0 con 0x7f83b414bf30 2023-07-12T02:02:40.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:40.882+0000 7f83bbe53700 1 -- 172.21.15.60:0/1288924711 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f839806ace0 msgr2=0x7f839806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:40.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:40.882+0000 7f83bbe53700 1 --2- 172.21.15.60:0/1288924711 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f839806ace0 0x7f839806d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f83a4009fd0 tx=0x7f83a401c040 comp rx=0 tx=0).stop 2023-07-12T02:02:40.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:40.882+0000 7f83bbe53700 1 -- 172.21.15.60:0/1288924711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83b414bf30 msgr2=0x7f83b4148f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:40.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:40.882+0000 7f83bbe53700 1 --2- 172.21.15.60:0/1288924711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83b414bf30 0x7f83b4148f40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f83ac00cba0 tx=0x7f83ac00cf60 comp rx=0 tx=0).stop 2023-07-12T02:02:40.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:40.882+0000 7f83bbe53700 1 -- 172.21.15.60:0/1288924711 shutdown_connections 2023-07-12T02:02:40.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:40.882+0000 7f83bbe53700 1 --2- 172.21.15.60:0/1288924711 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f839806ace0 0x7f839806d190 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:40.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:40.882+0000 7f83bbe53700 1 --2- 172.21.15.60:0/1288924711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83b414bf30 0x7f83b4148f40 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:40.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:40.882+0000 7f83bbe53700 1 --2- 172.21.15.60:0/1288924711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83b4071d20 0x7f83b41e4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:40.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:40.882+0000 7f83bbe53700 1 --2- 172.21.15.60:0/1288924711 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f83b4145fc0 0x7f83b41466c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:40.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:40.882+0000 7f83bbe53700 1 -- 172.21.15.60:0/1288924711 >> 172.21.15.60:0/1288924711 conn(0x7f83b40be670 msgr2=0x7f83b4143bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:40.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:40.882+0000 7f83bbe53700 1 -- 172.21.15.60:0/1288924711 shutdown_connections 2023-07-12T02:02:40.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:40.882+0000 7f83bbe53700 1 -- 172.21.15.60:0/1288924711 wait complete. 2023-07-12T02:02:40.901 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-12T02:02:41.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.033+0000 7f6dd891d700 1 Processor -- start 2023-07-12T02:02:41.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.033+0000 7f6dd891d700 1 -- start start 2023-07-12T02:02:41.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.033+0000 7f6dd891d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6dd406b120 0x7f6dd41474f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:41.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.033+0000 7f6dd891d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6dd4071b60 0x7f6dd4147a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:41.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.033+0000 7f6dd891d700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6dd40b6430 0x7f6dd40b68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:41.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.033+0000 7f6dd891d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd4070800 con 0x7f6dd4071b60 2023-07-12T02:02:41.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.033+0000 7f6dd891d700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd4141c90 con 0x7f6dd406b120 2023-07-12T02:02:41.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.033+0000 7f6dd891d700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd40b3bd0 con 0x7f6dd40b6430 2023-07-12T02:02:41.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.033+0000 7f6dc9d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6dd4071b60 0x7f6dd4147a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:41.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.033+0000 7f6dc9d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6dd4071b60 0x7f6dd4147a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40858/0 (socket says 172.21.15.60:40858) 2023-07-12T02:02:41.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.033+0000 7f6dc9d9b700 1 -- 172.21.15.60:0/4125423165 learned_addr learned my addr 172.21.15.60:0/4125423165 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:41.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.034+0000 7f6dd259c700 1 --2- 172.21.15.60:0/4125423165 >> v2:172.21.15.79:3300/0 conn(0x7f6dd406b120 0x7f6dd41474f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:41.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.034+0000 7f6dd2d9d700 1 --2- 172.21.15.60:0/4125423165 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6dd40b6430 0x7f6dd40b68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:41.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.034+0000 7f6dc9d9b700 1 -- 172.21.15.60:0/4125423165 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6dd40b6430 msgr2=0x7f6dd40b68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:41.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.034+0000 7f6dc9d9b700 1 --2- 172.21.15.60:0/4125423165 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6dd40b6430 0x7f6dd40b68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:41.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.034+0000 7f6dc9d9b700 1 -- 172.21.15.60:0/4125423165 >> v2:172.21.15.79:3300/0 conn(0x7f6dd406b120 msgr2=0x7f6dd41474f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:41.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.034+0000 7f6dc9d9b700 1 --2- 172.21.15.60:0/4125423165 >> v2:172.21.15.79:3300/0 conn(0x7f6dd406b120 0x7f6dd41474f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:41.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.034+0000 7f6dc9d9b700 1 -- 172.21.15.60:0/4125423165 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd40714d0 con 0x7f6dd4071b60 2023-07-12T02:02:41.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.034+0000 7f6dc9d9b700 1 --2- 172.21.15.60:0/4125423165 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dd4071b60 0x7f6dd4147a30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6dd406b830 tx=0x7f6dbc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3182416ff77ba5 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:41.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.034+0000 7f6dd1d9b700 1 -- 172.21.15.60:0/4125423165 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc00b870 con 0x7f6dd4071b60 2023-07-12T02:02:41.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.034+0000 7f6dd1d9b700 1 -- 172.21.15.60:0/4125423165 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dbc00b9d0 con 0x7f6dd4071b60 2023-07-12T02:02:41.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.034+0000 7f6dd1d9b700 1 -- 172.21.15.60:0/4125423165 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc00bd60 con 0x7f6dd4071b60 2023-07-12T02:02:41.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.035+0000 7f6dd891d700 1 -- 172.21.15.60:0/4125423165 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dd4071b60 msgr2=0x7f6dd4147a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:41.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.035+0000 7f6dd891d700 1 --2- 172.21.15.60:0/4125423165 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dd4071b60 0x7f6dd4147a30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6dd406b830 tx=0x7f6dbc009bd0 comp rx=0 tx=0).stop 2023-07-12T02:02:41.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.035+0000 7f6dd891d700 1 -- 172.21.15.60:0/4125423165 shutdown_connections 2023-07-12T02:02:41.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.035+0000 7f6dd891d700 1 --2- 172.21.15.60:0/4125423165 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6dd40b6430 0x7f6dd40b68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:41.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.035+0000 7f6dd891d700 1 --2- 172.21.15.60:0/4125423165 >> v2:172.21.15.79:3300/0 conn(0x7f6dd406b120 0x7f6dd41474f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:41.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.035+0000 7f6dd891d700 1 --2- 172.21.15.60:0/4125423165 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dd4071b60 0x7f6dd4147a30 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:41.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.035+0000 7f6dd891d700 1 -- 172.21.15.60:0/4125423165 >> 172.21.15.60:0/4125423165 conn(0x7f6dd40bd980 msgr2=0x7f6dd40b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:41.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.035+0000 7f6dd891d700 1 -- 172.21.15.60:0/4125423165 shutdown_connections 2023-07-12T02:02:41.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.035+0000 7f6dd891d700 1 -- 172.21.15.60:0/4125423165 wait complete. 2023-07-12T02:02:41.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.036+0000 7f6dd891d700 1 Processor -- start 2023-07-12T02:02:41.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.036+0000 7f6dd891d700 1 -- start start 2023-07-12T02:02:41.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.037+0000 7f6dd891d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dd406b120 0x7f6dd4146400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:41.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.037+0000 7f6dd891d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dd4071b60 0x7f6dd41404a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:41.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.037+0000 7f6dd891d700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6dd40b6430 0x7f6dd41420d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:41.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.037+0000 7f6dd891d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd41409e0 con 0x7f6dd4071b60 2023-07-12T02:02:41.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.037+0000 7f6dd891d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd41449c0 con 0x7f6dd406b120 2023-07-12T02:02:41.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.037+0000 7f6dd891d700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd4145850 con 0x7f6dd40b6430 2023-07-12T02:02:41.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.037+0000 7f6dc9d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dd4071b60 0x7f6dd41404a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:41.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.037+0000 7f6dc9d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dd4071b60 0x7f6dd41404a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40870/0 (socket says 172.21.15.60:40870) 2023-07-12T02:02:41.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.037+0000 7f6dc9d9b700 1 -- 172.21.15.60:0/409016962 learned_addr learned my addr 172.21.15.60:0/409016962 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:41.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.037+0000 7f6dd2d9d700 1 --2- 172.21.15.60:0/409016962 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6dd40b6430 0x7f6dd41420d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:41.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.037+0000 7f6dd259c700 1 --2- 172.21.15.60:0/409016962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dd406b120 0x7f6dd4146400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:41.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.037+0000 7f6dc9d9b700 1 -- 172.21.15.60:0/409016962 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6dd40b6430 msgr2=0x7f6dd41420d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:41.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.037+0000 7f6dc9d9b700 1 --2- 172.21.15.60:0/409016962 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6dd40b6430 0x7f6dd41420d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:41.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.037+0000 7f6dc9d9b700 1 -- 172.21.15.60:0/409016962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dd406b120 msgr2=0x7f6dd4146400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:41.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.037+0000 7f6dc9d9b700 1 --2- 172.21.15.60:0/409016962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dd406b120 0x7f6dd4146400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:41.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.037+0000 7f6dc9d9b700 1 -- 172.21.15.60:0/409016962 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dbc009550 con 0x7f6dd4071b60 2023-07-12T02:02:41.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.037+0000 7f6dc9d9b700 1 --2- 172.21.15.60:0/409016962 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dd4071b60 0x7f6dd41404a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc000c00 tx=0x7f6dbc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:41.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.038+0000 7f6dcb7fe700 1 -- 172.21.15.60:0/409016962 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc004480 con 0x7f6dd4071b60 2023-07-12T02:02:41.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.038+0000 7f6dcb7fe700 1 -- 172.21.15.60:0/409016962 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dbc0045e0 con 0x7f6dd4071b60 2023-07-12T02:02:41.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.038+0000 7f6dd891d700 1 -- 172.21.15.60:0/409016962 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd4146a80 con 0x7f6dd4071b60 2023-07-12T02:02:41.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.038+0000 7f6dcb7fe700 1 -- 172.21.15.60:0/409016962 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc0038e0 con 0x7f6dd4071b60 2023-07-12T02:02:41.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.038+0000 7f6dd891d700 1 -- 172.21.15.60:0/409016962 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd4146ea0 con 0x7f6dd4071b60 2023-07-12T02:02:41.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.039+0000 7f6dd891d700 1 -- 172.21.15.60:0/409016962 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dd4141df0 con 0x7f6dd4071b60 2023-07-12T02:02:41.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.039+0000 7f6dcb7fe700 1 -- 172.21.15.60:0/409016962 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6dbc021070 con 0x7f6dd4071b60 2023-07-12T02:02:41.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.040+0000 7f6dcb7fe700 1 --2- 172.21.15.60:0/409016962 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f6db406ace0 0x7f6db406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:41.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.040+0000 7f6dcb7fe700 1 -- 172.21.15.60:0/409016962 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6dbc08a9f0 con 0x7f6dd4071b60 2023-07-12T02:02:41.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.040+0000 7f6dd259c700 1 --2- 172.21.15.60:0/409016962 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f6db406ace0 0x7f6db406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:41.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.040+0000 7f6dd259c700 1 --2- 172.21.15.60:0/409016962 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f6db406ace0 0x7f6db406d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4009950 tx=0x7f6dc4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:41.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.044+0000 7f6dcb7fe700 1 -- 172.21.15.60:0/409016962 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f6dd4141df0 con 0x7f6dd4071b60 2023-07-12T02:02:41.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.238+0000 7f6dd891d700 1 -- 172.21.15.60:0/409016962 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6dd4141df0 con 0x7f6dd4071b60 2023-07-12T02:02:41.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.242+0000 7f6dcb7fe700 1 -- 172.21.15.60:0/409016962 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6dd4141df0 con 0x7f6dd4071b60 2023-07-12T02:02:41.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.244+0000 7f6dd891d700 1 -- 172.21.15.60:0/409016962 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f6db406ace0 msgr2=0x7f6db406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:41.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.244+0000 7f6dd891d700 1 --2- 172.21.15.60:0/409016962 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f6db406ace0 0x7f6db406d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4009950 tx=0x7f6dc4008040 comp rx=0 tx=0).stop 2023-07-12T02:02:41.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.244+0000 7f6dd891d700 1 -- 172.21.15.60:0/409016962 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dd4071b60 msgr2=0x7f6dd41404a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:41.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.244+0000 7f6dd891d700 1 --2- 172.21.15.60:0/409016962 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dd4071b60 0x7f6dd41404a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc000c00 tx=0x7f6dbc004750 comp rx=0 tx=0).stop 2023-07-12T02:02:41.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.244+0000 7f6dd891d700 1 -- 172.21.15.60:0/409016962 shutdown_connections 2023-07-12T02:02:41.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.244+0000 7f6dd891d700 1 --2- 172.21.15.60:0/409016962 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f6db406ace0 0x7f6db406d190 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:41.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.244+0000 7f6dd891d700 1 --2- 172.21.15.60:0/409016962 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6dd40b6430 0x7f6dd41420d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:41.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.244+0000 7f6dd891d700 1 --2- 172.21.15.60:0/409016962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dd406b120 0x7f6dd4146400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:41.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.244+0000 7f6dd891d700 1 --2- 172.21.15.60:0/409016962 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dd4071b60 0x7f6dd41404a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:41.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.244+0000 7f6dd891d700 1 -- 172.21.15.60:0/409016962 >> 172.21.15.60:0/409016962 conn(0x7f6dd40bd980 msgr2=0x7f6dd4141460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:41.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.244+0000 7f6dd891d700 1 -- 172.21.15.60:0/409016962 shutdown_connections 2023-07-12T02:02:41.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.244+0000 7f6dd891d700 1 -- 172.21.15.60:0/409016962 wait complete. 2023-07-12T02:02:41.260 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-12T02:02:41.261 DEBUG:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-12T02:02:41.342 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-12T02:02:41.431 DEBUG:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-12T02:02:41.533 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-12T02:02:41.534 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-07-12T02:02:41.534 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-12T02:02:41.581 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-07-12T02:02:41.581 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-12T02:02:41.666 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-07-12T02:02:41.666 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-12T02:02:41.751 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:02:41.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.878+0000 7f625c55a700 1 Processor -- start 2023-07-12T02:02:41.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.879+0000 7f625c55a700 1 -- start start 2023-07-12T02:02:41.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.880+0000 7f625c55a700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f625406b120 0x7f62541474f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:41.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.880+0000 7f625c55a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6254071b60 0x7f6254147a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:41.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.880+0000 7f625c55a700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62540b3bd0 con 0x7f62540b6430 2023-07-12T02:02:41.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.880+0000 7f625c55a700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6254070800 con 0x7f6254071b60 2023-07-12T02:02:41.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.880+0000 7f625c55a700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6254141c90 con 0x7f625406b120 2023-07-12T02:02:41.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.880+0000 7f625a2f6700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f625406b120 0x7f62541474f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:41.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.880+0000 7f6259af5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6254071b60 0x7f6254147a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:41.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.880+0000 7f6259af5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6254071b60 0x7f6254147a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.60:44918/0 (socket says 172.21.15.60:44918) 2023-07-12T02:02:41.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.880+0000 7f625a2f6700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f625406b120 0x7f62541474f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.60:38766/0 (socket says 172.21.15.60:38766) 2023-07-12T02:02:41.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.880+0000 7f6259af5700 1 -- 172.21.15.60:0/737901478 learned_addr learned my addr 172.21.15.60:0/737901478 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:41.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.880+0000 7f625aaf7700 1 --1- 172.21.15.60:0/737901478 >> v1:172.21.15.79:6789/0 conn(0x7f62540b6430 0x7f62540b68d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.60:45034/0 (socket says 172.21.15.60:45034) 2023-07-12T02:02:41.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.880+0000 7f625a2f6700 1 -- 172.21.15.60:0/737901478 >> v2:172.21.15.79:3300/0 conn(0x7f6254071b60 msgr2=0x7f6254147a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:41.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.880+0000 7f625a2f6700 1 --2- 172.21.15.60:0/737901478 >> v2:172.21.15.79:3300/0 conn(0x7f6254071b60 0x7f6254147a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:41.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.880+0000 7f625a2f6700 1 -- 172.21.15.60:0/737901478 >> v1:172.21.15.79:6789/0 conn(0x7f62540b6430 legacy=0x7f62540b68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:41.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.880+0000 7f625a2f6700 1 -- 172.21.15.60:0/737901478 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62540714d0 con 0x7f625406b120 2023-07-12T02:02:41.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.880+0000 7f6259af5700 1 --2- 172.21.15.60:0/737901478 >> v2:172.21.15.79:3300/0 conn(0x7f6254071b60 0x7f6254147a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:02:41.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.881+0000 7f625a2f6700 1 --2- 172.21.15.60:0/737901478 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f625406b120 0x7f62541474f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6250009840 tx=0x7f6250009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36dc01287030cac7 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:41.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.881+0000 7f62592f4700 1 -- 172.21.15.60:0/737901478 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6250011830 con 0x7f625406b120 2023-07-12T02:02:41.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.881+0000 7f62592f4700 1 -- 172.21.15.60:0/737901478 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6250011990 con 0x7f625406b120 2023-07-12T02:02:41.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.881+0000 7f62592f4700 1 -- 172.21.15.60:0/737901478 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6250011d20 con 0x7f625406b120 2023-07-12T02:02:41.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.882+0000 7f625c55a700 1 -- 172.21.15.60:0/737901478 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f625406b120 msgr2=0x7f62541474f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:41.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.882+0000 7f625c55a700 1 --2- 172.21.15.60:0/737901478 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f625406b120 0x7f62541474f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6250009840 tx=0x7f6250009b50 comp rx=0 tx=0).stop 2023-07-12T02:02:41.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.882+0000 7f625c55a700 1 -- 172.21.15.60:0/737901478 shutdown_connections 2023-07-12T02:02:41.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.882+0000 7f625c55a700 1 --2- 172.21.15.60:0/737901478 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f625406b120 0x7f62541474f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:41.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.882+0000 7f625c55a700 1 --2- 172.21.15.60:0/737901478 >> v2:172.21.15.79:3300/0 conn(0x7f6254071b60 0x7f6254147a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:41.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.882+0000 7f625c55a700 1 -- 172.21.15.60:0/737901478 >> 172.21.15.60:0/737901478 conn(0x7f62540bd980 msgr2=0x7f62540b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:41.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.882+0000 7f625c55a700 1 -- 172.21.15.60:0/737901478 shutdown_connections 2023-07-12T02:02:41.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.882+0000 7f625c55a700 1 -- 172.21.15.60:0/737901478 wait complete. 2023-07-12T02:02:41.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.883+0000 7f625c55a700 1 Processor -- start 2023-07-12T02:02:41.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.883+0000 7f625c55a700 1 -- start start 2023-07-12T02:02:41.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.884+0000 7f625c55a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f625406b120 0x7f625413aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:41.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.884+0000 7f625c55a700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6254071b60 0x7f6254140150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:41.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.884+0000 7f625c55a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62540b6430 0x7f6254143450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:41.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.884+0000 7f625c55a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62541e3290 con 0x7f62540b6430 2023-07-12T02:02:41.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.884+0000 7f625c55a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6254142f70 con 0x7f625406b120 2023-07-12T02:02:41.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.884+0000 7f625c55a700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6254144ec0 con 0x7f6254071b60 2023-07-12T02:02:41.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.884+0000 7f625aaf7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62540b6430 0x7f6254143450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:41.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.884+0000 7f625aaf7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62540b6430 0x7f6254143450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40886/0 (socket says 172.21.15.60:40886) 2023-07-12T02:02:41.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.884+0000 7f625aaf7700 1 -- 172.21.15.60:0/1695583225 learned_addr learned my addr 172.21.15.60:0/1695583225 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:41.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.884+0000 7f625a2f6700 1 --2- 172.21.15.60:0/1695583225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f625406b120 0x7f625413aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:41.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.884+0000 7f6259af5700 1 --2- 172.21.15.60:0/1695583225 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6254071b60 0x7f6254140150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:41.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.884+0000 7f625aaf7700 1 -- 172.21.15.60:0/1695583225 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6254071b60 msgr2=0x7f6254140150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:41.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.884+0000 7f625aaf7700 1 --2- 172.21.15.60:0/1695583225 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6254071b60 0x7f6254140150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:41.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.884+0000 7f625aaf7700 1 -- 172.21.15.60:0/1695583225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f625406b120 msgr2=0x7f625413aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:41.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.884+0000 7f625aaf7700 1 --2- 172.21.15.60:0/1695583225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f625406b120 0x7f625413aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:41.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.884+0000 7f625aaf7700 1 -- 172.21.15.60:0/1695583225 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6244009550 con 0x7f62540b6430 2023-07-12T02:02:41.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.884+0000 7f625a2f6700 1 --2- 172.21.15.60:0/1695583225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f625406b120 0x7f625413aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:41.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.884+0000 7f625aaf7700 1 --2- 172.21.15.60:0/1695583225 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62540b6430 0x7f6254143450 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f624c00cbd0 tx=0x7f624c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:41.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.885+0000 7f624affd700 1 -- 172.21.15.60:0/1695583225 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c00abb0 con 0x7f62540b6430 2023-07-12T02:02:41.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.885+0000 7f624affd700 1 -- 172.21.15.60:0/1695583225 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f624c00ad10 con 0x7f62540b6430 2023-07-12T02:02:41.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.885+0000 7f625c55a700 1 -- 172.21.15.60:0/1695583225 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62500094a0 con 0x7f62540b6430 2023-07-12T02:02:41.894 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.885+0000 7f624affd700 1 -- 172.21.15.60:0/1695583225 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c007270 con 0x7f62540b6430 2023-07-12T02:02:41.894 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.885+0000 7f625c55a700 1 -- 172.21.15.60:0/1695583225 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6254144be0 con 0x7f62540b6430 2023-07-12T02:02:41.894 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.886+0000 7f625c55a700 1 -- 172.21.15.60:0/1695583225 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6254143170 con 0x7f62540b6430 2023-07-12T02:02:41.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.886+0000 7f624affd700 1 -- 172.21.15.60:0/1695583225 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f624c0073d0 con 0x7f62540b6430 2023-07-12T02:02:41.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.887+0000 7f624affd700 1 --2- 172.21.15.60:0/1695583225 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f623806ace0 0x7f623806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:41.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.887+0000 7f624affd700 1 -- 172.21.15.60:0/1695583225 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f624c089160 con 0x7f62540b6430 2023-07-12T02:02:41.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.887+0000 7f625a2f6700 1 --2- 172.21.15.60:0/1695583225 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f623806ace0 0x7f623806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:41.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.887+0000 7f625a2f6700 1 --2- 172.21.15.60:0/1695583225 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f623806ace0 0x7f623806d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6250000c00 tx=0x7f625001c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:41.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:41.891+0000 7f624affd700 1 -- 172.21.15.60:0/1695583225 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f6254143170 con 0x7f62540b6430 2023-07-12T02:02:42.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.089+0000 7f625c55a700 1 -- 172.21.15.60:0/1695583225 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6254143140 con 0x7f62540b6430 2023-07-12T02:02:42.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.091+0000 7f624affd700 1 -- 172.21.15.60:0/1695583225 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18173 (secure 0 0 0) 0x7f624c017090 con 0x7f62540b6430 2023-07-12T02:02:42.095 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:02:42.095 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":21,"fsid":"97e7c909-e567-472e-a5aa-72fde15171f2","created":"2023-07-12T02:01:53.987086+0000","modified":"2023-07-12T02:02:14.307912+0000","last_up_change":"2023-07-12T02:02:04.031780+0000","last_in_change":"2023-07-12T02:01:56.538621+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-12T02:02:05.375042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-12T02:02:05.857441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:02:10.574633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-12T02:02:11.699872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ed8b71c2-3895-4952-a118-16ede0b4a98c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6801","nonce":2818935979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6803","nonce":2818935979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6807","nonce":2818935979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6805","nonce":2818935979}]},"public_addr":"172.21.15.60:6801/2818935979","cluster_addr":"172.21.15.60:6803/2818935979","heartbeat_back_addr":"172.21.15.60:6807/2818935979","heartbeat_front_addr":"172.21.15.60:6805/2818935979","state":["exists","up"]},{"osd":1,"uuid":"7cf4d354-78e0-43ce-8c09-4a7d2a0b57a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6817","nonce":1678864191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6819","nonce":1678864191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6823","nonce":1678864191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6821","nonce":1678864191}]},"public_addr":"172.21.15.60:6817/1678864191","cluster_addr":"172.21.15.60:6819/1678864191","heartbeat_back_addr":"172.21.15.60:6823/1678864191","heartbeat_front_addr":"172.21.15.60:6821/1678864191","state":["exists","up"]},{"osd":2,"uuid":"02c958b8-9599-4470-92cb-8f7018ec0189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6809","nonce":1459480680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6811","nonce":1459480680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6815","nonce":1459480680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6813","nonce":1459480680}]},"public_addr":"172.21.15.60:6809/1459480680","cluster_addr":"172.21.15.60:6811/1459480680","heartbeat_back_addr":"172.21.15.60:6815/1459480680","heartbeat_front_addr":"172.21.15.60:6813/1459480680","state":["exists","up"]},{"osd":3,"uuid":"bc300432-a228-4257-be5c-e42dd5f2015f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6825","nonce":3295100060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6827","nonce":3295100060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6831","nonce":3295100060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6829","nonce":3295100060}]},"public_addr":"172.21.15.60:6825/3295100060","cluster_addr":"172.21.15.60:6827/3295100060","heartbeat_back_addr":"172.21.15.60:6831/3295100060","heartbeat_front_addr":"172.21.15.60:6829/3295100060","state":["exists","up"]},{"osd":4,"uuid":"ad9f7dc4-7126-466d-a656-2844880c6060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6809","nonce":4127109138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6811","nonce":4127109138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6815","nonce":4127109138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6813","nonce":4127109138}]},"public_addr":"172.21.15.79:6809/4127109138","cluster_addr":"172.21.15.79:6811/4127109138","heartbeat_back_addr":"172.21.15.79:6815/4127109138","heartbeat_front_addr":"172.21.15.79:6813/4127109138","state":["exists","up"]},{"osd":5,"uuid":"e88d16ca-0b01-4ab9-8aa8-c4aff7f210f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6801","nonce":421449406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6803","nonce":421449406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6807","nonce":421449406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6805","nonce":421449406}]},"public_addr":"172.21.15.79:6801/421449406","cluster_addr":"172.21.15.79:6803/421449406","heartbeat_back_addr":"172.21.15.79:6807/421449406","heartbeat_front_addr":"172.21.15.79:6805/421449406","state":["exists","up"]},{"osd":6,"uuid":"6898cb84-56d1-48a9-bd45-97e4668e2fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6825","nonce":4144355139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6827","nonce":4144355139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6831","nonce":4144355139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6829","nonce":4144355139}]},"public_addr":"172.21.15.79:6825/4144355139","cluster_addr":"172.21.15.79:6827/4144355139","heartbeat_back_addr":"172.21.15.79:6831/4144355139","heartbeat_front_addr":"172.21.15.79:6829/4144355139","state":["exists","up"]},{"osd":7,"uuid":"65c10882-371e-4762-b384-9c3a48f332ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6817","nonce":2845223299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6819","nonce":2845223299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6823","nonce":2845223299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6821","nonce":2845223299}]},"public_addr":"172.21.15.79:6817/2845223299","cluster_addr":"172.21.15.79:6819/2845223299","heartbeat_back_addr":"172.21.15.79:6823/2845223299","heartbeat_front_addr":"172.21.15.79:6821/2845223299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.634716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.758349+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.728366+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.777395+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707262+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.649705+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.693021+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:02:42.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.092+0000 7f625c55a700 1 -- 172.21.15.60:0/1695583225 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f623806ace0 msgr2=0x7f623806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:42.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.092+0000 7f625c55a700 1 --2- 172.21.15.60:0/1695583225 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f623806ace0 0x7f623806d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6250000c00 tx=0x7f625001c040 comp rx=0 tx=0).stop 2023-07-12T02:02:42.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.092+0000 7f625c55a700 1 -- 172.21.15.60:0/1695583225 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62540b6430 msgr2=0x7f6254143450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:42.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.093+0000 7f625c55a700 1 --2- 172.21.15.60:0/1695583225 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62540b6430 0x7f6254143450 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f624c00cbd0 tx=0x7f624c00cf90 comp rx=0 tx=0).stop 2023-07-12T02:02:42.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.093+0000 7f625c55a700 1 -- 172.21.15.60:0/1695583225 shutdown_connections 2023-07-12T02:02:42.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.093+0000 7f625c55a700 1 --2- 172.21.15.60:0/1695583225 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f623806ace0 0x7f623806d190 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:42.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.093+0000 7f625c55a700 1 --2- 172.21.15.60:0/1695583225 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62540b6430 0x7f6254143450 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:42.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.093+0000 7f625c55a700 1 --2- 172.21.15.60:0/1695583225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f625406b120 0x7f625413aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:42.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.093+0000 7f625c55a700 1 --2- 172.21.15.60:0/1695583225 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6254071b60 0x7f6254140150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:42.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.093+0000 7f625c55a700 1 -- 172.21.15.60:0/1695583225 >> 172.21.15.60:0/1695583225 conn(0x7f62540bd980 msgr2=0x7f62540b91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:42.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.093+0000 7f625c55a700 1 -- 172.21.15.60:0/1695583225 shutdown_connections 2023-07-12T02:02:42.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.093+0000 7f625c55a700 1 -- 172.21.15.60:0/1695583225 wait complete. 2023-07-12T02:02:42.109 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-12T02:02:05.375042+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-12T02:02:05.857441+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-12T02:02:10.574633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-12T02:02:11.699872+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-12T02:02:42.110 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-12T02:02:42.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.234+0000 7f30bac6a700 1 Processor -- start 2023-07-12T02:02:42.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.234+0000 7f30bac6a700 1 -- start start 2023-07-12T02:02:42.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.235+0000 7f30bac6a700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30b41449d0 0x7f30b414db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:42.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.235+0000 7f30bac6a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f30b40b8d90 0x7f30b406ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:42.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.235+0000 7f30bac6a700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30b40b8620 con 0x7f30b40bc810 2023-07-12T02:02:42.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.235+0000 7f30bac6a700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30b40b97a0 con 0x7f30b40b8d90 2023-07-12T02:02:42.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.235+0000 7f30bac6a700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30b4144da0 con 0x7f30b41449d0 2023-07-12T02:02:42.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.235+0000 7f30b9207700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f30b40b8d90 0x7f30b406ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:42.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.235+0000 7f30b9207700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f30b40b8d90 0x7f30b406ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40890/0 (socket says 172.21.15.60:40890) 2023-07-12T02:02:42.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.235+0000 7f30b9207700 1 -- 172.21.15.60:0/2971224990 learned_addr learned my addr 172.21.15.60:0/2971224990 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:42.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.235+0000 7f30b8a06700 1 --2- 172.21.15.60:0/2971224990 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30b41449d0 0x7f30b414db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:42.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.235+0000 7f30b9207700 1 -- 172.21.15.60:0/2971224990 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30b41449d0 msgr2=0x7f30b414db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:42.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.235+0000 7f30b9207700 1 --2- 172.21.15.60:0/2971224990 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30b41449d0 0x7f30b414db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:42.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.235+0000 7f30b9207700 1 -- 172.21.15.60:0/2971224990 >> v1:172.21.15.79:6789/0 conn(0x7f30b40bc810 legacy=0x7f30b40ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:42.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.235+0000 7f30b9207700 1 -- 172.21.15.60:0/2971224990 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b40b8900 con 0x7f30b40b8d90 2023-07-12T02:02:42.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.235+0000 7f30b9207700 1 --2- 172.21.15.60:0/2971224990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30b40b8d90 0x7f30b406ade0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f30ac009e50 tx=0x7f30ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e153d83909e564be server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:42.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.235+0000 7f30b37fe700 1 -- 172.21.15.60:0/2971224990 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ac00e070 con 0x7f30b40b8d90 2023-07-12T02:02:42.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.235+0000 7f30b37fe700 1 -- 172.21.15.60:0/2971224990 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30ac00b9c0 con 0x7f30b40b8d90 2023-07-12T02:02:42.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.235+0000 7f30b37fe700 1 -- 172.21.15.60:0/2971224990 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ac00bd70 con 0x7f30b40b8d90 2023-07-12T02:02:42.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.236+0000 7f30bac6a700 1 -- 172.21.15.60:0/2971224990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30b40b8d90 msgr2=0x7f30b406ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:42.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.236+0000 7f30bac6a700 1 --2- 172.21.15.60:0/2971224990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30b40b8d90 0x7f30b406ade0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f30ac009e50 tx=0x7f30ac00b330 comp rx=0 tx=0).stop 2023-07-12T02:02:42.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.236+0000 7f30bac6a700 1 -- 172.21.15.60:0/2971224990 shutdown_connections 2023-07-12T02:02:42.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.236+0000 7f30bac6a700 1 --2- 172.21.15.60:0/2971224990 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30b41449d0 0x7f30b414db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:42.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.236+0000 7f30bac6a700 1 --2- 172.21.15.60:0/2971224990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30b40b8d90 0x7f30b406ade0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:42.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.236+0000 7f30bac6a700 1 -- 172.21.15.60:0/2971224990 >> 172.21.15.60:0/2971224990 conn(0x7f30b40c0860 msgr2=0x7f30b40c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:42.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.236+0000 7f30bac6a700 1 -- 172.21.15.60:0/2971224990 shutdown_connections 2023-07-12T02:02:42.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.236+0000 7f30bac6a700 1 -- 172.21.15.60:0/2971224990 wait complete. 2023-07-12T02:02:42.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.237+0000 7f30bac6a700 1 Processor -- start 2023-07-12T02:02:42.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.238+0000 7f30bac6a700 1 -- start start 2023-07-12T02:02:42.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.238+0000 7f30bac6a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30b40b8d90 0x7f30b41478d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:42.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.238+0000 7f30bac6a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30b40bc810 0x7f30b41d4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:42.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.238+0000 7f30bac6a700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30b41449d0 0x7f30b41e04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:42.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.238+0000 7f30bac6a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30b4147e10 con 0x7f30b40b8d90 2023-07-12T02:02:42.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.238+0000 7f30bac6a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30b41e0060 con 0x7f30b40bc810 2023-07-12T02:02:42.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.238+0000 7f30bac6a700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30b41dfd30 con 0x7f30b41449d0 2023-07-12T02:02:42.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.239+0000 7f30b8a06700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30b40b8d90 0x7f30b41478d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:42.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.239+0000 7f30b8a06700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30b40b8d90 0x7f30b41478d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40904/0 (socket says 172.21.15.60:40904) 2023-07-12T02:02:42.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.239+0000 7f30b8a06700 1 -- 172.21.15.60:0/3374181789 learned_addr learned my addr 172.21.15.60:0/3374181789 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:42.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.239+0000 7f30b3fff700 1 --2- 172.21.15.60:0/3374181789 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30b40bc810 0x7f30b41d4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:42.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.239+0000 7f30b9207700 1 --2- 172.21.15.60:0/3374181789 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30b41449d0 0x7f30b41e04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:42.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.239+0000 7f30b8a06700 1 -- 172.21.15.60:0/3374181789 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30b41449d0 msgr2=0x7f30b41e04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:42.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.239+0000 7f30b8a06700 1 --2- 172.21.15.60:0/3374181789 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30b41449d0 0x7f30b41e04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:42.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.239+0000 7f30b8a06700 1 -- 172.21.15.60:0/3374181789 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30b40bc810 msgr2=0x7f30b41d4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:42.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.239+0000 7f30b8a06700 1 --2- 172.21.15.60:0/3374181789 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30b40bc810 0x7f30b41d4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:42.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.239+0000 7f30b8a06700 1 -- 172.21.15.60:0/3374181789 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30ac009b30 con 0x7f30b40b8d90 2023-07-12T02:02:42.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.239+0000 7f30b8a06700 1 --2- 172.21.15.60:0/3374181789 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30b40b8d90 0x7f30b41478d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f30a800d800 tx=0x7f30a800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:42.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.239+0000 7f30b17fa700 1 -- 172.21.15.60:0/3374181789 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a80126b0 con 0x7f30b40b8d90 2023-07-12T02:02:42.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.239+0000 7f30b17fa700 1 -- 172.21.15.60:0/3374181789 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30a8012810 con 0x7f30b40b8d90 2023-07-12T02:02:42.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.239+0000 7f30bac6a700 1 -- 172.21.15.60:0/3374181789 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30b40b4370 con 0x7f30b40b8d90 2023-07-12T02:02:42.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.239+0000 7f30b17fa700 1 -- 172.21.15.60:0/3374181789 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a8012bc0 con 0x7f30b40b8d90 2023-07-12T02:02:42.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.239+0000 7f30bac6a700 1 -- 172.21.15.60:0/3374181789 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30b41d3f70 con 0x7f30b40b8d90 2023-07-12T02:02:42.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.240+0000 7f30bac6a700 1 -- 172.21.15.60:0/3374181789 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30b41e0340 con 0x7f30b40b8d90 2023-07-12T02:02:42.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.241+0000 7f30b17fa700 1 -- 172.21.15.60:0/3374181789 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f30a8012d20 con 0x7f30b40b8d90 2023-07-12T02:02:42.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.241+0000 7f30b17fa700 1 --2- 172.21.15.60:0/3374181789 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f309806ace0 0x7f309806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:42.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.241+0000 7f30b17fa700 1 -- 172.21.15.60:0/3374181789 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f30a8089570 con 0x7f30b40b8d90 2023-07-12T02:02:42.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.241+0000 7f30b3fff700 1 --2- 172.21.15.60:0/3374181789 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f309806ace0 0x7f309806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:42.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.242+0000 7f30b3fff700 1 --2- 172.21.15.60:0/3374181789 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f309806ace0 0x7f309806d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f30b40b7450 tx=0x7f30a0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:42.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.246+0000 7f30b17fa700 1 -- 172.21.15.60:0/3374181789 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f30a80580b0 con 0x7f30b40b8d90 2023-07-12T02:02:42.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.440+0000 7f30bac6a700 1 -- 172.21.15.60:0/3374181789 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f30b4074360 con 0x7f30b40b8d90 2023-07-12T02:02:42.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.441+0000 7f30b17fa700 1 -- 172.21.15.60:0/3374181789 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f30a8057c40 con 0x7f30b40b8d90 2023-07-12T02:02:42.445 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2023-07-12T02:02:42.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.443+0000 7f30bac6a700 1 -- 172.21.15.60:0/3374181789 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f309806ace0 msgr2=0x7f309806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:42.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.443+0000 7f30bac6a700 1 --2- 172.21.15.60:0/3374181789 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f309806ace0 0x7f309806d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f30b40b7450 tx=0x7f30a0009040 comp rx=0 tx=0).stop 2023-07-12T02:02:42.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.443+0000 7f30bac6a700 1 -- 172.21.15.60:0/3374181789 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30b40b8d90 msgr2=0x7f30b41478d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:42.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.443+0000 7f30bac6a700 1 --2- 172.21.15.60:0/3374181789 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30b40b8d90 0x7f30b41478d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f30a800d800 tx=0x7f30a800db10 comp rx=0 tx=0).stop 2023-07-12T02:02:42.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.443+0000 7f30bac6a700 1 -- 172.21.15.60:0/3374181789 shutdown_connections 2023-07-12T02:02:42.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.443+0000 7f30bac6a700 1 --2- 172.21.15.60:0/3374181789 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f309806ace0 0x7f309806d190 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:42.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.443+0000 7f30bac6a700 1 --2- 172.21.15.60:0/3374181789 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30b40b8d90 0x7f30b41478d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:42.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.443+0000 7f30bac6a700 1 --2- 172.21.15.60:0/3374181789 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f30b41449d0 0x7f30b41e04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:42.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.443+0000 7f30bac6a700 1 --2- 172.21.15.60:0/3374181789 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30b40bc810 0x7f30b41d4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:42.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.443+0000 7f30bac6a700 1 -- 172.21.15.60:0/3374181789 >> 172.21.15.60:0/3374181789 conn(0x7f30b40c0860 msgr2=0x7f30b40be850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:42.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.443+0000 7f30bac6a700 1 -- 172.21.15.60:0/3374181789 shutdown_connections 2023-07-12T02:02:42.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.443+0000 7f30bac6a700 1 -- 172.21.15.60:0/3374181789 wait complete. 2023-07-12T02:02:42.459 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-12T02:02:42.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.583+0000 7fc7cf877700 1 Processor -- start 2023-07-12T02:02:42.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.584+0000 7fc7cf877700 1 -- start start 2023-07-12T02:02:42.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.584+0000 7fc7cf877700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc7c806b120 0x7fc7c8071350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:42.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.585+0000 7fc7cf877700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc7c80ba160 0x7fc7c81485e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:42.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.585+0000 7fc7cf877700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7c80b7180 con 0x7fc7c80b5fc0 2023-07-12T02:02:42.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.585+0000 7fc7cf877700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7c80b90b0 con 0x7fc7c806b120 2023-07-12T02:02:42.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.585+0000 7fc7cf877700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c8148b20 con 0x7fc7c80ba160 2023-07-12T02:02:42.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.585+0000 7fc7cde14700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc7c80b5fc0 0x7fc7c80b6440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48644/0 (socket says 172.21.15.60:48644) 2023-07-12T02:02:42.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.585+0000 7fc7cde14700 1 -- 172.21.15.60:0/2718115582 learned_addr learned my addr 172.21.15.60:0/2718115582 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:42.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.585+0000 7fc7cd613700 1 --2- 172.21.15.60:0/2718115582 >> v2:172.21.15.79:3300/0 conn(0x7fc7c806b120 0x7fc7c8071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:42.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.585+0000 7fc7cce12700 1 --2- 172.21.15.60:0/2718115582 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc7c80ba160 0x7fc7c81485e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:42.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.585+0000 7fc7bffff700 1 -- 172.21.15.60:0/2718115582 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 489504599 0 0) 0x7fc7c80b7180 con 0x7fc7c80b5fc0 2023-07-12T02:02:42.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.585+0000 7fc7bffff700 1 -- 172.21.15.60:0/2718115582 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7b40035b0 con 0x7fc7c80b5fc0 2023-07-12T02:02:42.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.585+0000 7fc7cd613700 1 -- 172.21.15.60:0/2718115582 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc7c80ba160 msgr2=0x7fc7c81485e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:42.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.585+0000 7fc7cd613700 1 --2- 172.21.15.60:0/2718115582 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc7c80ba160 0x7fc7c81485e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:42.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.585+0000 7fc7bffff700 1 -- 172.21.15.60:0/2718115582 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4071051989 0 0) 0x7fc7b40035b0 con 0x7fc7c80b5fc0 2023-07-12T02:02:42.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.585+0000 7fc7cd613700 1 -- 172.21.15.60:0/2718115582 >> v1:172.21.15.60:6789/0 conn(0x7fc7c80b5fc0 legacy=0x7fc7c80b6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:42.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.585+0000 7fc7cd613700 1 -- 172.21.15.60:0/2718115582 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c8071070 con 0x7fc7c806b120 2023-07-12T02:02:42.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.585+0000 7fc7cce12700 1 --2- 172.21.15.60:0/2718115582 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc7c80ba160 0x7fc7c81485e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:02:42.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.585+0000 7fc7cd613700 1 --2- 172.21.15.60:0/2718115582 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7c806b120 0x7fc7c8071350 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4009d90 tx=0x7fc7c400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78bc344b352b846a server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:42.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.586+0000 7fc7bffff700 1 -- 172.21.15.60:0/2718115582 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c400e070 con 0x7fc7c806b120 2023-07-12T02:02:42.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.586+0000 7fc7bffff700 1 -- 172.21.15.60:0/2718115582 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c4003a20 con 0x7fc7c806b120 2023-07-12T02:02:42.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.586+0000 7fc7bffff700 1 -- 172.21.15.60:0/2718115582 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c0001670 con 0x7fc7c806b120 2023-07-12T02:02:42.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.586+0000 7fc7cf877700 1 -- 172.21.15.60:0/2718115582 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7c806b120 msgr2=0x7fc7c8071350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:42.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.586+0000 7fc7cf877700 1 --2- 172.21.15.60:0/2718115582 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7c806b120 0x7fc7c8071350 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4009d90 tx=0x7fc7c400b330 comp rx=0 tx=0).stop 2023-07-12T02:02:42.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.586+0000 7fc7cf877700 1 -- 172.21.15.60:0/2718115582 shutdown_connections 2023-07-12T02:02:42.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.586+0000 7fc7cf877700 1 --2- 172.21.15.60:0/2718115582 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7c806b120 0x7fc7c8071350 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:42.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.586+0000 7fc7cf877700 1 --2- 172.21.15.60:0/2718115582 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc7c80ba160 0x7fc7c81485e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:42.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.586+0000 7fc7cf877700 1 -- 172.21.15.60:0/2718115582 >> 172.21.15.60:0/2718115582 conn(0x7fc7c80bd980 msgr2=0x7fc7c80b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:42.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.586+0000 7fc7cf877700 1 -- 172.21.15.60:0/2718115582 shutdown_connections 2023-07-12T02:02:42.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.586+0000 7fc7cf877700 1 -- 172.21.15.60:0/2718115582 wait complete. 2023-07-12T02:02:42.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.587+0000 7fc7cf877700 1 Processor -- start 2023-07-12T02:02:42.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.587+0000 7fc7cf877700 1 -- start start 2023-07-12T02:02:42.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.588+0000 7fc7cf877700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7c806b120 0x7fc7c81d1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:42.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.588+0000 7fc7cf877700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7c80b5fc0 0x7fc7c81435b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:42.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.588+0000 7fc7cf877700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc7c80ba160 0x7fc7c81e08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:42.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.588+0000 7fc7cf877700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c81d2150 con 0x7fc7c806b120 2023-07-12T02:02:42.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.588+0000 7fc7cf877700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c8143de0 con 0x7fc7c80b5fc0 2023-07-12T02:02:42.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.588+0000 7fc7cf877700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c81d2700 con 0x7fc7c80ba160 2023-07-12T02:02:42.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.588+0000 7fc7cd613700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7c806b120 0x7fc7c81d1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:42.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.588+0000 7fc7cd613700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7c806b120 0x7fc7c81d1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40912/0 (socket says 172.21.15.60:40912) 2023-07-12T02:02:42.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.588+0000 7fc7cd613700 1 -- 172.21.15.60:0/3268418040 learned_addr learned my addr 172.21.15.60:0/3268418040 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:42.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.588+0000 7fc7cce12700 1 --2- 172.21.15.60:0/3268418040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7c80b5fc0 0x7fc7c81435b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:42.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.588+0000 7fc7cde14700 1 --2- 172.21.15.60:0/3268418040 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc7c80ba160 0x7fc7c81e08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:42.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.588+0000 7fc7cd613700 1 -- 172.21.15.60:0/3268418040 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc7c80ba160 msgr2=0x7fc7c81e08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:42.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.588+0000 7fc7cd613700 1 --2- 172.21.15.60:0/3268418040 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc7c80ba160 0x7fc7c81e08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:42.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.588+0000 7fc7cd613700 1 -- 172.21.15.60:0/3268418040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7c80b5fc0 msgr2=0x7fc7c81435b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:42.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.588+0000 7fc7cd613700 1 --2- 172.21.15.60:0/3268418040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7c80b5fc0 0x7fc7c81435b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:42.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.588+0000 7fc7cd613700 1 -- 172.21.15.60:0/3268418040 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b80094a0 con 0x7fc7c806b120 2023-07-12T02:02:42.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.589+0000 7fc7cd613700 1 --2- 172.21.15.60:0/3268418040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7c806b120 0x7fc7c81d1c10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc7c400b680 tx=0x7fc7c4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:42.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.589+0000 7fc7bdffb700 1 -- 172.21.15.60:0/3268418040 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c40044c0 con 0x7fc7c806b120 2023-07-12T02:02:42.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.589+0000 7fc7bdffb700 1 -- 172.21.15.60:0/3268418040 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c4004620 con 0x7fc7c806b120 2023-07-12T02:02:42.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.589+0000 7fc7bdffb700 1 -- 172.21.15.60:0/3268418040 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c4012430 con 0x7fc7c806b120 2023-07-12T02:02:42.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.589+0000 7fc7cf877700 1 -- 172.21.15.60:0/3268418040 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7c4009a70 con 0x7fc7c806b120 2023-07-12T02:02:42.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.589+0000 7fc7cf877700 1 -- 172.21.15.60:0/3268418040 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7c8148160 con 0x7fc7c806b120 2023-07-12T02:02:42.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.590+0000 7fc7cf877700 1 -- 172.21.15.60:0/3268418040 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7c8074360 con 0x7fc7c806b120 2023-07-12T02:02:42.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.590+0000 7fc7bdffb700 1 -- 172.21.15.60:0/3268418040 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc7c4012590 con 0x7fc7c806b120 2023-07-12T02:02:42.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.591+0000 7fc7bdffb700 1 --2- 172.21.15.60:0/3268418040 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc7ac06ace0 0x7fc7ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:42.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.591+0000 7fc7bdffb700 1 -- 172.21.15.60:0/3268418040 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc7c408afc0 con 0x7fc7c806b120 2023-07-12T02:02:42.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.591+0000 7fc7cce12700 1 --2- 172.21.15.60:0/3268418040 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc7ac06ace0 0x7fc7ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:42.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.592+0000 7fc7cce12700 1 --2- 172.21.15.60:0/3268418040 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc7ac06ace0 0x7fc7ac06d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc7c80b3710 tx=0x7fc7b8009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:42.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.595+0000 7fc7bdffb700 1 -- 172.21.15.60:0/3268418040 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fc7c40bd380 con 0x7fc7c806b120 2023-07-12T02:02:42.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.791+0000 7fc7cf877700 1 -- 172.21.15.60:0/3268418040 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc7c8143af0 con 0x7fc7c806b120 2023-07-12T02:02:42.796 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.791+0000 7fc7bdffb700 1 -- 172.21.15.60:0/3268418040 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc7c4056100 con 0x7fc7c806b120 2023-07-12T02:02:42.796 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-07-12T02:02:42.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.794+0000 7fc7cf877700 1 -- 172.21.15.60:0/3268418040 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc7ac06ace0 msgr2=0x7fc7ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:42.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.794+0000 7fc7cf877700 1 --2- 172.21.15.60:0/3268418040 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc7ac06ace0 0x7fc7ac06d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc7c80b3710 tx=0x7fc7b8009210 comp rx=0 tx=0).stop 2023-07-12T02:02:42.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.794+0000 7fc7cf877700 1 -- 172.21.15.60:0/3268418040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7c806b120 msgr2=0x7fc7c81d1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:42.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.794+0000 7fc7cf877700 1 --2- 172.21.15.60:0/3268418040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7c806b120 0x7fc7c81d1c10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc7c400b680 tx=0x7fc7c4004ad0 comp rx=0 tx=0).stop 2023-07-12T02:02:42.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.794+0000 7fc7cf877700 1 -- 172.21.15.60:0/3268418040 shutdown_connections 2023-07-12T02:02:42.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.794+0000 7fc7cf877700 1 --2- 172.21.15.60:0/3268418040 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc7ac06ace0 0x7fc7ac06d190 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:42.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.794+0000 7fc7cf877700 1 --2- 172.21.15.60:0/3268418040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7c806b120 0x7fc7c81d1c10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:42.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.794+0000 7fc7cf877700 1 --2- 172.21.15.60:0/3268418040 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc7c80ba160 0x7fc7c81e08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:42.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.794+0000 7fc7cf877700 1 --2- 172.21.15.60:0/3268418040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7c80b5fc0 0x7fc7c81435b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:42.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.794+0000 7fc7cf877700 1 -- 172.21.15.60:0/3268418040 >> 172.21.15.60:0/3268418040 conn(0x7fc7c80bd980 msgr2=0x7fc7c81423f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:42.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.794+0000 7fc7cf877700 1 -- 172.21.15.60:0/3268418040 shutdown_connections 2023-07-12T02:02:42.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.794+0000 7fc7cf877700 1 -- 172.21.15.60:0/3268418040 wait complete. 2023-07-12T02:02:42.810 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-12T02:02:42.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.935+0000 7f84c9ffc700 1 Processor -- start 2023-07-12T02:02:42.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.935+0000 7f84c9ffc700 1 -- start start 2023-07-12T02:02:42.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.936+0000 7f84c9ffc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f84c406b120 0x7f84c4071350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:42.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.936+0000 7f84c9ffc700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84c40b5fc0 0x7f84c40b6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:42.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.936+0000 7f84c9ffc700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84c40b7180 con 0x7f84c40ba160 2023-07-12T02:02:42.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.936+0000 7f84c9ffc700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84c40b90b0 con 0x7f84c406b120 2023-07-12T02:02:42.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.936+0000 7f84c9ffc700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84c40b6980 con 0x7f84c40b5fc0 2023-07-12T02:02:42.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.936+0000 7f84c37fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f84c406b120 0x7f84c4071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:42.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.936+0000 7f84c2ffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f84c40ba160 0x7f84c41485e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48656/0 (socket says 172.21.15.60:48656) 2023-07-12T02:02:42.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.936+0000 7f84c2ffd700 1 -- 172.21.15.60:0/913513051 learned_addr learned my addr 172.21.15.60:0/913513051 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:42.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.936+0000 7f84c3fff700 1 --2- 172.21.15.60:0/913513051 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84c40b5fc0 0x7f84c40b6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:42.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.937+0000 7f84c37fe700 1 -- 172.21.15.60:0/913513051 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84c40b5fc0 msgr2=0x7f84c40b6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:42.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.937+0000 7f84c37fe700 1 --2- 172.21.15.60:0/913513051 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84c40b5fc0 0x7f84c40b6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:42.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.937+0000 7f84c37fe700 1 -- 172.21.15.60:0/913513051 >> v1:172.21.15.60:6789/0 conn(0x7f84c40ba160 legacy=0x7f84c41485e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:42.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.937+0000 7f84c37fe700 1 -- 172.21.15.60:0/913513051 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c4071070 con 0x7f84c406b120 2023-07-12T02:02:42.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.937+0000 7f84c37fe700 1 --2- 172.21.15.60:0/913513051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84c406b120 0x7f84c4071350 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f84b4009840 tx=0x7f84b4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a313dd92ce22b850 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:42.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.937+0000 7f84c27fc700 1 -- 172.21.15.60:0/913513051 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b4004230 con 0x7f84c406b120 2023-07-12T02:02:42.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.937+0000 7f84c27fc700 1 -- 172.21.15.60:0/913513051 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b4004390 con 0x7f84c406b120 2023-07-12T02:02:42.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.937+0000 7f84c27fc700 1 -- 172.21.15.60:0/913513051 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b40036a0 con 0x7f84c406b120 2023-07-12T02:02:42.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.938+0000 7f84c9ffc700 1 -- 172.21.15.60:0/913513051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84c406b120 msgr2=0x7f84c4071350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:42.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.938+0000 7f84c9ffc700 1 --2- 172.21.15.60:0/913513051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84c406b120 0x7f84c4071350 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f84b4009840 tx=0x7f84b4009b50 comp rx=0 tx=0).stop 2023-07-12T02:02:42.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.938+0000 7f84c9ffc700 1 -- 172.21.15.60:0/913513051 shutdown_connections 2023-07-12T02:02:42.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.938+0000 7f84c9ffc700 1 --2- 172.21.15.60:0/913513051 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84c40b5fc0 0x7f84c40b6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:42.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.938+0000 7f84c9ffc700 1 --2- 172.21.15.60:0/913513051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84c406b120 0x7f84c4071350 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:42.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.938+0000 7f84c9ffc700 1 -- 172.21.15.60:0/913513051 >> 172.21.15.60:0/913513051 conn(0x7f84c40bd980 msgr2=0x7f84c40b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:42.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.938+0000 7f84c9ffc700 1 -- 172.21.15.60:0/913513051 shutdown_connections 2023-07-12T02:02:42.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.938+0000 7f84c9ffc700 1 -- 172.21.15.60:0/913513051 wait complete. 2023-07-12T02:02:42.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.939+0000 7f84c9ffc700 1 Processor -- start 2023-07-12T02:02:42.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.939+0000 7f84c9ffc700 1 -- start start 2023-07-12T02:02:42.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.940+0000 7f84c9ffc700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84c406b120 0x7f84c406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:42.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.940+0000 7f84c9ffc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84c40b5fc0 0x7f84c41d1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:42.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.940+0000 7f84c9ffc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84c40ba160 0x7f84c41df920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:42.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.940+0000 7f84c9ffc700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c41d2150 con 0x7f84c40ba160 2023-07-12T02:02:42.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.940+0000 7f84c9ffc700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c41e08c0 con 0x7f84c40b5fc0 2023-07-12T02:02:42.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.940+0000 7f84c9ffc700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84c4070750 con 0x7f84c406b120 2023-07-12T02:02:42.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.940+0000 7f84c3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84c40ba160 0x7f84c41df920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:42.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.940+0000 7f84c3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84c40ba160 0x7f84c41df920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40928/0 (socket says 172.21.15.60:40928) 2023-07-12T02:02:42.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.940+0000 7f84c3fff700 1 -- 172.21.15.60:0/3070418268 learned_addr learned my addr 172.21.15.60:0/3070418268 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:42.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.940+0000 7f84c37fe700 1 --2- 172.21.15.60:0/3070418268 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84c406b120 0x7f84c406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:42.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.940+0000 7f84c2ffd700 1 --2- 172.21.15.60:0/3070418268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84c40b5fc0 0x7f84c41d1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:42.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.940+0000 7f84c3fff700 1 -- 172.21.15.60:0/3070418268 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84c406b120 msgr2=0x7f84c406f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:42.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.940+0000 7f84c3fff700 1 --2- 172.21.15.60:0/3070418268 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84c406b120 0x7f84c406f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:42.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.940+0000 7f84c3fff700 1 -- 172.21.15.60:0/3070418268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84c40b5fc0 msgr2=0x7f84c41d1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:42.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.940+0000 7f84c3fff700 1 --2- 172.21.15.60:0/3070418268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84c40b5fc0 0x7f84c41d1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:42.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.940+0000 7f84c3fff700 1 -- 172.21.15.60:0/3070418268 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b40094a0 con 0x7f84c40ba160 2023-07-12T02:02:42.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.940+0000 7f84c3fff700 1 --2- 172.21.15.60:0/3070418268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84c40ba160 0x7f84c41df920 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f84bc007e70 tx=0x7f84bc00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:42.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.940+0000 7f84bbfff700 1 -- 172.21.15.60:0/3070418268 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84bc00ed30 con 0x7f84c40ba160 2023-07-12T02:02:42.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.940+0000 7f84bbfff700 1 -- 172.21.15.60:0/3070418268 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84bc00eeb0 con 0x7f84c40ba160 2023-07-12T02:02:42.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.941+0000 7f84c9ffc700 1 -- 172.21.15.60:0/3070418268 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84c406f960 con 0x7f84c40ba160 2023-07-12T02:02:42.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.941+0000 7f84bbfff700 1 -- 172.21.15.60:0/3070418268 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84bc014640 con 0x7f84c40ba160 2023-07-12T02:02:42.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.941+0000 7f84c9ffc700 1 -- 172.21.15.60:0/3070418268 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84c4140150 con 0x7f84c40ba160 2023-07-12T02:02:42.950 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.941+0000 7f84c9ffc700 1 -- 172.21.15.60:0/3070418268 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84c4074360 con 0x7f84c40ba160 2023-07-12T02:02:42.950 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.942+0000 7f84bbfff700 1 -- 172.21.15.60:0/3070418268 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f84bc0147a0 con 0x7f84c40ba160 2023-07-12T02:02:42.950 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.942+0000 7f84bbfff700 1 --2- 172.21.15.60:0/3070418268 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f84a406ace0 0x7f84a406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:42.950 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.942+0000 7f84bbfff700 1 -- 172.21.15.60:0/3070418268 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f84bc089b40 con 0x7f84c40ba160 2023-07-12T02:02:42.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.943+0000 7f84c37fe700 1 --2- 172.21.15.60:0/3070418268 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f84a406ace0 0x7f84a406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:42.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.943+0000 7f84c37fe700 1 --2- 172.21.15.60:0/3070418268 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f84a406ace0 0x7f84a406d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f84b40090b0 tx=0x7f84b4008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:42.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:42.947+0000 7f84bbfff700 1 -- 172.21.15.60:0/3070418268 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f84bc058680 con 0x7f84c40ba160 2023-07-12T02:02:43.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.143+0000 7f84c9ffc700 1 -- 172.21.15.60:0/3070418268 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f84c40709c0 con 0x7f84c40ba160 2023-07-12T02:02:43.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.144+0000 7f84bbfff700 1 -- 172.21.15.60:0/3070418268 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f84bc058210 con 0x7f84c40ba160 2023-07-12T02:02:43.148 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-07-12T02:02:43.149 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.145+0000 7f84c9ffc700 1 -- 172.21.15.60:0/3070418268 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f84a406ace0 msgr2=0x7f84a406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:43.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.145+0000 7f84c9ffc700 1 --2- 172.21.15.60:0/3070418268 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f84a406ace0 0x7f84a406d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f84b40090b0 tx=0x7f84b4008030 comp rx=0 tx=0).stop 2023-07-12T02:02:43.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.145+0000 7f84c9ffc700 1 -- 172.21.15.60:0/3070418268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84c40ba160 msgr2=0x7f84c41df920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:43.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.145+0000 7f84c9ffc700 1 --2- 172.21.15.60:0/3070418268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84c40ba160 0x7f84c41df920 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f84bc007e70 tx=0x7f84bc00e3c0 comp rx=0 tx=0).stop 2023-07-12T02:02:43.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.145+0000 7f84c9ffc700 1 -- 172.21.15.60:0/3070418268 shutdown_connections 2023-07-12T02:02:43.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.145+0000 7f84c9ffc700 1 --2- 172.21.15.60:0/3070418268 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f84a406ace0 0x7f84a406d190 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:43.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.145+0000 7f84c9ffc700 1 --2- 172.21.15.60:0/3070418268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84c40ba160 0x7f84c41df920 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:43.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.145+0000 7f84c9ffc700 1 --2- 172.21.15.60:0/3070418268 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84c406b120 0x7f84c406f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:43.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.145+0000 7f84c9ffc700 1 --2- 172.21.15.60:0/3070418268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84c40b5fc0 0x7f84c41d1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:43.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.145+0000 7f84c9ffc700 1 -- 172.21.15.60:0/3070418268 >> 172.21.15.60:0/3070418268 conn(0x7f84c40bd980 msgr2=0x7f84c40bc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:43.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.146+0000 7f84c9ffc700 1 -- 172.21.15.60:0/3070418268 shutdown_connections 2023-07-12T02:02:43.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.146+0000 7f84c9ffc700 1 -- 172.21.15.60:0/3070418268 wait complete. 2023-07-12T02:02:43.162 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-12T02:02:43.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.286+0000 7f0ba9721700 1 Processor -- start 2023-07-12T02:02:43.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.286+0000 7f0ba9721700 1 -- start start 2023-07-12T02:02:43.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.287+0000 7f0ba9721700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0ba41449d0 0x7f0ba414db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:43.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.287+0000 7f0ba9721700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0ba40b8d90 0x7f0ba406ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:43.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.287+0000 7f0ba9721700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ba40b8620 con 0x7f0ba40bc810 2023-07-12T02:02:43.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.287+0000 7f0ba9721700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ba40b97a0 con 0x7f0ba40b8d90 2023-07-12T02:02:43.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.287+0000 7f0ba9721700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba4144da0 con 0x7f0ba41449d0 2023-07-12T02:02:43.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.287+0000 7f0ba37fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0ba40b8d90 0x7f0ba406ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:43.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.287+0000 7f0ba2ffd700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0ba41449d0 0x7f0ba414db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:43.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.287+0000 7f0ba27fc700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f0ba40bc810 0x7f0ba40ba530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.60:45062/0 (socket says 172.21.15.60:45062) 2023-07-12T02:02:43.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.287+0000 7f0ba37fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0ba40b8d90 0x7f0ba406ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.60:44962/0 (socket says 172.21.15.60:44962) 2023-07-12T02:02:43.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.287+0000 7f0ba2ffd700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0ba41449d0 0x7f0ba414db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.60:38832/0 (socket says 172.21.15.60:38832) 2023-07-12T02:02:43.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.287+0000 7f0ba27fc700 1 -- 172.21.15.60:0/41315515 learned_addr learned my addr 172.21.15.60:0/41315515 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:43.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.287+0000 7f0ba2ffd700 1 -- 172.21.15.60:0/41315515 >> v2:172.21.15.79:3300/0 conn(0x7f0ba40b8d90 msgr2=0x7f0ba406ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:43.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.287+0000 7f0ba2ffd700 1 --2- 172.21.15.60:0/41315515 >> v2:172.21.15.79:3300/0 conn(0x7f0ba40b8d90 0x7f0ba406ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:43.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.287+0000 7f0ba2ffd700 1 -- 172.21.15.60:0/41315515 >> v1:172.21.15.79:6789/0 conn(0x7f0ba40bc810 legacy=0x7f0ba40ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:43.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.287+0000 7f0ba2ffd700 1 -- 172.21.15.60:0/41315515 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba40b8900 con 0x7f0ba41449d0 2023-07-12T02:02:43.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.287+0000 7f0ba37fe700 1 --2- 172.21.15.60:0/41315515 >> v2:172.21.15.79:3300/0 conn(0x7f0ba40b8d90 0x7f0ba406ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:02:43.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.288+0000 7f0ba2ffd700 1 --2- 172.21.15.60:0/41315515 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0ba41449d0 0x7f0ba414db50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0b98009840 tx=0x7f0b98009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ff2dff4c4d0e74f server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:43.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.288+0000 7f0ba1ffb700 1 -- 172.21.15.60:0/41315515 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b98011830 con 0x7f0ba41449d0 2023-07-12T02:02:43.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.288+0000 7f0ba1ffb700 1 -- 172.21.15.60:0/41315515 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b98011990 con 0x7f0ba41449d0 2023-07-12T02:02:43.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.288+0000 7f0ba1ffb700 1 -- 172.21.15.60:0/41315515 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b98011d20 con 0x7f0ba41449d0 2023-07-12T02:02:43.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.288+0000 7f0ba9721700 1 -- 172.21.15.60:0/41315515 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0ba41449d0 msgr2=0x7f0ba414db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:43.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.288+0000 7f0ba9721700 1 --2- 172.21.15.60:0/41315515 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0ba41449d0 0x7f0ba414db50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0b98009840 tx=0x7f0b98009b50 comp rx=0 tx=0).stop 2023-07-12T02:02:43.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.288+0000 7f0ba9721700 1 -- 172.21.15.60:0/41315515 shutdown_connections 2023-07-12T02:02:43.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.288+0000 7f0ba9721700 1 --2- 172.21.15.60:0/41315515 >> v2:172.21.15.79:3300/0 conn(0x7f0ba40b8d90 0x7f0ba406ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:43.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.288+0000 7f0ba9721700 1 --2- 172.21.15.60:0/41315515 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0ba41449d0 0x7f0ba414db50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:43.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.288+0000 7f0ba9721700 1 -- 172.21.15.60:0/41315515 >> 172.21.15.60:0/41315515 conn(0x7f0ba40c0860 msgr2=0x7f0ba40c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:43.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.288+0000 7f0ba9721700 1 -- 172.21.15.60:0/41315515 shutdown_connections 2023-07-12T02:02:43.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.288+0000 7f0ba9721700 1 -- 172.21.15.60:0/41315515 wait complete. 2023-07-12T02:02:43.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.290+0000 7f0ba9721700 1 Processor -- start 2023-07-12T02:02:43.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.290+0000 7f0ba9721700 1 -- start start 2023-07-12T02:02:43.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.291+0000 7f0ba9721700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ba40b8d90 0x7f0ba40a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:43.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.291+0000 7f0ba9721700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0ba40bc810 0x7f0ba41422a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:43.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.291+0000 7f0ba9721700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ba41449d0 0x7f0ba40a3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:43.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.291+0000 7f0ba9721700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba41427e0 con 0x7f0ba41449d0 2023-07-12T02:02:43.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.291+0000 7f0ba9721700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba40a5e80 con 0x7f0ba40b8d90 2023-07-12T02:02:43.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.291+0000 7f0ba9721700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba40a4220 con 0x7f0ba40bc810 2023-07-12T02:02:43.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.291+0000 7f0ba37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ba41449d0 0x7f0ba40a3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:43.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.291+0000 7f0ba2ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ba40b8d90 0x7f0ba40a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:43.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.291+0000 7f0ba37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ba41449d0 0x7f0ba40a3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40940/0 (socket says 172.21.15.60:40940) 2023-07-12T02:02:43.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.291+0000 7f0ba37fe700 1 -- 172.21.15.60:0/955102411 learned_addr learned my addr 172.21.15.60:0/955102411 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:43.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.291+0000 7f0ba27fc700 1 --2- 172.21.15.60:0/955102411 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0ba40bc810 0x7f0ba41422a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:43.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.291+0000 7f0ba37fe700 1 -- 172.21.15.60:0/955102411 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0ba40bc810 msgr2=0x7f0ba41422a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:43.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.291+0000 7f0ba37fe700 1 --2- 172.21.15.60:0/955102411 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0ba40bc810 0x7f0ba41422a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:43.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.291+0000 7f0ba37fe700 1 -- 172.21.15.60:0/955102411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ba40b8d90 msgr2=0x7f0ba40a6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:43.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.291+0000 7f0ba37fe700 1 --2- 172.21.15.60:0/955102411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ba40b8d90 0x7f0ba40a6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:43.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.291+0000 7f0ba37fe700 1 -- 172.21.15.60:0/955102411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b9c009a70 con 0x7f0ba41449d0 2023-07-12T02:02:43.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.291+0000 7f0ba2ffd700 1 --2- 172.21.15.60:0/955102411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ba40b8d90 0x7f0ba40a6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:02:43.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.291+0000 7f0ba37fe700 1 --2- 172.21.15.60:0/955102411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ba41449d0 0x7f0ba40a3430 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c00efc0 tx=0x7f0b9c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:43.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.291+0000 7f0b8b7fe700 1 -- 172.21.15.60:0/955102411 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c00ca90 con 0x7f0ba41449d0 2023-07-12T02:02:43.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.292+0000 7f0b8b7fe700 1 -- 172.21.15.60:0/955102411 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b9c00f040 con 0x7f0ba41449d0 2023-07-12T02:02:43.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.292+0000 7f0ba9721700 1 -- 172.21.15.60:0/955102411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b980094a0 con 0x7f0ba41449d0 2023-07-12T02:02:43.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.292+0000 7f0b8b7fe700 1 -- 172.21.15.60:0/955102411 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c00ce10 con 0x7f0ba41449d0 2023-07-12T02:02:43.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.292+0000 7f0ba9721700 1 -- 172.21.15.60:0/955102411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ba40a1460 con 0x7f0ba41449d0 2023-07-12T02:02:43.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.293+0000 7f0ba9721700 1 -- 172.21.15.60:0/955102411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ba40a6840 con 0x7f0ba41449d0 2023-07-12T02:02:43.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.293+0000 7f0b8b7fe700 1 -- 172.21.15.60:0/955102411 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0b9c014480 con 0x7f0ba41449d0 2023-07-12T02:02:43.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.293+0000 7f0b8b7fe700 1 --2- 172.21.15.60:0/955102411 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f0b9006ace0 0x7f0b9006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:43.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.293+0000 7f0b8b7fe700 1 -- 172.21.15.60:0/955102411 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0b9c089a40 con 0x7f0ba41449d0 2023-07-12T02:02:43.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.293+0000 7f0ba2ffd700 1 --2- 172.21.15.60:0/955102411 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f0b9006ace0 0x7f0b9006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:43.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.294+0000 7f0ba2ffd700 1 --2- 172.21.15.60:0/955102411 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f0b9006ace0 0x7f0b9006d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0b98000c00 tx=0x7f0b9801c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:43.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.298+0000 7f0b8b7fe700 1 -- 172.21.15.60:0/955102411 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f0b9c08be60 con 0x7f0ba41449d0 2023-07-12T02:02:43.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.491+0000 7f0ba9721700 1 -- 172.21.15.60:0/955102411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0ba40bcf50 con 0x7f0ba41449d0 2023-07-12T02:02:43.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.492+0000 7f0b8b7fe700 1 -- 172.21.15.60:0/955102411 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0b9c058610 con 0x7f0ba41449d0 2023-07-12T02:02:43.496 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-07-12T02:02:43.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.494+0000 7f0ba9721700 1 -- 172.21.15.60:0/955102411 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f0b9006ace0 msgr2=0x7f0b9006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:43.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.494+0000 7f0ba9721700 1 --2- 172.21.15.60:0/955102411 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f0b9006ace0 0x7f0b9006d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0b98000c00 tx=0x7f0b9801c040 comp rx=0 tx=0).stop 2023-07-12T02:02:43.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.494+0000 7f0ba9721700 1 -- 172.21.15.60:0/955102411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ba41449d0 msgr2=0x7f0ba40a3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:43.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.494+0000 7f0ba9721700 1 --2- 172.21.15.60:0/955102411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ba41449d0 0x7f0ba40a3430 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c00efc0 tx=0x7f0b9c00c3a0 comp rx=0 tx=0).stop 2023-07-12T02:02:43.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.494+0000 7f0ba9721700 1 -- 172.21.15.60:0/955102411 shutdown_connections 2023-07-12T02:02:43.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.494+0000 7f0ba9721700 1 --2- 172.21.15.60:0/955102411 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f0b9006ace0 0x7f0b9006d190 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:43.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.494+0000 7f0ba9721700 1 --2- 172.21.15.60:0/955102411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ba41449d0 0x7f0ba40a3430 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:43.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.494+0000 7f0ba9721700 1 --2- 172.21.15.60:0/955102411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ba40b8d90 0x7f0ba40a6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:43.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.494+0000 7f0ba9721700 1 --2- 172.21.15.60:0/955102411 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0ba40bc810 0x7f0ba41422a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:43.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.494+0000 7f0ba9721700 1 -- 172.21.15.60:0/955102411 >> 172.21.15.60:0/955102411 conn(0x7f0ba40c0860 msgr2=0x7f0ba40c0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:43.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.494+0000 7f0ba9721700 1 -- 172.21.15.60:0/955102411 shutdown_connections 2023-07-12T02:02:43.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.494+0000 7f0ba9721700 1 -- 172.21.15.60:0/955102411 wait complete. 2023-07-12T02:02:43.510 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-12T02:02:43.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.632+0000 7f533378b700 1 Processor -- start 2023-07-12T02:02:43.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.633+0000 7f533378b700 1 -- start start 2023-07-12T02:02:43.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.633+0000 7f533378b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f532c1444c0 0x7f532c1448e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:43.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.633+0000 7f533378b700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532c070410 con 0x7f532c06b120 2023-07-12T02:02:43.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.633+0000 7f533378b700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532c06ef60 con 0x7f532c14aa40 2023-07-12T02:02:43.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.633+0000 7f533378b700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532c0b9590 con 0x7f532c1444c0 2023-07-12T02:02:43.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.633+0000 7f5331527700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f532c06b120 0x7f532c0b8cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48658/0 (socket says 172.21.15.60:48658) 2023-07-12T02:02:43.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.634+0000 7f5331527700 1 -- 172.21.15.60:0/2936779418 learned_addr learned my addr 172.21.15.60:0/2936779418 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:43.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.634+0000 7f5331d28700 1 --2- 172.21.15.60:0/2936779418 >> v2:172.21.15.79:3300/0 conn(0x7f532c1444c0 0x7f532c1448e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:43.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.634+0000 7f531ffff700 1 -- 172.21.15.60:0/2936779418 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 654855830 0 0) 0x7f532c070410 con 0x7f532c06b120 2023-07-12T02:02:43.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.634+0000 7f531ffff700 1 -- 172.21.15.60:0/2936779418 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53180035b0 con 0x7f532c06b120 2023-07-12T02:02:43.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.634+0000 7f531ffff700 1 -- 172.21.15.60:0/2936779418 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2730527966 0 0) 0x7f532c06ef60 con 0x7f532c14aa40 2023-07-12T02:02:43.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.634+0000 7f531ffff700 1 -- 172.21.15.60:0/2936779418 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f532c070410 con 0x7f532c14aa40 2023-07-12T02:02:43.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.634+0000 7f5331d28700 1 -- 172.21.15.60:0/2936779418 >> v1:172.21.15.79:6789/0 conn(0x7f532c14aa40 legacy=0x7f532c14aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:43.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.634+0000 7f531ffff700 1 -- 172.21.15.60:0/2936779418 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2242506365 0 0) 0x7f53180035b0 con 0x7f532c06b120 2023-07-12T02:02:43.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.634+0000 7f5331d28700 1 -- 172.21.15.60:0/2936779418 >> v1:172.21.15.60:6789/0 conn(0x7f532c06b120 legacy=0x7f532c0b8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:43.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.634+0000 7f5331d28700 1 -- 172.21.15.60:0/2936779418 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f532c06f240 con 0x7f532c1444c0 2023-07-12T02:02:43.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.634+0000 7f5331d28700 1 --2- 172.21.15.60:0/2936779418 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f532c1444c0 0x7f532c1448e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5324009d90 tx=0x7f532400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb2f6bdd3fedda7 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:43.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.634+0000 7f531ffff700 1 -- 172.21.15.60:0/2936779418 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532400e070 con 0x7f532c1444c0 2023-07-12T02:02:43.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.634+0000 7f531ffff700 1 -- 172.21.15.60:0/2936779418 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5324003a20 con 0x7f532c1444c0 2023-07-12T02:02:43.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.634+0000 7f531ffff700 1 -- 172.21.15.60:0/2936779418 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5328001670 con 0x7f532c1444c0 2023-07-12T02:02:43.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.635+0000 7f533378b700 1 -- 172.21.15.60:0/2936779418 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f532c1444c0 msgr2=0x7f532c1448e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:43.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.635+0000 7f533378b700 1 --2- 172.21.15.60:0/2936779418 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f532c1444c0 0x7f532c1448e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5324009d90 tx=0x7f532400b330 comp rx=0 tx=0).stop 2023-07-12T02:02:43.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.635+0000 7f533378b700 1 -- 172.21.15.60:0/2936779418 shutdown_connections 2023-07-12T02:02:43.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.635+0000 7f533378b700 1 --2- 172.21.15.60:0/2936779418 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f532c1444c0 0x7f532c1448e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:43.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.635+0000 7f533378b700 1 -- 172.21.15.60:0/2936779418 >> 172.21.15.60:0/2936779418 conn(0x7f532c0bd980 msgr2=0x7f532c0b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:43.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.635+0000 7f533378b700 1 -- 172.21.15.60:0/2936779418 shutdown_connections 2023-07-12T02:02:43.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.635+0000 7f533378b700 1 -- 172.21.15.60:0/2936779418 wait complete. 2023-07-12T02:02:43.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.636+0000 7f533378b700 1 Processor -- start 2023-07-12T02:02:43.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.636+0000 7f533378b700 1 -- start start 2023-07-12T02:02:43.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.637+0000 7f533378b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f532c06b120 0x7f532c146b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:43.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.637+0000 7f533378b700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f532c1444c0 0x7f532c1df8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:43.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.637+0000 7f533378b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f532c14aa40 0x7f532c1dfe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:43.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.637+0000 7f533378b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f532c147070 con 0x7f532c14aa40 2023-07-12T02:02:43.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.637+0000 7f533378b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f532c148000 con 0x7f532c06b120 2023-07-12T02:02:43.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.637+0000 7f533378b700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f532c145780 con 0x7f532c1444c0 2023-07-12T02:02:43.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.637+0000 7f5331d28700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f532c14aa40 0x7f532c1dfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:43.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.637+0000 7f5331d28700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f532c14aa40 0x7f532c1dfe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40944/0 (socket says 172.21.15.60:40944) 2023-07-12T02:02:43.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.637+0000 7f5331d28700 1 -- 172.21.15.60:0/4064117862 learned_addr learned my addr 172.21.15.60:0/4064117862 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:43.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.637+0000 7f5331527700 1 --2- 172.21.15.60:0/4064117862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f532c06b120 0x7f532c146b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:43.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.637+0000 7f5330d26700 1 --2- 172.21.15.60:0/4064117862 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f532c1444c0 0x7f532c1df8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:43.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.637+0000 7f5331d28700 1 -- 172.21.15.60:0/4064117862 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f532c1444c0 msgr2=0x7f532c1df8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:43.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.637+0000 7f5331d28700 1 --2- 172.21.15.60:0/4064117862 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f532c1444c0 0x7f532c1df8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:43.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.637+0000 7f5331d28700 1 -- 172.21.15.60:0/4064117862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f532c06b120 msgr2=0x7f532c146b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:43.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.637+0000 7f5331d28700 1 --2- 172.21.15.60:0/4064117862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f532c06b120 0x7f532c146b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:43.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.637+0000 7f5331d28700 1 -- 172.21.15.60:0/4064117862 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5324009a70 con 0x7f532c14aa40 2023-07-12T02:02:43.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.637+0000 7f5331527700 1 --2- 172.21.15.60:0/4064117862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f532c06b120 0x7f532c146b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:43.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.637+0000 7f5331d28700 1 --2- 172.21.15.60:0/4064117862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f532c14aa40 0x7f532c1dfe20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f532400b370 tx=0x7f5324004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:43.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.637+0000 7f531dffb700 1 -- 172.21.15.60:0/4064117862 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53240045c0 con 0x7f532c14aa40 2023-07-12T02:02:43.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.637+0000 7f531dffb700 1 -- 172.21.15.60:0/4064117862 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5324004720 con 0x7f532c14aa40 2023-07-12T02:02:43.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.637+0000 7f533378b700 1 -- 172.21.15.60:0/4064117862 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f532c145a60 con 0x7f532c14aa40 2023-07-12T02:02:43.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.637+0000 7f531dffb700 1 -- 172.21.15.60:0/4064117862 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532401d470 con 0x7f532c14aa40 2023-07-12T02:02:43.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.638+0000 7f533378b700 1 -- 172.21.15.60:0/4064117862 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f532c1453e0 con 0x7f532c14aa40 2023-07-12T02:02:43.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.638+0000 7f533378b700 1 -- 172.21.15.60:0/4064117862 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f532c074360 con 0x7f532c14aa40 2023-07-12T02:02:43.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.639+0000 7f531dffb700 1 -- 172.21.15.60:0/4064117862 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f532401d5d0 con 0x7f532c14aa40 2023-07-12T02:02:43.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.639+0000 7f531dffb700 1 --2- 172.21.15.60:0/4064117862 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f531006ace0 0x7f531006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:43.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.640+0000 7f531dffb700 1 -- 172.21.15.60:0/4064117862 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f532408ac50 con 0x7f532c14aa40 2023-07-12T02:02:43.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.640+0000 7f5331527700 1 --2- 172.21.15.60:0/4064117862 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f531006ace0 0x7f531006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:43.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.640+0000 7f5331527700 1 --2- 172.21.15.60:0/4064117862 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f531006ace0 0x7f531006d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f53280017a0 tx=0x7f5328001550 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:43.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.644+0000 7f531dffb700 1 -- 172.21.15.60:0/4064117862 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f5324059820 con 0x7f532c14aa40 2023-07-12T02:02:43.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.855+0000 7f533378b700 1 -- 172.21.15.60:0/4064117862 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f532c06e2e0 con 0x7f532c14aa40 2023-07-12T02:02:43.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.856+0000 7f531dffb700 1 -- 172.21.15.60:0/4064117862 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f53240593b0 con 0x7f532c14aa40 2023-07-12T02:02:43.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.858+0000 7f533378b700 1 -- 172.21.15.60:0/4064117862 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f531006ace0 msgr2=0x7f531006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:43.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.858+0000 7f533378b700 1 --2- 172.21.15.60:0/4064117862 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f531006ace0 0x7f531006d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f53280017a0 tx=0x7f5328001550 comp rx=0 tx=0).stop 2023-07-12T02:02:43.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.858+0000 7f533378b700 1 -- 172.21.15.60:0/4064117862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f532c14aa40 msgr2=0x7f532c1dfe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:43.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.858+0000 7f533378b700 1 --2- 172.21.15.60:0/4064117862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f532c14aa40 0x7f532c1dfe20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f532400b370 tx=0x7f5324004ad0 comp rx=0 tx=0).stop 2023-07-12T02:02:43.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.858+0000 7f533378b700 1 -- 172.21.15.60:0/4064117862 shutdown_connections 2023-07-12T02:02:43.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.858+0000 7f533378b700 1 --2- 172.21.15.60:0/4064117862 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f531006ace0 0x7f531006d190 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:43.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.858+0000 7f533378b700 1 --2- 172.21.15.60:0/4064117862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f532c14aa40 0x7f532c1dfe20 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:43.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.858+0000 7f533378b700 1 --2- 172.21.15.60:0/4064117862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f532c06b120 0x7f532c146b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:43.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.858+0000 7f533378b700 1 --2- 172.21.15.60:0/4064117862 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f532c1444c0 0x7f532c1df8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:43.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.858+0000 7f533378b700 1 -- 172.21.15.60:0/4064117862 >> 172.21.15.60:0/4064117862 conn(0x7f532c0bd980 msgr2=0x7f532c14aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:43.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.858+0000 7f533378b700 1 -- 172.21.15.60:0/4064117862 shutdown_connections 2023-07-12T02:02:43.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:43.858+0000 7f533378b700 1 -- 172.21.15.60:0/4064117862 wait complete. 2023-07-12T02:02:43.864 INFO:teuthology.orchestra.run.smithi060.stderr:listed 0 entries 2023-07-12T02:02:43.874 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-12T02:02:43.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:02:43.874 DEBUG:teuthology.orchestra.run.smithi174:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-07-12T02:02:43.967 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi174.front.sepia.ceph.com 2023-07-12T02:02:43.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:02:43.968 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-12T02:02:44.029 INFO:tasks.cephfs.cephfs_test_case:[] 2023-07-12T02:02:44.029 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-12T02:02:44.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.152+0000 7f32b1731700 1 Processor -- start 2023-07-12T02:02:44.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.152+0000 7f32b1731700 1 -- start start 2023-07-12T02:02:44.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.153+0000 7f32b1731700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f32ac0b66d0 0x7f32ac071350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:44.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.153+0000 7f32b1731700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32ac0b7180 con 0x7f32ac06b120 2023-07-12T02:02:44.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.153+0000 7f32b1731700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32ac071070 con 0x7f32ac0ba160 2023-07-12T02:02:44.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.153+0000 7f32b1731700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32ac0b90b0 con 0x7f32ac0b66d0 2023-07-12T02:02:44.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.153+0000 7f32ab7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f32ac0b66d0 0x7f32ac071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:44.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.153+0000 7f32aaffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f32ac06b120 0x7f32ac1485e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48666/0 (socket says 172.21.15.60:48666) 2023-07-12T02:02:44.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.153+0000 7f32aaffd700 1 -- 172.21.15.60:0/373287934 learned_addr learned my addr 172.21.15.60:0/373287934 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:44.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.153+0000 7f32a9ffb700 1 -- 172.21.15.60:0/373287934 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1580091695 0 0) 0x7f32ac0b7180 con 0x7f32ac06b120 2023-07-12T02:02:44.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.153+0000 7f32a9ffb700 1 -- 172.21.15.60:0/373287934 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32940035b0 con 0x7f32ac06b120 2023-07-12T02:02:44.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.153+0000 7f32ab7fe700 1 -- 172.21.15.60:0/373287934 >> v1:172.21.15.79:6789/0 conn(0x7f32ac0ba160 legacy=0x7f32ac0b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:44.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.153+0000 7f32ab7fe700 1 -- 172.21.15.60:0/373287934 >> v1:172.21.15.60:6789/0 conn(0x7f32ac06b120 legacy=0x7f32ac1485e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:44.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.153+0000 7f32ab7fe700 1 -- 172.21.15.60:0/373287934 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32ac0b6e10 con 0x7f32ac0b66d0 2023-07-12T02:02:44.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.154+0000 7f32ab7fe700 1 --2- 172.21.15.60:0/373287934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32ac0b66d0 0x7f32ac071350 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f32a4009d90 tx=0x7f32a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed4772082604d3d6 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:44.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.154+0000 7f32a9ffb700 1 -- 172.21.15.60:0/373287934 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a400e070 con 0x7f32ac0b66d0 2023-07-12T02:02:44.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.154+0000 7f32a9ffb700 1 -- 172.21.15.60:0/373287934 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a400bb20 con 0x7f32ac0b66d0 2023-07-12T02:02:44.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.154+0000 7f32a9ffb700 1 -- 172.21.15.60:0/373287934 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a4012430 con 0x7f32ac0b66d0 2023-07-12T02:02:44.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.154+0000 7f32b1731700 1 -- 172.21.15.60:0/373287934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32ac0b66d0 msgr2=0x7f32ac071350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:44.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.154+0000 7f32b1731700 1 --2- 172.21.15.60:0/373287934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32ac0b66d0 0x7f32ac071350 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f32a4009d90 tx=0x7f32a400b330 comp rx=0 tx=0).stop 2023-07-12T02:02:44.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.154+0000 7f32b1731700 1 -- 172.21.15.60:0/373287934 shutdown_connections 2023-07-12T02:02:44.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.154+0000 7f32b1731700 1 --2- 172.21.15.60:0/373287934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32ac0b66d0 0x7f32ac071350 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:44.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.154+0000 7f32b1731700 1 -- 172.21.15.60:0/373287934 >> 172.21.15.60:0/373287934 conn(0x7f32ac0bd980 msgr2=0x7f32ac0b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:44.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.154+0000 7f32b1731700 1 -- 172.21.15.60:0/373287934 shutdown_connections 2023-07-12T02:02:44.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.154+0000 7f32b1731700 1 -- 172.21.15.60:0/373287934 wait complete. 2023-07-12T02:02:44.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.156+0000 7f32b1731700 1 Processor -- start 2023-07-12T02:02:44.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.156+0000 7f32b1731700 1 -- start start 2023-07-12T02:02:44.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.156+0000 7f32b1731700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32ac06b120 0x7f32ac140050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:44.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.156+0000 7f32b1731700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f32ac0b66d0 0x7f32ac143150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:44.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.156+0000 7f32b1731700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32ac0ba160 0x7f32ac144b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:44.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.156+0000 7f32b1731700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac143690 con 0x7f32ac06b120 2023-07-12T02:02:44.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.156+0000 7f32b1731700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac070ad0 con 0x7f32ac0ba160 2023-07-12T02:02:44.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.156+0000 7f32b1731700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac145fc0 con 0x7f32ac0b66d0 2023-07-12T02:02:44.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.156+0000 7f32aaffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32ac06b120 0x7f32ac140050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:44.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.156+0000 7f32aaffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32ac06b120 0x7f32ac140050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40962/0 (socket says 172.21.15.60:40962) 2023-07-12T02:02:44.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.156+0000 7f32aaffd700 1 -- 172.21.15.60:0/1854484608 learned_addr learned my addr 172.21.15.60:0/1854484608 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:44.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.156+0000 7f32ab7fe700 1 --2- 172.21.15.60:0/1854484608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32ac0ba160 0x7f32ac144b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:44.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.157+0000 7f32aa7fc700 1 --2- 172.21.15.60:0/1854484608 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f32ac0b66d0 0x7f32ac143150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:44.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.157+0000 7f32aaffd700 1 -- 172.21.15.60:0/1854484608 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f32ac0b66d0 msgr2=0x7f32ac143150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:44.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.157+0000 7f32aaffd700 1 --2- 172.21.15.60:0/1854484608 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f32ac0b66d0 0x7f32ac143150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:44.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.157+0000 7f32aaffd700 1 -- 172.21.15.60:0/1854484608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32ac0ba160 msgr2=0x7f32ac144b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:44.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.157+0000 7f32aaffd700 1 --2- 172.21.15.60:0/1854484608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32ac0ba160 0x7f32ac144b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:44.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.157+0000 7f32aaffd700 1 -- 172.21.15.60:0/1854484608 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a4009a70 con 0x7f32ac06b120 2023-07-12T02:02:44.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.157+0000 7f32aa7fc700 1 --2- 172.21.15.60:0/1854484608 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f32ac0b66d0 0x7f32ac143150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:44.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.157+0000 7f32aaffd700 1 --2- 172.21.15.60:0/1854484608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32ac06b120 0x7f32ac140050 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f32a000c700 tx=0x7f32a000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:44.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.157+0000 7f32937fe700 1 -- 172.21.15.60:0/1854484608 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a0005d70 con 0x7f32ac06b120 2023-07-12T02:02:44.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.157+0000 7f32937fe700 1 -- 172.21.15.60:0/1854484608 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a00070d0 con 0x7f32ac06b120 2023-07-12T02:02:44.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.157+0000 7f32b1731700 1 -- 172.21.15.60:0/1854484608 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32ac145090 con 0x7f32ac06b120 2023-07-12T02:02:44.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.157+0000 7f32937fe700 1 -- 172.21.15.60:0/1854484608 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a0007460 con 0x7f32ac06b120 2023-07-12T02:02:44.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.157+0000 7f32b1731700 1 -- 172.21.15.60:0/1854484608 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32ac145a00 con 0x7f32ac06b120 2023-07-12T02:02:44.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.158+0000 7f32b1731700 1 -- 172.21.15.60:0/1854484608 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32ac074360 con 0x7f32ac06b120 2023-07-12T02:02:44.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.159+0000 7f32937fe700 1 -- 172.21.15.60:0/1854484608 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f32a00075c0 con 0x7f32ac06b120 2023-07-12T02:02:44.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.159+0000 7f32937fe700 1 --2- 172.21.15.60:0/1854484608 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f329806ace0 0x7f329806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:44.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.159+0000 7f32937fe700 1 -- 172.21.15.60:0/1854484608 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f32a0088960 con 0x7f32ac06b120 2023-07-12T02:02:44.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.159+0000 7f32aa7fc700 1 --2- 172.21.15.60:0/1854484608 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f329806ace0 0x7f329806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:44.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.160+0000 7f32aa7fc700 1 --2- 172.21.15.60:0/1854484608 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f329806ace0 0x7f329806d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f32ac1457c0 tx=0x7f329c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:44.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.163+0000 7f32937fe700 1 -- 172.21.15.60:0/1854484608 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f32a0053aa0 con 0x7f32ac06b120 2023-07-12T02:02:44.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.409+0000 7f32b1731700 1 -- 172.21.15.60:0/1854484608 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f32ac0b70f0 con 0x7f32ac06b120 2023-07-12T02:02:44.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.409+0000 7f32937fe700 1 -- 172.21.15.60:0/1854484608 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3906 (secure 0 0 0) 0x7f32a00570c0 con 0x7f32ac06b120 2023-07-12T02:02:44.414 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:02:44.414 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2687011977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2687011977},{"type":"v1","addr":"172.21.15.60:6835","nonce":2687011977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/1153134400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1153134400},{"type":"v1","addr":"172.21.15.79:6835","nonce":1153134400}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-12T02:02:12.733570+0000","modified":"2023-07-12T02:02:15.754293+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6833/825430907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":825430907},{"type":"v1","addr":"172.21.15.60:6833","nonce":825430907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-12T02:02:44.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.411+0000 7f32b1731700 1 -- 172.21.15.60:0/1854484608 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f329806ace0 msgr2=0x7f329806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:44.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.411+0000 7f32b1731700 1 --2- 172.21.15.60:0/1854484608 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f329806ace0 0x7f329806d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f32ac1457c0 tx=0x7f329c009040 comp rx=0 tx=0).stop 2023-07-12T02:02:44.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.411+0000 7f32b1731700 1 -- 172.21.15.60:0/1854484608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32ac06b120 msgr2=0x7f32ac140050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:44.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.411+0000 7f32b1731700 1 --2- 172.21.15.60:0/1854484608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32ac06b120 0x7f32ac140050 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f32a000c700 tx=0x7f32a000ca10 comp rx=0 tx=0).stop 2023-07-12T02:02:44.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.411+0000 7f32b1731700 1 -- 172.21.15.60:0/1854484608 shutdown_connections 2023-07-12T02:02:44.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.411+0000 7f32b1731700 1 --2- 172.21.15.60:0/1854484608 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f329806ace0 0x7f329806d190 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:44.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.411+0000 7f32b1731700 1 --2- 172.21.15.60:0/1854484608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32ac06b120 0x7f32ac140050 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:44.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.411+0000 7f32b1731700 1 --2- 172.21.15.60:0/1854484608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32ac0ba160 0x7f32ac144b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:44.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.411+0000 7f32b1731700 1 --2- 172.21.15.60:0/1854484608 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f32ac0b66d0 0x7f32ac143150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:44.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.411+0000 7f32b1731700 1 -- 172.21.15.60:0/1854484608 >> 172.21.15.60:0/1854484608 conn(0x7f32ac0bd980 msgr2=0x7f32ac1d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:44.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.411+0000 7f32b1731700 1 -- 172.21.15.60:0/1854484608 shutdown_connections 2023-07-12T02:02:44.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.411+0000 7f32b1731700 1 -- 172.21.15.60:0/1854484608 wait complete. 2023-07-12T02:02:44.417 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 7 2023-07-12T02:02:44.427 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:02:44.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.549+0000 7ffb7e953700 1 Processor -- start 2023-07-12T02:02:44.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.549+0000 7ffb7e953700 1 -- start start 2023-07-12T02:02:44.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.550+0000 7ffb7e953700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ffb78147c00 0x7ffb780b6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:44.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.550+0000 7ffb7e953700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ffb78071b60 0x7ffb780b6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:44.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.550+0000 7ffb7e953700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb780b3bd0 con 0x7ffb7806b120 2023-07-12T02:02:44.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.550+0000 7ffb7e953700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb78070800 con 0x7ffb78147c00 2023-07-12T02:02:44.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.550+0000 7ffb7e953700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb78141c90 con 0x7ffb78071b60 2023-07-12T02:02:44.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.550+0000 7ffb777fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ffb78147c00 0x7ffb780b6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:44.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.550+0000 7ffb777fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ffb78147c00 0x7ffb780b6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40966/0 (socket says 172.21.15.60:40966) 2023-07-12T02:02:44.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.550+0000 7ffb777fe700 1 -- 172.21.15.60:0/2591902844 learned_addr learned my addr 172.21.15.60:0/2591902844 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:44.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.550+0000 7ffb7cef0700 1 --2- 172.21.15.60:0/2591902844 >> v2:172.21.15.79:3300/0 conn(0x7ffb78071b60 0x7ffb780b6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:44.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.550+0000 7ffb777fe700 1 -- 172.21.15.60:0/2591902844 >> v2:172.21.15.79:3300/0 conn(0x7ffb78071b60 msgr2=0x7ffb780b6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:44.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.550+0000 7ffb777fe700 1 --2- 172.21.15.60:0/2591902844 >> v2:172.21.15.79:3300/0 conn(0x7ffb78071b60 0x7ffb780b6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:44.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.550+0000 7ffb777fe700 1 -- 172.21.15.60:0/2591902844 >> v1:172.21.15.79:6789/0 conn(0x7ffb7806b120 legacy=0x7ffb781474f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:44.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.550+0000 7ffb777fe700 1 -- 172.21.15.60:0/2591902844 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb780714d0 con 0x7ffb78147c00 2023-07-12T02:02:44.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.551+0000 7ffb7cef0700 1 --2- 172.21.15.60:0/2591902844 >> v2:172.21.15.79:3300/0 conn(0x7ffb78071b60 0x7ffb780b6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:44.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.551+0000 7ffb777fe700 1 --2- 172.21.15.60:0/2591902844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb78147c00 0x7ffb780b6430 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ffb780662c0 tx=0x7ffb6c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5068fa45766b41ab server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:44.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.551+0000 7ffb76ffd700 1 -- 172.21.15.60:0/2591902844 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c00b860 con 0x7ffb78147c00 2023-07-12T02:02:44.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.551+0000 7ffb76ffd700 1 -- 172.21.15.60:0/2591902844 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6c00b9c0 con 0x7ffb78147c00 2023-07-12T02:02:44.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.551+0000 7ffb76ffd700 1 -- 172.21.15.60:0/2591902844 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c00bd50 con 0x7ffb78147c00 2023-07-12T02:02:44.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.551+0000 7ffb7e953700 1 -- 172.21.15.60:0/2591902844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb78147c00 msgr2=0x7ffb780b6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:44.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.551+0000 7ffb7e953700 1 --2- 172.21.15.60:0/2591902844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb78147c00 0x7ffb780b6430 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ffb780662c0 tx=0x7ffb6c009c00 comp rx=0 tx=0).stop 2023-07-12T02:02:44.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.551+0000 7ffb7e953700 1 -- 172.21.15.60:0/2591902844 shutdown_connections 2023-07-12T02:02:44.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.551+0000 7ffb7e953700 1 --2- 172.21.15.60:0/2591902844 >> v2:172.21.15.79:3300/0 conn(0x7ffb78071b60 0x7ffb780b6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:44.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.551+0000 7ffb7e953700 1 --2- 172.21.15.60:0/2591902844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb78147c00 0x7ffb780b6430 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:44.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.551+0000 7ffb7e953700 1 -- 172.21.15.60:0/2591902844 >> 172.21.15.60:0/2591902844 conn(0x7ffb780bd980 msgr2=0x7ffb780b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:44.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.551+0000 7ffb7e953700 1 -- 172.21.15.60:0/2591902844 shutdown_connections 2023-07-12T02:02:44.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.551+0000 7ffb7e953700 1 -- 172.21.15.60:0/2591902844 wait complete. 2023-07-12T02:02:44.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.552+0000 7ffb7e953700 1 Processor -- start 2023-07-12T02:02:44.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.553+0000 7ffb7e953700 1 -- start start 2023-07-12T02:02:44.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.553+0000 7ffb7e953700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffb7806b120 0x7ffb78141fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:44.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.553+0000 7ffb7e953700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb78071b60 0x7ffb780b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:44.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.553+0000 7ffb7e953700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb78147c00 0x7ffb780b52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:44.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.553+0000 7ffb7e953700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb781cff80 con 0x7ffb78147c00 2023-07-12T02:02:44.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.553+0000 7ffb7e953700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb781ce800 con 0x7ffb78071b60 2023-07-12T02:02:44.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.553+0000 7ffb7e953700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb781d0220 con 0x7ffb7806b120 2023-07-12T02:02:44.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.553+0000 7ffb7cef0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb78147c00 0x7ffb780b52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:44.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.553+0000 7ffb7cef0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb78147c00 0x7ffb780b52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40974/0 (socket says 172.21.15.60:40974) 2023-07-12T02:02:44.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.553+0000 7ffb7cef0700 1 -- 172.21.15.60:0/4209859169 learned_addr learned my addr 172.21.15.60:0/4209859169 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:44.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.553+0000 7ffb777fe700 1 --2- 172.21.15.60:0/4209859169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb78071b60 0x7ffb780b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:44.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.553+0000 7ffb77fff700 1 --2- 172.21.15.60:0/4209859169 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffb7806b120 0x7ffb78141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:44.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.554+0000 7ffb7cef0700 1 -- 172.21.15.60:0/4209859169 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffb7806b120 msgr2=0x7ffb78141fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:44.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.554+0000 7ffb7cef0700 1 --2- 172.21.15.60:0/4209859169 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffb7806b120 0x7ffb78141fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:44.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.554+0000 7ffb7cef0700 1 -- 172.21.15.60:0/4209859169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb78071b60 msgr2=0x7ffb780b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:44.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.554+0000 7ffb7cef0700 1 --2- 172.21.15.60:0/4209859169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb78071b60 0x7ffb780b2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:44.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.554+0000 7ffb7cef0700 1 -- 172.21.15.60:0/4209859169 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb6c009550 con 0x7ffb78147c00 2023-07-12T02:02:44.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.554+0000 7ffb7cef0700 1 --2- 172.21.15.60:0/4209859169 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb78147c00 0x7ffb780b52f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ffb70007e40 tx=0x7ffb7000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:44.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.554+0000 7ffb74ff9700 1 -- 172.21.15.60:0/4209859169 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7000dd20 con 0x7ffb78147c00 2023-07-12T02:02:44.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.554+0000 7ffb74ff9700 1 -- 172.21.15.60:0/4209859169 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7000f040 con 0x7ffb78147c00 2023-07-12T02:02:44.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.554+0000 7ffb74ff9700 1 -- 172.21.15.60:0/4209859169 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb70015640 con 0x7ffb78147c00 2023-07-12T02:02:44.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.554+0000 7ffb7e953700 1 -- 172.21.15.60:0/4209859169 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb78143130 con 0x7ffb78147c00 2023-07-12T02:02:44.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.555+0000 7ffb7e953700 1 -- 172.21.15.60:0/4209859169 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb78142d00 con 0x7ffb78147c00 2023-07-12T02:02:44.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.555+0000 7ffb7e953700 1 -- 172.21.15.60:0/4209859169 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb78142a40 con 0x7ffb78147c00 2023-07-12T02:02:44.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.556+0000 7ffb74ff9700 1 -- 172.21.15.60:0/4209859169 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffb7001e3b0 con 0x7ffb78147c00 2023-07-12T02:02:44.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.556+0000 7ffb74ff9700 1 --2- 172.21.15.60:0/4209859169 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ffb6406ad10 0x7ffb6406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:44.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.556+0000 7ffb74ff9700 1 -- 172.21.15.60:0/4209859169 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffb70089580 con 0x7ffb78147c00 2023-07-12T02:02:44.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.557+0000 7ffb77fff700 1 --2- 172.21.15.60:0/4209859169 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ffb6406ad10 0x7ffb6406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:44.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.557+0000 7ffb77fff700 1 --2- 172.21.15.60:0/4209859169 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ffb6406ad10 0x7ffb6406d1c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ffb68007fd0 tx=0x7ffb68009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:44.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.561+0000 7ffb74ff9700 1 -- 172.21.15.60:0/4209859169 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7ffb78142a40 con 0x7ffb78147c00 2023-07-12T02:02:44.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.759+0000 7ffb7e953700 1 -- 172.21.15.60:0/4209859169 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb78142a40 con 0x7ffb78147c00 2023-07-12T02:02:44.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.761+0000 7ffb74ff9700 1 -- 172.21.15.60:0/4209859169 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18173 (secure 0 0 0) 0x7ffb78142a40 con 0x7ffb78147c00 2023-07-12T02:02:44.765 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:02:44.766 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":21,"fsid":"97e7c909-e567-472e-a5aa-72fde15171f2","created":"2023-07-12T02:01:53.987086+0000","modified":"2023-07-12T02:02:14.307912+0000","last_up_change":"2023-07-12T02:02:04.031780+0000","last_in_change":"2023-07-12T02:01:56.538621+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-12T02:02:05.375042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-12T02:02:05.857441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:02:10.574633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-12T02:02:11.699872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ed8b71c2-3895-4952-a118-16ede0b4a98c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6801","nonce":2818935979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6803","nonce":2818935979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6807","nonce":2818935979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6805","nonce":2818935979}]},"public_addr":"172.21.15.60:6801/2818935979","cluster_addr":"172.21.15.60:6803/2818935979","heartbeat_back_addr":"172.21.15.60:6807/2818935979","heartbeat_front_addr":"172.21.15.60:6805/2818935979","state":["exists","up"]},{"osd":1,"uuid":"7cf4d354-78e0-43ce-8c09-4a7d2a0b57a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6817","nonce":1678864191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6819","nonce":1678864191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6823","nonce":1678864191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6821","nonce":1678864191}]},"public_addr":"172.21.15.60:6817/1678864191","cluster_addr":"172.21.15.60:6819/1678864191","heartbeat_back_addr":"172.21.15.60:6823/1678864191","heartbeat_front_addr":"172.21.15.60:6821/1678864191","state":["exists","up"]},{"osd":2,"uuid":"02c958b8-9599-4470-92cb-8f7018ec0189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6809","nonce":1459480680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6811","nonce":1459480680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6815","nonce":1459480680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6813","nonce":1459480680}]},"public_addr":"172.21.15.60:6809/1459480680","cluster_addr":"172.21.15.60:6811/1459480680","heartbeat_back_addr":"172.21.15.60:6815/1459480680","heartbeat_front_addr":"172.21.15.60:6813/1459480680","state":["exists","up"]},{"osd":3,"uuid":"bc300432-a228-4257-be5c-e42dd5f2015f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6825","nonce":3295100060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6827","nonce":3295100060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6831","nonce":3295100060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6829","nonce":3295100060}]},"public_addr":"172.21.15.60:6825/3295100060","cluster_addr":"172.21.15.60:6827/3295100060","heartbeat_back_addr":"172.21.15.60:6831/3295100060","heartbeat_front_addr":"172.21.15.60:6829/3295100060","state":["exists","up"]},{"osd":4,"uuid":"ad9f7dc4-7126-466d-a656-2844880c6060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6809","nonce":4127109138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6811","nonce":4127109138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6815","nonce":4127109138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6813","nonce":4127109138}]},"public_addr":"172.21.15.79:6809/4127109138","cluster_addr":"172.21.15.79:6811/4127109138","heartbeat_back_addr":"172.21.15.79:6815/4127109138","heartbeat_front_addr":"172.21.15.79:6813/4127109138","state":["exists","up"]},{"osd":5,"uuid":"e88d16ca-0b01-4ab9-8aa8-c4aff7f210f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6801","nonce":421449406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6803","nonce":421449406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6807","nonce":421449406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6805","nonce":421449406}]},"public_addr":"172.21.15.79:6801/421449406","cluster_addr":"172.21.15.79:6803/421449406","heartbeat_back_addr":"172.21.15.79:6807/421449406","heartbeat_front_addr":"172.21.15.79:6805/421449406","state":["exists","up"]},{"osd":6,"uuid":"6898cb84-56d1-48a9-bd45-97e4668e2fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6825","nonce":4144355139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6827","nonce":4144355139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6831","nonce":4144355139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6829","nonce":4144355139}]},"public_addr":"172.21.15.79:6825/4144355139","cluster_addr":"172.21.15.79:6827/4144355139","heartbeat_back_addr":"172.21.15.79:6831/4144355139","heartbeat_front_addr":"172.21.15.79:6829/4144355139","state":["exists","up"]},{"osd":7,"uuid":"65c10882-371e-4762-b384-9c3a48f332ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6817","nonce":2845223299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6819","nonce":2845223299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6823","nonce":2845223299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6821","nonce":2845223299}]},"public_addr":"172.21.15.79:6817/2845223299","cluster_addr":"172.21.15.79:6819/2845223299","heartbeat_back_addr":"172.21.15.79:6823/2845223299","heartbeat_front_addr":"172.21.15.79:6821/2845223299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.634716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.758349+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.728366+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.777395+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707262+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.649705+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.693021+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:02:44.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.763+0000 7ffb7e953700 1 -- 172.21.15.60:0/4209859169 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ffb6406ad10 msgr2=0x7ffb6406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:44.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.763+0000 7ffb7e953700 1 --2- 172.21.15.60:0/4209859169 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ffb6406ad10 0x7ffb6406d1c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ffb68007fd0 tx=0x7ffb68009040 comp rx=0 tx=0).stop 2023-07-12T02:02:44.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.763+0000 7ffb7e953700 1 -- 172.21.15.60:0/4209859169 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb78147c00 msgr2=0x7ffb780b52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:44.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.763+0000 7ffb7e953700 1 --2- 172.21.15.60:0/4209859169 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb78147c00 0x7ffb780b52f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ffb70007e40 tx=0x7ffb7000d3b0 comp rx=0 tx=0).stop 2023-07-12T02:02:44.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.763+0000 7ffb7e953700 1 -- 172.21.15.60:0/4209859169 shutdown_connections 2023-07-12T02:02:44.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.763+0000 7ffb7e953700 1 --2- 172.21.15.60:0/4209859169 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ffb6406ad10 0x7ffb6406d1c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:44.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.763+0000 7ffb7e953700 1 --2- 172.21.15.60:0/4209859169 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb78147c00 0x7ffb780b52f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:44.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.763+0000 7ffb7e953700 1 --2- 172.21.15.60:0/4209859169 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffb7806b120 0x7ffb78141fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:44.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.763+0000 7ffb7e953700 1 --2- 172.21.15.60:0/4209859169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb78071b60 0x7ffb780b2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:44.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.763+0000 7ffb7e953700 1 -- 172.21.15.60:0/4209859169 >> 172.21.15.60:0/4209859169 conn(0x7ffb780bd980 msgr2=0x7ffb780bb000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:44.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.763+0000 7ffb7e953700 1 -- 172.21.15.60:0/4209859169 shutdown_connections 2023-07-12T02:02:44.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.763+0000 7ffb7e953700 1 -- 172.21.15.60:0/4209859169 wait complete. 2023-07-12T02:02:44.779 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-12T02:02:05.375042+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-12T02:02:05.857441+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-12T02:02:10.574633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-12T02:02:11.699872+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-12T02:02:44.780 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-12T02:02:44.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.905+0000 7fde14612700 1 Processor -- start 2023-07-12T02:02:44.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.905+0000 7fde14612700 1 -- start start 2023-07-12T02:02:44.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.906+0000 7fde14612700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde0c1444f0 0x7fde0c144960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:44.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.906+0000 7fde14612700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde0c0bc6e0 con 0x7fde0c0bd490 2023-07-12T02:02:44.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.906+0000 7fde14612700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde0c0bc9c0 con 0x7fde0c0ba3d0 2023-07-12T02:02:44.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.906+0000 7fde14612700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde0c0bcca0 con 0x7fde0c1444f0 2023-07-12T02:02:44.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.906+0000 7fde123ae700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fde0c0bd490 0x7fde0c0b86c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48672/0 (socket says 172.21.15.60:48672) 2023-07-12T02:02:44.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.906+0000 7fde123ae700 1 -- 172.21.15.60:0/1541240499 learned_addr learned my addr 172.21.15.60:0/1541240499 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:44.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.906+0000 7fde113ac700 1 -- 172.21.15.60:0/1541240499 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2460187869 0 0) 0x7fde0c0bc6e0 con 0x7fde0c0bd490 2023-07-12T02:02:44.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.906+0000 7fde113ac700 1 -- 172.21.15.60:0/1541240499 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddf80035b0 con 0x7fde0c0bd490 2023-07-12T02:02:44.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.906+0000 7fde11bad700 1 --2- 172.21.15.60:0/1541240499 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde0c1444f0 0x7fde0c144960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:44.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.906+0000 7fde113ac700 1 -- 172.21.15.60:0/1541240499 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1527492007 0 0) 0x7fddf80035b0 con 0x7fde0c0bd490 2023-07-12T02:02:44.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.906+0000 7fde113ac700 1 -- 172.21.15.60:0/1541240499 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde0c1444f0 msgr2=0x7fde0c144960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:44.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.906+0000 7fde113ac700 1 --2- 172.21.15.60:0/1541240499 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde0c1444f0 0x7fde0c144960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:44.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.906+0000 7fde113ac700 1 -- 172.21.15.60:0/1541240499 >> v1:172.21.15.79:6789/0 conn(0x7fde0c0ba3d0 legacy=0x7fde0c1551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:44.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.906+0000 7fde113ac700 1 -- 172.21.15.60:0/1541240499 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde0c0b9bd0 con 0x7fde0c0bd490 2023-07-12T02:02:44.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.907+0000 7fde113ac700 1 -- 172.21.15.60:0/1541240499 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1141905739 0 0) 0x7fddfc001670 con 0x7fde0c0bd490 2023-07-12T02:02:44.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.907+0000 7fde113ac700 1 -- 172.21.15.60:0/1541240499 >> v1:172.21.15.60:6789/0 conn(0x7fde0c0bd490 legacy=0x7fde0c0b86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:44.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.907+0000 7fde113ac700 1 --2- 172.21.15.60:0/1541240499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddf8003a30 0x7fddf8003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:44.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.907+0000 7fde113ac700 1 --2- 172.21.15.60:0/1541240499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddf8004850 0x7fddf8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:44.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.907+0000 7fde113ac700 1 --2- 172.21.15.60:0/1541240499 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde0c1444f0 0x7fddf8005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:44.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.907+0000 7fde113ac700 1 -- 172.21.15.60:0/1541240499 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0c0bcca0 con 0x7fddf8003a30 2023-07-12T02:02:44.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.907+0000 7fde113ac700 1 -- 172.21.15.60:0/1541240499 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf800bb10 con 0x7fddf8004850 2023-07-12T02:02:44.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.907+0000 7fde113ac700 1 -- 172.21.15.60:0/1541240499 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf800bcd0 con 0x7fde0c1444f0 2023-07-12T02:02:44.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.907+0000 7fde123ae700 1 --2- 172.21.15.60:0/1541240499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddf8003a30 0x7fddf8003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:44.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.907+0000 7fde11bad700 1 --2- 172.21.15.60:0/1541240499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddf8004850 0x7fddf8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:44.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.907+0000 7fde12baf700 1 --2- 172.21.15.60:0/1541240499 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde0c1444f0 0x7fddf8005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:44.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.907+0000 7fde123ae700 1 -- 172.21.15.60:0/1541240499 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde0c1444f0 msgr2=0x7fddf8005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:44.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.907+0000 7fde123ae700 1 --2- 172.21.15.60:0/1541240499 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde0c1444f0 0x7fddf8005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:44.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.907+0000 7fde123ae700 1 -- 172.21.15.60:0/1541240499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddf8004850 msgr2=0x7fddf8004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:44.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.907+0000 7fde123ae700 1 --2- 172.21.15.60:0/1541240499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddf8004850 0x7fddf8004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:44.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.907+0000 7fde123ae700 1 -- 172.21.15.60:0/1541240499 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf80035b0 con 0x7fddf8003a30 2023-07-12T02:02:44.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.907+0000 7fde123ae700 1 --2- 172.21.15.60:0/1541240499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddf8003a30 0x7fddf8003e40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fddfc00c240 tx=0x7fddf8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b0e39571974b733 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:44.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.907+0000 7fde113ac700 1 -- 172.21.15.60:0/1541240499 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddfc007c10 con 0x7fddf8003a30 2023-07-12T02:02:44.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.907+0000 7fde113ac700 1 -- 172.21.15.60:0/1541240499 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddfc00ce00 con 0x7fddf8003a30 2023-07-12T02:02:44.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.907+0000 7fde113ac700 1 -- 172.21.15.60:0/1541240499 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddfc005ba0 con 0x7fddf8003a30 2023-07-12T02:02:44.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.908+0000 7fde14612700 1 -- 172.21.15.60:0/1541240499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddf8003a30 msgr2=0x7fddf8003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:44.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.908+0000 7fde14612700 1 --2- 172.21.15.60:0/1541240499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddf8003a30 0x7fddf8003e40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fddfc00c240 tx=0x7fddf8005880 comp rx=0 tx=0).stop 2023-07-12T02:02:44.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.908+0000 7fde12baf700 1 -- 172.21.15.60:0/1541240499 reap_dead start 2023-07-12T02:02:44.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.908+0000 7fde14612700 1 -- 172.21.15.60:0/1541240499 shutdown_connections 2023-07-12T02:02:44.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.908+0000 7fde14612700 1 -- 172.21.15.60:0/1541240499 >> 172.21.15.60:0/1541240499 conn(0x7fde0c06aef0 msgr2=0x7fde0c06b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:44.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.908+0000 7fde14612700 1 -- 172.21.15.60:0/1541240499 shutdown_connections 2023-07-12T02:02:44.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.908+0000 7fde14612700 1 -- 172.21.15.60:0/1541240499 wait complete. 2023-07-12T02:02:44.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.909+0000 7fde14612700 1 Processor -- start 2023-07-12T02:02:44.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.909+0000 7fde14612700 1 -- start start 2023-07-12T02:02:44.919 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.910+0000 7fde14612700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddf8003a30 0x7fde0c148b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:44.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.910+0000 7fde14612700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde0c14e1e0 0x7fde0c140190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:44.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.910+0000 7fde14612700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde0c14e650 0x7fde0c1406d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:44.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.910+0000 7fde14612700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0c1dfdd0 con 0x7fde0c14e650 2023-07-12T02:02:44.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.910+0000 7fde14612700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0c149070 con 0x7fddf8003a30 2023-07-12T02:02:44.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.910+0000 7fde14612700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde0c14ba00 con 0x7fde0c14e1e0 2023-07-12T02:02:44.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.910+0000 7fde12baf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde0c14e650 0x7fde0c1406d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:44.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.910+0000 7fde12baf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde0c14e650 0x7fde0c1406d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41004/0 (socket says 172.21.15.60:41004) 2023-07-12T02:02:44.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.910+0000 7fde12baf700 1 -- 172.21.15.60:0/2666490611 learned_addr learned my addr 172.21.15.60:0/2666490611 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:44.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.910+0000 7fde123ae700 1 --2- 172.21.15.60:0/2666490611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddf8003a30 0x7fde0c148b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:44.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.910+0000 7fde11bad700 1 --2- 172.21.15.60:0/2666490611 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde0c14e1e0 0x7fde0c140190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:44.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.910+0000 7fde12baf700 1 -- 172.21.15.60:0/2666490611 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde0c14e1e0 msgr2=0x7fde0c140190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:44.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.910+0000 7fde12baf700 1 --2- 172.21.15.60:0/2666490611 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde0c14e1e0 0x7fde0c140190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:44.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.910+0000 7fde12baf700 1 -- 172.21.15.60:0/2666490611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddf8003a30 msgr2=0x7fde0c148b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:44.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.910+0000 7fde12baf700 1 --2- 172.21.15.60:0/2666490611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddf8003a30 0x7fde0c148b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:44.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.910+0000 7fde12baf700 1 -- 172.21.15.60:0/2666490611 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde0c14bdc0 con 0x7fde0c14e650 2023-07-12T02:02:44.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.910+0000 7fde12baf700 1 --2- 172.21.15.60:0/2666490611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde0c14e650 0x7fde0c1406d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fde0c0672c0 tx=0x7fde0400d150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:44.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.910+0000 7fde02ffd700 1 -- 172.21.15.60:0/2666490611 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde04003c10 con 0x7fde0c14e650 2023-07-12T02:02:44.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.910+0000 7fde02ffd700 1 -- 172.21.15.60:0/2666490611 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde04003d90 con 0x7fde0c14e650 2023-07-12T02:02:44.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.910+0000 7fde14612700 1 -- 172.21.15.60:0/2666490611 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde0c14eb40 con 0x7fde0c14e650 2023-07-12T02:02:44.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.910+0000 7fde02ffd700 1 -- 172.21.15.60:0/2666490611 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0400d950 con 0x7fde0c14e650 2023-07-12T02:02:44.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.910+0000 7fde14612700 1 -- 172.21.15.60:0/2666490611 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde0c14c9d0 con 0x7fde0c14e650 2023-07-12T02:02:44.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.911+0000 7fde14612700 1 -- 172.21.15.60:0/2666490611 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde0c14cb90 con 0x7fde0c14e650 2023-07-12T02:02:44.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.912+0000 7fde02ffd700 1 -- 172.21.15.60:0/2666490611 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fde0400dab0 con 0x7fde0c14e650 2023-07-12T02:02:44.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.912+0000 7fde02ffd700 1 --2- 172.21.15.60:0/2666490611 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fddf006ace0 0x7fddf006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:44.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.912+0000 7fde02ffd700 1 -- 172.21.15.60:0/2666490611 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fde04089500 con 0x7fde0c14e650 2023-07-12T02:02:44.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.912+0000 7fde123ae700 1 --2- 172.21.15.60:0/2666490611 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fddf006ace0 0x7fddf006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:44.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.913+0000 7fde123ae700 1 --2- 172.21.15.60:0/2666490611 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fddf006ace0 0x7fddf006d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fddfc001930 tx=0x7fddfc007000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:44.923 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:44.917+0000 7fde02ffd700 1 -- 172.21.15.60:0/2666490611 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fde0c14cb90 con 0x7fde0c14e650 2023-07-12T02:02:45.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.112+0000 7fde14612700 1 -- 172.21.15.60:0/2666490611 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fde0c14cb90 con 0x7fde0c14e650 2023-07-12T02:02:45.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.112+0000 7fde02ffd700 1 -- 172.21.15.60:0/2666490611 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fde0c14cb90 con 0x7fde0c14e650 2023-07-12T02:02:45.117 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2023-07-12T02:02:45.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.115+0000 7fde14612700 1 -- 172.21.15.60:0/2666490611 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fddf006ace0 msgr2=0x7fddf006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:45.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.115+0000 7fde14612700 1 --2- 172.21.15.60:0/2666490611 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fddf006ace0 0x7fddf006d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fddfc001930 tx=0x7fddfc007000 comp rx=0 tx=0).stop 2023-07-12T02:02:45.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.115+0000 7fde14612700 1 -- 172.21.15.60:0/2666490611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde0c14e650 msgr2=0x7fde0c1406d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:45.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.115+0000 7fde14612700 1 --2- 172.21.15.60:0/2666490611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde0c14e650 0x7fde0c1406d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fde0c0672c0 tx=0x7fde0400d150 comp rx=0 tx=0).stop 2023-07-12T02:02:45.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.115+0000 7fde14612700 1 -- 172.21.15.60:0/2666490611 shutdown_connections 2023-07-12T02:02:45.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.115+0000 7fde14612700 1 --2- 172.21.15.60:0/2666490611 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fddf006ace0 0x7fddf006d190 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:45.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.115+0000 7fde14612700 1 --2- 172.21.15.60:0/2666490611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde0c14e650 0x7fde0c1406d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:45.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.115+0000 7fde14612700 1 --2- 172.21.15.60:0/2666490611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddf8003a30 0x7fde0c148b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:45.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.115+0000 7fde14612700 1 --2- 172.21.15.60:0/2666490611 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde0c14e1e0 0x7fde0c140190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:45.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.115+0000 7fde14612700 1 -- 172.21.15.60:0/2666490611 >> 172.21.15.60:0/2666490611 conn(0x7fde0c06aef0 msgr2=0x7fde0c139de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:45.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.115+0000 7fde14612700 1 -- 172.21.15.60:0/2666490611 shutdown_connections 2023-07-12T02:02:45.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.115+0000 7fde14612700 1 -- 172.21.15.60:0/2666490611 wait complete. 2023-07-12T02:02:45.131 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-12T02:02:45.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.256+0000 7f4d070a5700 1 Processor -- start 2023-07-12T02:02:45.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.256+0000 7f4d070a5700 1 -- start start 2023-07-12T02:02:45.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.257+0000 7f4d070a5700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4d00071b60 0x7f4d000b6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:45.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.257+0000 7f4d070a5700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d000b3bd0 con 0x7f4d00147c00 2023-07-12T02:02:45.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.257+0000 7f4d070a5700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d000714d0 con 0x7f4d0006b120 2023-07-12T02:02:45.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.257+0000 7f4d070a5700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d00070800 con 0x7f4d00071b60 2023-07-12T02:02:45.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.257+0000 7f4cfffff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f4d00147c00 0x7f4d000b6430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48676/0 (socket says 172.21.15.60:48676) 2023-07-12T02:02:45.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.257+0000 7f4cfffff700 1 -- 172.21.15.60:0/1272909573 learned_addr learned my addr 172.21.15.60:0/1272909573 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:45.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.257+0000 7f4d05642700 1 --2- 172.21.15.60:0/1272909573 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4d00071b60 0x7f4d000b6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:45.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.257+0000 7f4cff7fe700 1 -- 172.21.15.60:0/1272909573 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4216561832 0 0) 0x7f4d000b3bd0 con 0x7f4d00147c00 2023-07-12T02:02:45.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.257+0000 7f4cff7fe700 1 -- 172.21.15.60:0/1272909573 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cf00035b0 con 0x7f4d00147c00 2023-07-12T02:02:45.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.258+0000 7f4cff7fe700 1 -- 172.21.15.60:0/1272909573 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3955954182 0 0) 0x7f4d000714d0 con 0x7f4d0006b120 2023-07-12T02:02:45.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.258+0000 7f4cff7fe700 1 -- 172.21.15.60:0/1272909573 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d000b3bd0 con 0x7f4d0006b120 2023-07-12T02:02:45.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.258+0000 7f4d05642700 1 -- 172.21.15.60:0/1272909573 >> v1:172.21.15.79:6789/0 conn(0x7f4d0006b120 legacy=0x7f4d001474f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:45.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.258+0000 7f4d05642700 1 -- 172.21.15.60:0/1272909573 >> v1:172.21.15.60:6789/0 conn(0x7f4d00147c00 legacy=0x7f4d000b6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:45.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.258+0000 7f4d05642700 1 -- 172.21.15.60:0/1272909573 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d000b3e20 con 0x7f4d00071b60 2023-07-12T02:02:45.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.258+0000 7f4d05642700 1 --2- 172.21.15.60:0/1272909573 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4d00071b60 0x7f4d000b6b40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8009dc0 tx=0x7f4cf800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16eafdc45fc94176 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:45.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.258+0000 7f4cff7fe700 1 -- 172.21.15.60:0/1272909573 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf800e070 con 0x7f4d00071b60 2023-07-12T02:02:45.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.258+0000 7f4cff7fe700 1 -- 172.21.15.60:0/1272909573 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf800bb20 con 0x7f4d00071b60 2023-07-12T02:02:45.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.258+0000 7f4cff7fe700 1 -- 172.21.15.60:0/1272909573 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf8012430 con 0x7f4d00071b60 2023-07-12T02:02:45.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.258+0000 7f4d070a5700 1 -- 172.21.15.60:0/1272909573 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4d00071b60 msgr2=0x7f4d000b6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:45.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.258+0000 7f4d070a5700 1 --2- 172.21.15.60:0/1272909573 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4d00071b60 0x7f4d000b6b40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8009dc0 tx=0x7f4cf800b330 comp rx=0 tx=0).stop 2023-07-12T02:02:45.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.259+0000 7f4d070a5700 1 -- 172.21.15.60:0/1272909573 shutdown_connections 2023-07-12T02:02:45.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.259+0000 7f4d070a5700 1 --2- 172.21.15.60:0/1272909573 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4d00071b60 0x7f4d000b6b40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:45.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.259+0000 7f4d070a5700 1 -- 172.21.15.60:0/1272909573 >> 172.21.15.60:0/1272909573 conn(0x7f4d000bd980 msgr2=0x7f4d000b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:45.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.259+0000 7f4d070a5700 1 -- 172.21.15.60:0/1272909573 shutdown_connections 2023-07-12T02:02:45.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.259+0000 7f4d070a5700 1 -- 172.21.15.60:0/1272909573 wait complete. 2023-07-12T02:02:45.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.260+0000 7f4d070a5700 1 Processor -- start 2023-07-12T02:02:45.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.260+0000 7f4d070a5700 1 -- start start 2023-07-12T02:02:45.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.261+0000 7f4d070a5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d0006b120 0x7f4d000b6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:45.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.261+0000 7f4d070a5700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4d00071b60 0x7f4d001494f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:45.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.261+0000 7f4d070a5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d00147c00 0x7f4d00149a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:45.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.261+0000 7f4d070a5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d001490d0 con 0x7f4d00147c00 2023-07-12T02:02:45.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.261+0000 7f4d070a5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d000b69d0 con 0x7f4d0006b120 2023-07-12T02:02:45.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.261+0000 7f4d070a5700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0013fd70 con 0x7f4d00071b60 2023-07-12T02:02:45.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.261+0000 7f4d05642700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d00147c00 0x7f4d00149a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:45.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.261+0000 7f4d05642700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d00147c00 0x7f4d00149a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41014/0 (socket says 172.21.15.60:41014) 2023-07-12T02:02:45.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.261+0000 7f4d05642700 1 -- 172.21.15.60:0/2628461204 learned_addr learned my addr 172.21.15.60:0/2628461204 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:45.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.261+0000 7f4d04e41700 1 --2- 172.21.15.60:0/2628461204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d0006b120 0x7f4d000b6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:45.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.261+0000 7f4cfffff700 1 --2- 172.21.15.60:0/2628461204 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4d00071b60 0x7f4d001494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:45.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.262+0000 7f4d05642700 1 -- 172.21.15.60:0/2628461204 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4d00071b60 msgr2=0x7f4d001494f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:45.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.262+0000 7f4d05642700 1 --2- 172.21.15.60:0/2628461204 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4d00071b60 0x7f4d001494f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:45.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.262+0000 7f4d05642700 1 -- 172.21.15.60:0/2628461204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d0006b120 msgr2=0x7f4d000b6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:45.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.262+0000 7f4d05642700 1 --2- 172.21.15.60:0/2628461204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d0006b120 0x7f4d000b6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:45.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.262+0000 7f4d05642700 1 -- 172.21.15.60:0/2628461204 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf8009a70 con 0x7f4d00147c00 2023-07-12T02:02:45.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.262+0000 7f4d05642700 1 --2- 172.21.15.60:0/2628461204 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d00147c00 0x7f4d00149a30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4cf800b370 tx=0x7f4cf8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:45.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.262+0000 7f4cfd7fa700 1 -- 172.21.15.60:0/2628461204 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf8012430 con 0x7f4d00147c00 2023-07-12T02:02:45.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.262+0000 7f4cfd7fa700 1 -- 172.21.15.60:0/2628461204 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf8020070 con 0x7f4d00147c00 2023-07-12T02:02:45.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.262+0000 7f4cfd7fa700 1 -- 172.21.15.60:0/2628461204 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf801ba90 con 0x7f4d00147c00 2023-07-12T02:02:45.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.262+0000 7f4d070a5700 1 -- 172.21.15.60:0/2628461204 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d0013f7b0 con 0x7f4d00147c00 2023-07-12T02:02:45.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.262+0000 7f4d070a5700 1 -- 172.21.15.60:0/2628461204 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d0013f460 con 0x7f4d00147c00 2023-07-12T02:02:45.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.263+0000 7f4d070a5700 1 -- 172.21.15.60:0/2628461204 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d00074360 con 0x7f4d00147c00 2023-07-12T02:02:45.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.263+0000 7f4cfd7fa700 1 -- 172.21.15.60:0/2628461204 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4cf801bbf0 con 0x7f4d00147c00 2023-07-12T02:02:45.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.264+0000 7f4cfd7fa700 1 --2- 172.21.15.60:0/2628461204 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f4ce406ace0 0x7f4ce406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:45.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.264+0000 7f4cfd7fa700 1 -- 172.21.15.60:0/2628461204 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4cf8022070 con 0x7f4d00147c00 2023-07-12T02:02:45.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.264+0000 7f4d04e41700 1 --2- 172.21.15.60:0/2628461204 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f4ce406ace0 0x7f4ce406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:45.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.264+0000 7f4d04e41700 1 --2- 172.21.15.60:0/2628461204 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f4ce406ace0 0x7f4ce406d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4cf40011e0 tx=0x7f4cf4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:45.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.268+0000 7f4cfd7fa700 1 -- 172.21.15.60:0/2628461204 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f4cf8056900 con 0x7f4d00147c00 2023-07-12T02:02:45.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.465+0000 7f4d070a5700 1 -- 172.21.15.60:0/2628461204 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4d000b9cc0 con 0x7f4d00147c00 2023-07-12T02:02:45.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.465+0000 7f4cfd7fa700 1 -- 172.21.15.60:0/2628461204 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4cf8059f20 con 0x7f4d00147c00 2023-07-12T02:02:45.470 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-07-12T02:02:45.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.467+0000 7f4d070a5700 1 -- 172.21.15.60:0/2628461204 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f4ce406ace0 msgr2=0x7f4ce406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:45.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.467+0000 7f4d070a5700 1 --2- 172.21.15.60:0/2628461204 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f4ce406ace0 0x7f4ce406d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4cf40011e0 tx=0x7f4cf4009040 comp rx=0 tx=0).stop 2023-07-12T02:02:45.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.467+0000 7f4d070a5700 1 -- 172.21.15.60:0/2628461204 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d00147c00 msgr2=0x7f4d00149a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:45.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.467+0000 7f4d070a5700 1 --2- 172.21.15.60:0/2628461204 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d00147c00 0x7f4d00149a30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4cf800b370 tx=0x7f4cf8004ad0 comp rx=0 tx=0).stop 2023-07-12T02:02:45.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.467+0000 7f4d070a5700 1 -- 172.21.15.60:0/2628461204 shutdown_connections 2023-07-12T02:02:45.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.467+0000 7f4d070a5700 1 --2- 172.21.15.60:0/2628461204 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f4ce406ace0 0x7f4ce406d190 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:45.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.467+0000 7f4d070a5700 1 --2- 172.21.15.60:0/2628461204 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d00147c00 0x7f4d00149a30 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:45.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.467+0000 7f4d070a5700 1 --2- 172.21.15.60:0/2628461204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d0006b120 0x7f4d000b6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:45.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.467+0000 7f4d070a5700 1 --2- 172.21.15.60:0/2628461204 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4d00071b60 0x7f4d001494f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:45.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.467+0000 7f4d070a5700 1 -- 172.21.15.60:0/2628461204 >> 172.21.15.60:0/2628461204 conn(0x7f4d000bd980 msgr2=0x7f4d000bbe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:45.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.468+0000 7f4d070a5700 1 -- 172.21.15.60:0/2628461204 shutdown_connections 2023-07-12T02:02:45.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.468+0000 7f4d070a5700 1 -- 172.21.15.60:0/2628461204 wait complete. 2023-07-12T02:02:45.484 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-12T02:02:45.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.608+0000 7fe38b3c4700 1 Processor -- start 2023-07-12T02:02:45.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.608+0000 7fe38b3c4700 1 -- start start 2023-07-12T02:02:45.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.609+0000 7fe38b3c4700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3841449d0 0x7fe38414db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:45.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.609+0000 7fe38b3c4700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3840b8620 con 0x7fe3840b8d90 2023-07-12T02:02:45.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.609+0000 7fe38b3c4700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3840b8900 con 0x7fe3840bc810 2023-07-12T02:02:45.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.609+0000 7fe38b3c4700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3840b97a0 con 0x7fe3841449d0 2023-07-12T02:02:45.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.609+0000 7fe389961700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe3840b8d90 0x7fe38406ade0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48692/0 (socket says 172.21.15.60:48692) 2023-07-12T02:02:45.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.609+0000 7fe389961700 1 -- 172.21.15.60:0/3825205893 learned_addr learned my addr 172.21.15.60:0/3825205893 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:45.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.609+0000 7fe389160700 1 --2- 172.21.15.60:0/3825205893 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3841449d0 0x7fe38414db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:45.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.609+0000 7fe37bfff700 1 -- 172.21.15.60:0/3825205893 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1820056623 0 0) 0x7fe3840b8620 con 0x7fe3840b8d90 2023-07-12T02:02:45.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.609+0000 7fe37bfff700 1 -- 172.21.15.60:0/3825205893 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3700035b0 con 0x7fe3840b8d90 2023-07-12T02:02:45.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.610+0000 7fe37bfff700 1 -- 172.21.15.60:0/3825205893 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1135885669 0 0) 0x7fe3840b8900 con 0x7fe3840bc810 2023-07-12T02:02:45.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.610+0000 7fe37bfff700 1 -- 172.21.15.60:0/3825205893 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3840b8620 con 0x7fe3840bc810 2023-07-12T02:02:45.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.610+0000 7fe37bfff700 1 -- 172.21.15.60:0/3825205893 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1784663882 0 0) 0x7fe3700035b0 con 0x7fe3840b8d90 2023-07-12T02:02:45.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.610+0000 7fe37bfff700 1 -- 172.21.15.60:0/3825205893 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3841449d0 msgr2=0x7fe38414db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:45.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.610+0000 7fe37bfff700 1 --2- 172.21.15.60:0/3825205893 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3841449d0 0x7fe38414db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:45.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.610+0000 7fe37bfff700 1 -- 172.21.15.60:0/3825205893 >> v1:172.21.15.79:6789/0 conn(0x7fe3840bc810 legacy=0x7fe3840ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:45.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.610+0000 7fe37bfff700 1 -- 172.21.15.60:0/3825205893 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3840bac40 con 0x7fe3840b8d90 2023-07-12T02:02:45.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.610+0000 7fe37bfff700 1 -- 172.21.15.60:0/3825205893 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1141905739 0 0) 0x7fe37c0019f0 con 0x7fe3840b8d90 2023-07-12T02:02:45.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.610+0000 7fe37bfff700 1 -- 172.21.15.60:0/3825205893 >> v1:172.21.15.60:6789/0 conn(0x7fe3840b8d90 legacy=0x7fe38406ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:45.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.610+0000 7fe37bfff700 1 --2- 172.21.15.60:0/3825205893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe370003bc0 0x7fe370003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:45.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.610+0000 7fe37bfff700 1 --2- 172.21.15.60:0/3825205893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe370004850 0x7fe370004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:45.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.610+0000 7fe37bfff700 1 --2- 172.21.15.60:0/3825205893 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3841449d0 0x7fe370005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:45.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.610+0000 7fe37bfff700 1 -- 172.21.15.60:0/3825205893 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3840b97a0 con 0x7fe370004850 2023-07-12T02:02:45.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.610+0000 7fe37bfff700 1 -- 172.21.15.60:0/3825205893 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37000bac0 con 0x7fe370003bc0 2023-07-12T02:02:45.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.610+0000 7fe37bfff700 1 -- 172.21.15.60:0/3825205893 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe37000bc30 con 0x7fe3841449d0 2023-07-12T02:02:45.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.610+0000 7fe38895f700 1 --2- 172.21.15.60:0/3825205893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe370004850 0x7fe370004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:45.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.610+0000 7fe389160700 1 --2- 172.21.15.60:0/3825205893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe370003bc0 0x7fe370003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:45.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.610+0000 7fe389961700 1 --2- 172.21.15.60:0/3825205893 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3841449d0 0x7fe370005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:45.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.610+0000 7fe38895f700 1 -- 172.21.15.60:0/3825205893 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3841449d0 msgr2=0x7fe370005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:45.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.610+0000 7fe38895f700 1 --2- 172.21.15.60:0/3825205893 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3841449d0 0x7fe370005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:45.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.610+0000 7fe38895f700 1 -- 172.21.15.60:0/3825205893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe370003bc0 msgr2=0x7fe370003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:45.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.610+0000 7fe38895f700 1 --2- 172.21.15.60:0/3825205893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe370003bc0 0x7fe370003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:45.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.610+0000 7fe38895f700 1 -- 172.21.15.60:0/3825205893 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3700035b0 con 0x7fe370004850 2023-07-12T02:02:45.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.610+0000 7fe38895f700 1 --2- 172.21.15.60:0/3825205893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe370004850 0x7fe370004cc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe380001980 tx=0x7fe370005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56040278ea6e00ce server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:45.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.610+0000 7fe37bfff700 1 -- 172.21.15.60:0/3825205893 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe380001470 con 0x7fe370004850 2023-07-12T02:02:45.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.610+0000 7fe37bfff700 1 -- 172.21.15.60:0/3825205893 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3800052d0 con 0x7fe370004850 2023-07-12T02:02:45.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.610+0000 7fe37bfff700 1 -- 172.21.15.60:0/3825205893 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe380003680 con 0x7fe370004850 2023-07-12T02:02:45.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.611+0000 7fe38b3c4700 1 -- 172.21.15.60:0/3825205893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe370004850 msgr2=0x7fe370004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:45.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.611+0000 7fe38b3c4700 1 --2- 172.21.15.60:0/3825205893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe370004850 0x7fe370004cc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe380001980 tx=0x7fe370005880 comp rx=0 tx=0).stop 2023-07-12T02:02:45.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.611+0000 7fe389961700 1 -- 172.21.15.60:0/3825205893 reap_dead start 2023-07-12T02:02:45.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.611+0000 7fe38b3c4700 1 -- 172.21.15.60:0/3825205893 shutdown_connections 2023-07-12T02:02:45.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.611+0000 7fe38b3c4700 1 -- 172.21.15.60:0/3825205893 >> 172.21.15.60:0/3825205893 conn(0x7fe3840c0860 msgr2=0x7fe3840c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:45.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.611+0000 7fe38b3c4700 1 -- 172.21.15.60:0/3825205893 shutdown_connections 2023-07-12T02:02:45.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.611+0000 7fe38b3c4700 1 -- 172.21.15.60:0/3825205893 wait complete. 2023-07-12T02:02:45.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.612+0000 7fe38b3c4700 1 Processor -- start 2023-07-12T02:02:45.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.612+0000 7fe38b3c4700 1 -- start start 2023-07-12T02:02:45.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.613+0000 7fe38b3c4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe370004850 0x7fe3840b2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:45.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.613+0000 7fe38b3c4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3840b3110 0x7fe3840a2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:45.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.613+0000 7fe38b3c4700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3840a2b90 0x7fe384149440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:45.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.613+0000 7fe38b3c4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3840a21c0 con 0x7fe370004850 2023-07-12T02:02:45.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.613+0000 7fe38b3c4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3840a3ed0 con 0x7fe3840b3110 2023-07-12T02:02:45.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.613+0000 7fe38b3c4700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3840a3000 con 0x7fe3840a2b90 2023-07-12T02:02:45.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.613+0000 7fe389160700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe370004850 0x7fe3840b2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:45.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.613+0000 7fe389160700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe370004850 0x7fe3840b2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41032/0 (socket says 172.21.15.60:41032) 2023-07-12T02:02:45.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.613+0000 7fe389160700 1 -- 172.21.15.60:0/4098526159 learned_addr learned my addr 172.21.15.60:0/4098526159 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:45.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.613+0000 7fe38895f700 1 --2- 172.21.15.60:0/4098526159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3840b3110 0x7fe3840a2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:45.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.613+0000 7fe389961700 1 --2- 172.21.15.60:0/4098526159 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3840a2b90 0x7fe384149440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:45.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.613+0000 7fe389160700 1 -- 172.21.15.60:0/4098526159 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3840a2b90 msgr2=0x7fe384149440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:45.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.613+0000 7fe389160700 1 --2- 172.21.15.60:0/4098526159 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3840a2b90 0x7fe384149440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:45.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.613+0000 7fe389160700 1 -- 172.21.15.60:0/4098526159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3840b3110 msgr2=0x7fe3840a2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:45.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.613+0000 7fe389160700 1 --2- 172.21.15.60:0/4098526159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3840b3110 0x7fe3840a2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:45.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.613+0000 7fe389160700 1 -- 172.21.15.60:0/4098526159 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe384145270 con 0x7fe370004850 2023-07-12T02:02:45.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.613+0000 7fe389160700 1 --2- 172.21.15.60:0/4098526159 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe370004850 0x7fe3840b2bd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe374011aa0 tx=0x7fe374011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:45.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.613+0000 7fe379ffb700 1 -- 172.21.15.60:0/4098526159 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe374011ed0 con 0x7fe370004850 2023-07-12T02:02:45.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.614+0000 7fe379ffb700 1 -- 172.21.15.60:0/4098526159 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe37400f940 con 0x7fe370004850 2023-07-12T02:02:45.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.614+0000 7fe38b3c4700 1 -- 172.21.15.60:0/4098526159 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3840a1890 con 0x7fe370004850 2023-07-12T02:02:45.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.614+0000 7fe379ffb700 1 -- 172.21.15.60:0/4098526159 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37400fcf0 con 0x7fe370004850 2023-07-12T02:02:45.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.614+0000 7fe38b3c4700 1 -- 172.21.15.60:0/4098526159 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3840a1e50 con 0x7fe370004850 2023-07-12T02:02:45.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.615+0000 7fe38b3c4700 1 -- 172.21.15.60:0/4098526159 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe384074360 con 0x7fe370004850 2023-07-12T02:02:45.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.615+0000 7fe379ffb700 1 -- 172.21.15.60:0/4098526159 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe374014440 con 0x7fe370004850 2023-07-12T02:02:45.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.615+0000 7fe379ffb700 1 --2- 172.21.15.60:0/4098526159 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fe36806ad10 0x7fe36806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:45.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.616+0000 7fe379ffb700 1 -- 172.21.15.60:0/4098526159 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe374089940 con 0x7fe370004850 2023-07-12T02:02:45.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.616+0000 7fe38895f700 1 --2- 172.21.15.60:0/4098526159 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fe36806ad10 0x7fe36806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:45.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.616+0000 7fe38895f700 1 --2- 172.21.15.60:0/4098526159 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fe36806ad10 0x7fe36806d1c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe3840c06a0 tx=0x7fe38000a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:45.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.620+0000 7fe379ffb700 1 -- 172.21.15.60:0/4098526159 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fe374054b40 con 0x7fe370004850 2023-07-12T02:02:45.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.816+0000 7fe38b3c4700 1 -- 172.21.15.60:0/4098526159 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe3840bc330 con 0x7fe370004850 2023-07-12T02:02:45.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.816+0000 7fe379ffb700 1 -- 172.21.15.60:0/4098526159 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe374022020 con 0x7fe370004850 2023-07-12T02:02:45.820 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-07-12T02:02:45.822 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.818+0000 7fe38b3c4700 1 -- 172.21.15.60:0/4098526159 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fe36806ad10 msgr2=0x7fe36806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:45.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.818+0000 7fe38b3c4700 1 --2- 172.21.15.60:0/4098526159 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fe36806ad10 0x7fe36806d1c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe3840c06a0 tx=0x7fe38000a000 comp rx=0 tx=0).stop 2023-07-12T02:02:45.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.818+0000 7fe38b3c4700 1 -- 172.21.15.60:0/4098526159 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe370004850 msgr2=0x7fe3840b2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:45.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.818+0000 7fe38b3c4700 1 --2- 172.21.15.60:0/4098526159 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe370004850 0x7fe3840b2bd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe374011aa0 tx=0x7fe374011db0 comp rx=0 tx=0).stop 2023-07-12T02:02:45.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.818+0000 7fe38b3c4700 1 -- 172.21.15.60:0/4098526159 shutdown_connections 2023-07-12T02:02:45.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.818+0000 7fe38b3c4700 1 --2- 172.21.15.60:0/4098526159 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fe36806ad10 0x7fe36806d1c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:45.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.818+0000 7fe38b3c4700 1 --2- 172.21.15.60:0/4098526159 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe370004850 0x7fe3840b2bd0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:45.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.818+0000 7fe38b3c4700 1 --2- 172.21.15.60:0/4098526159 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe3840a2b90 0x7fe384149440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:45.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.818+0000 7fe38b3c4700 1 --2- 172.21.15.60:0/4098526159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3840b3110 0x7fe3840a2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:45.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.818+0000 7fe38b3c4700 1 -- 172.21.15.60:0/4098526159 >> 172.21.15.60:0/4098526159 conn(0x7fe3840c0860 msgr2=0x7fe38414e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:45.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.819+0000 7fe38b3c4700 1 -- 172.21.15.60:0/4098526159 shutdown_connections 2023-07-12T02:02:45.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.819+0000 7fe38b3c4700 1 -- 172.21.15.60:0/4098526159 wait complete. 2023-07-12T02:02:45.834 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-12T02:02:45.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.960+0000 7f669fdbf700 1 Processor -- start 2023-07-12T02:02:45.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.960+0000 7f669fdbf700 1 -- start start 2023-07-12T02:02:45.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.961+0000 7f669fdbf700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f669806b120 0x7f669806edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:45.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.961+0000 7f669fdbf700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66980b93e0 con 0x7f669806f340 2023-07-12T02:02:45.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.961+0000 7f669fdbf700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6698141200 con 0x7f6698071ab0 2023-07-12T02:02:45.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.961+0000 7f669fdbf700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6698071690 con 0x7f669806b120 2023-07-12T02:02:45.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.961+0000 7f669e35c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f669806f340 0x7f6698151370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48708/0 (socket says 172.21.15.60:48708) 2023-07-12T02:02:45.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.961+0000 7f669e35c700 1 -- 172.21.15.60:0/545899613 learned_addr learned my addr 172.21.15.60:0/545899613 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:45.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.962+0000 7f669db5b700 1 --2- 172.21.15.60:0/545899613 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f669806b120 0x7f669806edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:45.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.962+0000 7f669cb59700 1 -- 172.21.15.60:0/545899613 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1269478172 0 0) 0x7f66980b93e0 con 0x7f669806f340 2023-07-12T02:02:45.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.962+0000 7f669cb59700 1 -- 172.21.15.60:0/545899613 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66840046c0 con 0x7f669806f340 2023-07-12T02:02:45.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.962+0000 7f669cb59700 1 -- 172.21.15.60:0/545899613 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1380022466 0 0) 0x7f6698141200 con 0x7f6698071ab0 2023-07-12T02:02:45.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.962+0000 7f669cb59700 1 -- 172.21.15.60:0/545899613 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66980b93e0 con 0x7f6698071ab0 2023-07-12T02:02:45.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.962+0000 7f669cb59700 1 -- 172.21.15.60:0/545899613 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2014757174 0 0) 0x7f66840046c0 con 0x7f669806f340 2023-07-12T02:02:45.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.962+0000 7f669cb59700 1 -- 172.21.15.60:0/545899613 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f669806b120 msgr2=0x7f669806edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:45.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.962+0000 7f669cb59700 1 --2- 172.21.15.60:0/545899613 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f669806b120 0x7f669806edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:45.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.962+0000 7f669cb59700 1 -- 172.21.15.60:0/545899613 >> v1:172.21.15.79:6789/0 conn(0x7f6698071ab0 legacy=0x7f6698140af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:45.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.962+0000 7f669cb59700 1 -- 172.21.15.60:0/545899613 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f669806f8d0 con 0x7f669806f340 2023-07-12T02:02:45.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.962+0000 7f669cb59700 1 -- 172.21.15.60:0/545899613 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1141905739 0 0) 0x7f66900019f0 con 0x7f669806f340 2023-07-12T02:02:45.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.962+0000 7f669cb59700 1 -- 172.21.15.60:0/545899613 >> v1:172.21.15.60:6789/0 conn(0x7f669806f340 legacy=0x7f6698151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:45.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.962+0000 7f669cb59700 1 --2- 172.21.15.60:0/545899613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6684004cd0 0x7f66840050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:45.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.962+0000 7f669cb59700 1 --2- 172.21.15.60:0/545899613 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f669806b120 0x7f6684005960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:45.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.962+0000 7f669cb59700 1 --2- 172.21.15.60:0/545899613 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6684005ea0 0x7f6684006310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:45.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.962+0000 7f669cb59700 1 -- 172.21.15.60:0/545899613 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6698071690 con 0x7f6684005ea0 2023-07-12T02:02:45.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.962+0000 7f669cb59700 1 -- 172.21.15.60:0/545899613 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66840035b0 con 0x7f6684004cd0 2023-07-12T02:02:45.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.962+0000 7f669cb59700 1 -- 172.21.15.60:0/545899613 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6684003770 con 0x7f669806b120 2023-07-12T02:02:45.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.962+0000 7f669e35c700 1 --2- 172.21.15.60:0/545899613 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6684005ea0 0x7f6684006310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:45.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.962+0000 7f669db5b700 1 --2- 172.21.15.60:0/545899613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6684004cd0 0x7f66840050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:45.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.962+0000 7f669d35a700 1 --2- 172.21.15.60:0/545899613 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f669806b120 0x7f6684005960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:45.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.962+0000 7f669e35c700 1 -- 172.21.15.60:0/545899613 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f669806b120 msgr2=0x7f6684005960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:45.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.962+0000 7f669e35c700 1 --2- 172.21.15.60:0/545899613 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f669806b120 0x7f6684005960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:45.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.962+0000 7f669e35c700 1 -- 172.21.15.60:0/545899613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6684004cd0 msgr2=0x7f66840050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:45.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.962+0000 7f669e35c700 1 --2- 172.21.15.60:0/545899613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6684004cd0 0x7f66840050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:45.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.962+0000 7f669e35c700 1 -- 172.21.15.60:0/545899613 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66840046c0 con 0x7f6684005ea0 2023-07-12T02:02:45.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.963+0000 7f669e35c700 1 --2- 172.21.15.60:0/545899613 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6684005ea0 0x7f6684006310 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f669000a7d0 tx=0x7f6684006990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=715a18a65eaa1025 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:45.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.963+0000 7f669cb59700 1 -- 172.21.15.60:0/545899613 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6690012600 con 0x7f6684005ea0 2023-07-12T02:02:45.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.963+0000 7f669cb59700 1 -- 172.21.15.60:0/545899613 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6690012780 con 0x7f6684005ea0 2023-07-12T02:02:45.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.963+0000 7f669cb59700 1 -- 172.21.15.60:0/545899613 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6690012b30 con 0x7f6684005ea0 2023-07-12T02:02:45.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.963+0000 7f669fdbf700 1 -- 172.21.15.60:0/545899613 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6684005ea0 msgr2=0x7f6684006310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:45.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.963+0000 7f669fdbf700 1 --2- 172.21.15.60:0/545899613 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6684005ea0 0x7f6684006310 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f669000a7d0 tx=0x7f6684006990 comp rx=0 tx=0).stop 2023-07-12T02:02:45.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.963+0000 7f669e35c700 1 -- 172.21.15.60:0/545899613 reap_dead start 2023-07-12T02:02:45.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.963+0000 7f669fdbf700 1 -- 172.21.15.60:0/545899613 shutdown_connections 2023-07-12T02:02:45.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.963+0000 7f669fdbf700 1 -- 172.21.15.60:0/545899613 >> 172.21.15.60:0/545899613 conn(0x7f66980bd980 msgr2=0x7f66980b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:45.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.963+0000 7f669fdbf700 1 -- 172.21.15.60:0/545899613 shutdown_connections 2023-07-12T02:02:45.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.963+0000 7f669fdbf700 1 -- 172.21.15.60:0/545899613 wait complete. 2023-07-12T02:02:45.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.964+0000 7f669fdbf700 1 Processor -- start 2023-07-12T02:02:45.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.965+0000 7f669fdbf700 1 -- start start 2023-07-12T02:02:45.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.965+0000 7f669fdbf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6684005ea0 0x7f6698145390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:45.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.965+0000 7f669fdbf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66980b5ff0 0x7f66981deda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:45.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.965+0000 7f669fdbf700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f66981df2e0 0x7f669813cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:45.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.965+0000 7f669fdbf700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66980b4c70 con 0x7f6684005ea0 2023-07-12T02:02:45.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.965+0000 7f669fdbf700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66981458d0 con 0x7f66980b5ff0 2023-07-12T02:02:45.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.965+0000 7f669fdbf700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66980b71e0 con 0x7f66981df2e0 2023-07-12T02:02:45.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.965+0000 7f669db5b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6684005ea0 0x7f6698145390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:45.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.965+0000 7f669db5b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6684005ea0 0x7f6698145390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41042/0 (socket says 172.21.15.60:41042) 2023-07-12T02:02:45.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.965+0000 7f669db5b700 1 -- 172.21.15.60:0/3276585196 learned_addr learned my addr 172.21.15.60:0/3276585196 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:45.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.965+0000 7f669d35a700 1 --2- 172.21.15.60:0/3276585196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66980b5ff0 0x7f66981deda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:45.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.965+0000 7f669e35c700 1 --2- 172.21.15.60:0/3276585196 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f66981df2e0 0x7f669813cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:45.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.965+0000 7f669db5b700 1 -- 172.21.15.60:0/3276585196 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f66981df2e0 msgr2=0x7f669813cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:45.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.965+0000 7f669db5b700 1 --2- 172.21.15.60:0/3276585196 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f66981df2e0 0x7f669813cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:45.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.965+0000 7f669db5b700 1 -- 172.21.15.60:0/3276585196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66980b5ff0 msgr2=0x7f66981deda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:45.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.966+0000 7f669db5b700 1 --2- 172.21.15.60:0/3276585196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66980b5ff0 0x7f66981deda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:45.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.966+0000 7f669db5b700 1 -- 172.21.15.60:0/3276585196 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66980b5070 con 0x7f6684005ea0 2023-07-12T02:02:45.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.966+0000 7f669db5b700 1 --2- 172.21.15.60:0/3276585196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6684005ea0 0x7f6698145390 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6694011aa0 tx=0x7f6694011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:45.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.966+0000 7f668e7fc700 1 -- 172.21.15.60:0/3276585196 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6694011ed0 con 0x7f6684005ea0 2023-07-12T02:02:45.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.966+0000 7f668e7fc700 1 -- 172.21.15.60:0/3276585196 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669400f940 con 0x7f6684005ea0 2023-07-12T02:02:45.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.966+0000 7f669fdbf700 1 -- 172.21.15.60:0/3276585196 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66980b6460 con 0x7f6684005ea0 2023-07-12T02:02:45.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.966+0000 7f668e7fc700 1 -- 172.21.15.60:0/3276585196 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669400fcf0 con 0x7f6684005ea0 2023-07-12T02:02:45.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.966+0000 7f669fdbf700 1 -- 172.21.15.60:0/3276585196 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66981cceb0 con 0x7f6684005ea0 2023-07-12T02:02:45.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.967+0000 7f669fdbf700 1 -- 172.21.15.60:0/3276585196 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66980b4ee0 con 0x7f6684005ea0 2023-07-12T02:02:45.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.967+0000 7f668e7fc700 1 -- 172.21.15.60:0/3276585196 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6694014440 con 0x7f6684005ea0 2023-07-12T02:02:45.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.968+0000 7f668e7fc700 1 --2- 172.21.15.60:0/3276585196 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f667c06ace0 0x7f667c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:45.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.968+0000 7f668e7fc700 1 -- 172.21.15.60:0/3276585196 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f66940899a0 con 0x7f6684005ea0 2023-07-12T02:02:45.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.968+0000 7f669d35a700 1 --2- 172.21.15.60:0/3276585196 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f667c06ace0 0x7f667c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:45.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.968+0000 7f669d35a700 1 --2- 172.21.15.60:0/3276585196 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f667c06ace0 0x7f667c06d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f66980b8690 tx=0x7f6688009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:45.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:45.972+0000 7f668e7fc700 1 -- 172.21.15.60:0/3276585196 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f6694058650 con 0x7f6684005ea0 2023-07-12T02:02:46.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.171+0000 7f669fdbf700 1 -- 172.21.15.60:0/3276585196 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f66980b5070 con 0x7f6684005ea0 2023-07-12T02:02:46.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.171+0000 7f668e7fc700 1 -- 172.21.15.60:0/3276585196 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f66980b5070 con 0x7f6684005ea0 2023-07-12T02:02:46.175 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-07-12T02:02:46.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.173+0000 7f669fdbf700 1 -- 172.21.15.60:0/3276585196 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f667c06ace0 msgr2=0x7f667c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:46.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.173+0000 7f669fdbf700 1 --2- 172.21.15.60:0/3276585196 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f667c06ace0 0x7f667c06d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f66980b8690 tx=0x7f6688009040 comp rx=0 tx=0).stop 2023-07-12T02:02:46.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.173+0000 7f669fdbf700 1 -- 172.21.15.60:0/3276585196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6684005ea0 msgr2=0x7f6698145390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:46.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.173+0000 7f669fdbf700 1 --2- 172.21.15.60:0/3276585196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6684005ea0 0x7f6698145390 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6694011aa0 tx=0x7f6694011db0 comp rx=0 tx=0).stop 2023-07-12T02:02:46.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.173+0000 7f669fdbf700 1 -- 172.21.15.60:0/3276585196 shutdown_connections 2023-07-12T02:02:46.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.173+0000 7f669fdbf700 1 --2- 172.21.15.60:0/3276585196 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f667c06ace0 0x7f667c06d190 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:46.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.173+0000 7f669fdbf700 1 --2- 172.21.15.60:0/3276585196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6684005ea0 0x7f6698145390 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:46.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.173+0000 7f669fdbf700 1 --2- 172.21.15.60:0/3276585196 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f66981df2e0 0x7f669813cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:46.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.173+0000 7f669fdbf700 1 --2- 172.21.15.60:0/3276585196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66980b5ff0 0x7f66981deda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:46.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.173+0000 7f669fdbf700 1 -- 172.21.15.60:0/3276585196 >> 172.21.15.60:0/3276585196 conn(0x7f66980bd980 msgr2=0x7f669813f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:46.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.173+0000 7f669fdbf700 1 -- 172.21.15.60:0/3276585196 shutdown_connections 2023-07-12T02:02:46.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.173+0000 7f669fdbf700 1 -- 172.21.15.60:0/3276585196 wait complete. 2023-07-12T02:02:46.189 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-12T02:02:46.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.311+0000 7f1d59624700 1 Processor -- start 2023-07-12T02:02:46.315 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.311+0000 7f1d59624700 1 -- start start 2023-07-12T02:02:46.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.311+0000 7f1d59624700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1d541449d0 0x7f1d5414db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:46.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.311+0000 7f1d59624700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1d540b8d90 0x7f1d5406ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:46.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.311+0000 7f1d59624700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d540b8620 con 0x7f1d540bc810 2023-07-12T02:02:46.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.311+0000 7f1d59624700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d540b97a0 con 0x7f1d541449d0 2023-07-12T02:02:46.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.311+0000 7f1d59624700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d54144da0 con 0x7f1d540b8d90 2023-07-12T02:02:46.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.311+0000 7f1d52ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1d541449d0 0x7f1d5414db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:46.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.311+0000 7f1d52ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1d541449d0 0x7f1d5414db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41056/0 (socket says 172.21.15.60:41056) 2023-07-12T02:02:46.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.311+0000 7f1d52ffd700 1 -- 172.21.15.60:0/4289436111 learned_addr learned my addr 172.21.15.60:0/4289436111 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:46.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.311+0000 7f1d537fe700 1 --2- 172.21.15.60:0/4289436111 >> v2:172.21.15.79:3300/0 conn(0x7f1d540b8d90 0x7f1d5406ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:46.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.312+0000 7f1d52ffd700 1 -- 172.21.15.60:0/4289436111 >> v2:172.21.15.79:3300/0 conn(0x7f1d540b8d90 msgr2=0x7f1d5406ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:46.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.312+0000 7f1d52ffd700 1 --2- 172.21.15.60:0/4289436111 >> v2:172.21.15.79:3300/0 conn(0x7f1d540b8d90 0x7f1d5406ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:46.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.312+0000 7f1d52ffd700 1 -- 172.21.15.60:0/4289436111 >> v1:172.21.15.79:6789/0 conn(0x7f1d540bc810 legacy=0x7f1d540ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:46.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.312+0000 7f1d52ffd700 1 -- 172.21.15.60:0/4289436111 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d540b8900 con 0x7f1d541449d0 2023-07-12T02:02:46.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.312+0000 7f1d52ffd700 1 --2- 172.21.15.60:0/4289436111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d541449d0 0x7f1d5414db50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1d540be710 tx=0x7f1d44009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9585d2a9b37e480f server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:46.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.312+0000 7f1d51ffb700 1 -- 172.21.15.60:0/4289436111 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d44011830 con 0x7f1d541449d0 2023-07-12T02:02:46.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.312+0000 7f1d51ffb700 1 -- 172.21.15.60:0/4289436111 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d44011990 con 0x7f1d541449d0 2023-07-12T02:02:46.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.312+0000 7f1d51ffb700 1 -- 172.21.15.60:0/4289436111 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d44011d20 con 0x7f1d541449d0 2023-07-12T02:02:46.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.313+0000 7f1d59624700 1 -- 172.21.15.60:0/4289436111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d541449d0 msgr2=0x7f1d5414db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:46.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.313+0000 7f1d59624700 1 --2- 172.21.15.60:0/4289436111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d541449d0 0x7f1d5414db50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1d540be710 tx=0x7f1d44009bd0 comp rx=0 tx=0).stop 2023-07-12T02:02:46.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.313+0000 7f1d59624700 1 -- 172.21.15.60:0/4289436111 shutdown_connections 2023-07-12T02:02:46.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.313+0000 7f1d59624700 1 --2- 172.21.15.60:0/4289436111 >> v2:172.21.15.79:3300/0 conn(0x7f1d540b8d90 0x7f1d5406ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:46.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.313+0000 7f1d59624700 1 --2- 172.21.15.60:0/4289436111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d541449d0 0x7f1d5414db50 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:46.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.313+0000 7f1d59624700 1 -- 172.21.15.60:0/4289436111 >> 172.21.15.60:0/4289436111 conn(0x7f1d540c0860 msgr2=0x7f1d540c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:46.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.313+0000 7f1d59624700 1 -- 172.21.15.60:0/4289436111 shutdown_connections 2023-07-12T02:02:46.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.313+0000 7f1d59624700 1 -- 172.21.15.60:0/4289436111 wait complete. 2023-07-12T02:02:46.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.314+0000 7f1d59624700 1 Processor -- start 2023-07-12T02:02:46.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.314+0000 7f1d59624700 1 -- start start 2023-07-12T02:02:46.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.314+0000 7f1d59624700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d540b8d90 0x7f1d5414a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:46.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.314+0000 7f1d59624700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d540bc810 0x7f1d54146b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:46.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.315+0000 7f1d59624700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d541449d0 0x7f1d540a6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:46.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.315+0000 7f1d59624700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5414cfb0 con 0x7f1d541449d0 2023-07-12T02:02:46.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.315+0000 7f1d59624700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5414d190 con 0x7f1d540bc810 2023-07-12T02:02:46.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.315+0000 7f1d59624700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d541489c0 con 0x7f1d540b8d90 2023-07-12T02:02:46.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.315+0000 7f1d537fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d541449d0 0x7f1d540a6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:46.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.315+0000 7f1d537fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d541449d0 0x7f1d540a6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41070/0 (socket says 172.21.15.60:41070) 2023-07-12T02:02:46.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.315+0000 7f1d537fe700 1 -- 172.21.15.60:0/3526861225 learned_addr learned my addr 172.21.15.60:0/3526861225 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:46.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.315+0000 7f1d527fc700 1 --2- 172.21.15.60:0/3526861225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d540bc810 0x7f1d54146b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:46.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.315+0000 7f1d52ffd700 1 --2- 172.21.15.60:0/3526861225 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d540b8d90 0x7f1d5414a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:46.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.315+0000 7f1d537fe700 1 -- 172.21.15.60:0/3526861225 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d540b8d90 msgr2=0x7f1d5414a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:46.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.315+0000 7f1d537fe700 1 --2- 172.21.15.60:0/3526861225 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d540b8d90 0x7f1d5414a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:46.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.315+0000 7f1d537fe700 1 -- 172.21.15.60:0/3526861225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d540bc810 msgr2=0x7f1d54146b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:46.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.315+0000 7f1d537fe700 1 --2- 172.21.15.60:0/3526861225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d540bc810 0x7f1d54146b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:46.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.315+0000 7f1d537fe700 1 -- 172.21.15.60:0/3526861225 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d44009550 con 0x7f1d541449d0 2023-07-12T02:02:46.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.315+0000 7f1d537fe700 1 --2- 172.21.15.60:0/3526861225 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d541449d0 0x7f1d540a6050 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c009dd0 tx=0x7f1d4c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:46.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.315+0000 7f1d3b7fe700 1 -- 172.21.15.60:0/3526861225 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c009c40 con 0x7f1d541449d0 2023-07-12T02:02:46.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.315+0000 7f1d3b7fe700 1 -- 172.21.15.60:0/3526861225 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d4c00f040 con 0x7f1d541449d0 2023-07-12T02:02:46.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.315+0000 7f1d59624700 1 -- 172.21.15.60:0/3526861225 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d54148650 con 0x7f1d541449d0 2023-07-12T02:02:46.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.315+0000 7f1d3b7fe700 1 -- 172.21.15.60:0/3526861225 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c00ceb0 con 0x7f1d541449d0 2023-07-12T02:02:46.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.315+0000 7f1d59624700 1 -- 172.21.15.60:0/3526861225 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d5414ada0 con 0x7f1d541449d0 2023-07-12T02:02:46.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.316+0000 7f1d59624700 1 -- 172.21.15.60:0/3526861225 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d54074360 con 0x7f1d541449d0 2023-07-12T02:02:46.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.317+0000 7f1d3b7fe700 1 -- 172.21.15.60:0/3526861225 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1d4c014480 con 0x7f1d541449d0 2023-07-12T02:02:46.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.317+0000 7f1d3b7fe700 1 --2- 172.21.15.60:0/3526861225 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f1d4006ace0 0x7f1d4006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:46.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.317+0000 7f1d3b7fe700 1 -- 172.21.15.60:0/3526861225 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1d4c089fc0 con 0x7f1d541449d0 2023-07-12T02:02:46.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.317+0000 7f1d52ffd700 1 --2- 172.21.15.60:0/3526861225 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f1d4006ace0 0x7f1d4006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:46.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.318+0000 7f1d52ffd700 1 --2- 172.21.15.60:0/3526861225 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f1d4006ace0 0x7f1d4006d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1d44014040 tx=0x7f1d44008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:46.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.322+0000 7f1d3b7fe700 1 -- 172.21.15.60:0/3526861225 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f1d4c058af0 con 0x7f1d541449d0 2023-07-12T02:02:46.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.560+0000 7f1d59624700 1 -- 172.21.15.60:0/3526861225 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d541484b0 con 0x7f1d541449d0 2023-07-12T02:02:46.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.560+0000 7f1d3b7fe700 1 -- 172.21.15.60:0/3526861225 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3906 (secure 0 0 0) 0x7f1d541484b0 con 0x7f1d541449d0 2023-07-12T02:02:46.564 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:02:46.565 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2687011977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2687011977},{"type":"v1","addr":"172.21.15.60:6835","nonce":2687011977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/1153134400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1153134400},{"type":"v1","addr":"172.21.15.79:6835","nonce":1153134400}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-12T02:02:12.733570+0000","modified":"2023-07-12T02:02:15.754293+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6833/825430907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":825430907},{"type":"v1","addr":"172.21.15.60:6833","nonce":825430907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-12T02:02:46.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.562+0000 7f1d59624700 1 -- 172.21.15.60:0/3526861225 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f1d4006ace0 msgr2=0x7f1d4006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:46.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.562+0000 7f1d59624700 1 --2- 172.21.15.60:0/3526861225 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f1d4006ace0 0x7f1d4006d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1d44014040 tx=0x7f1d44008030 comp rx=0 tx=0).stop 2023-07-12T02:02:46.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.562+0000 7f1d59624700 1 -- 172.21.15.60:0/3526861225 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d541449d0 msgr2=0x7f1d540a6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:46.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.562+0000 7f1d59624700 1 --2- 172.21.15.60:0/3526861225 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d541449d0 0x7f1d540a6050 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c009dd0 tx=0x7f1d4c00c3a0 comp rx=0 tx=0).stop 2023-07-12T02:02:46.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.563+0000 7f1d59624700 1 -- 172.21.15.60:0/3526861225 shutdown_connections 2023-07-12T02:02:46.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.563+0000 7f1d59624700 1 --2- 172.21.15.60:0/3526861225 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f1d4006ace0 0x7f1d4006d190 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:46.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.563+0000 7f1d59624700 1 --2- 172.21.15.60:0/3526861225 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d541449d0 0x7f1d540a6050 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:46.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.563+0000 7f1d59624700 1 --2- 172.21.15.60:0/3526861225 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d540b8d90 0x7f1d5414a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:46.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.563+0000 7f1d59624700 1 --2- 172.21.15.60:0/3526861225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d540bc810 0x7f1d54146b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:46.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.563+0000 7f1d59624700 1 -- 172.21.15.60:0/3526861225 >> 172.21.15.60:0/3526861225 conn(0x7f1d540c0860 msgr2=0x7f1d540bfa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:46.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.563+0000 7f1d59624700 1 -- 172.21.15.60:0/3526861225 shutdown_connections 2023-07-12T02:02:46.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.563+0000 7f1d59624700 1 -- 172.21.15.60:0/3526861225 wait complete. 2023-07-12T02:02:46.569 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 7 2023-07-12T02:02:46.579 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:02:46.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.700+0000 7f718950a700 1 Processor -- start 2023-07-12T02:02:46.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.701+0000 7f718950a700 1 -- start start 2023-07-12T02:02:46.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.702+0000 7f718950a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f718414aa40 0x7f718414aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:46.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.702+0000 7f718950a700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7184070410 con 0x7f71841444c0 2023-07-12T02:02:46.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.702+0000 7f718950a700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f718414b400 con 0x7f718406b120 2023-07-12T02:02:46.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.702+0000 7f718950a700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71840b9590 con 0x7f718414aa40 2023-07-12T02:02:46.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.702+0000 7f71837fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f71841444c0 0x7f71841448e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48710/0 (socket says 172.21.15.60:48710) 2023-07-12T02:02:46.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.702+0000 7f71837fe700 1 -- 172.21.15.60:0/4066212078 learned_addr learned my addr 172.21.15.60:0/4066212078 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:46.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.702+0000 7f717a7fc700 1 --2- 172.21.15.60:0/4066212078 >> v2:172.21.15.79:3300/0 conn(0x7f718414aa40 0x7f718414aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:46.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.702+0000 7f71827fc700 1 -- 172.21.15.60:0/4066212078 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3470461025 0 0) 0x7f7184070410 con 0x7f71841444c0 2023-07-12T02:02:46.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.702+0000 7f71827fc700 1 -- 172.21.15.60:0/4066212078 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71700035b0 con 0x7f71841444c0 2023-07-12T02:02:46.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.702+0000 7f71827fc700 1 -- 172.21.15.60:0/4066212078 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3832955523 0 0) 0x7f718414b400 con 0x7f718406b120 2023-07-12T02:02:46.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.702+0000 7f71827fc700 1 -- 172.21.15.60:0/4066212078 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7184070410 con 0x7f718406b120 2023-07-12T02:02:46.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.702+0000 7f717a7fc700 1 -- 172.21.15.60:0/4066212078 >> v1:172.21.15.79:6789/0 conn(0x7f718406b120 legacy=0x7f71840b8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:46.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.702+0000 7f717a7fc700 1 -- 172.21.15.60:0/4066212078 >> v1:172.21.15.60:6789/0 conn(0x7f71841444c0 legacy=0x7f71841448e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:46.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.702+0000 7f717a7fc700 1 -- 172.21.15.60:0/4066212078 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f718406ef60 con 0x7f718414aa40 2023-07-12T02:02:46.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.702+0000 7f717a7fc700 1 --2- 172.21.15.60:0/4066212078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f718414aa40 0x7f718414aec0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f716c009840 tx=0x7f716c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb8e5adcefa91ea4 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:46.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.703+0000 7f71827fc700 1 -- 172.21.15.60:0/4066212078 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c011830 con 0x7f718414aa40 2023-07-12T02:02:46.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.703+0000 7f71827fc700 1 -- 172.21.15.60:0/4066212078 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716c011990 con 0x7f718414aa40 2023-07-12T02:02:46.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.703+0000 7f71827fc700 1 -- 172.21.15.60:0/4066212078 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c011d20 con 0x7f718414aa40 2023-07-12T02:02:46.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.703+0000 7f718950a700 1 -- 172.21.15.60:0/4066212078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f718414aa40 msgr2=0x7f718414aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:46.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.703+0000 7f718950a700 1 --2- 172.21.15.60:0/4066212078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f718414aa40 0x7f718414aec0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f716c009840 tx=0x7f716c009b50 comp rx=0 tx=0).stop 2023-07-12T02:02:46.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.703+0000 7f718950a700 1 -- 172.21.15.60:0/4066212078 shutdown_connections 2023-07-12T02:02:46.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.703+0000 7f718950a700 1 --2- 172.21.15.60:0/4066212078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f718414aa40 0x7f718414aec0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:46.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.703+0000 7f718950a700 1 -- 172.21.15.60:0/4066212078 >> 172.21.15.60:0/4066212078 conn(0x7f71840bd980 msgr2=0x7f71840b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:46.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.703+0000 7f718950a700 1 -- 172.21.15.60:0/4066212078 shutdown_connections 2023-07-12T02:02:46.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.703+0000 7f718950a700 1 -- 172.21.15.60:0/4066212078 wait complete. 2023-07-12T02:02:46.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.705+0000 7f718950a700 1 Processor -- start 2023-07-12T02:02:46.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.705+0000 7f718950a700 1 -- start start 2023-07-12T02:02:46.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.706+0000 7f718950a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f718406b120 0x7f718414e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:46.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.706+0000 7f718950a700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71841444c0 0x7f71841e3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:46.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.706+0000 7f718950a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f718414aa40 0x7f71841e0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:46.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.706+0000 7f718950a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71840b4d70 con 0x7f718406b120 2023-07-12T02:02:46.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.706+0000 7f718950a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718414e8e0 con 0x7f718414aa40 2023-07-12T02:02:46.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.706+0000 7f718950a700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f718413f930 con 0x7f71841444c0 2023-07-12T02:02:46.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.706+0000 7f7182ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f718406b120 0x7f718414e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:46.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.706+0000 7f7182ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f718406b120 0x7f718414e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41082/0 (socket says 172.21.15.60:41082) 2023-07-12T02:02:46.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.706+0000 7f7182ffd700 1 -- 172.21.15.60:0/1715163604 learned_addr learned my addr 172.21.15.60:0/1715163604 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:46.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.706+0000 7f717a7fc700 1 --2- 172.21.15.60:0/1715163604 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71841444c0 0x7f71841e3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:46.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.706+0000 7f71837fe700 1 --2- 172.21.15.60:0/1715163604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f718414aa40 0x7f71841e0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:46.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.706+0000 7f7182ffd700 1 -- 172.21.15.60:0/1715163604 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71841444c0 msgr2=0x7f71841e3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:46.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.706+0000 7f7182ffd700 1 --2- 172.21.15.60:0/1715163604 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71841444c0 0x7f71841e3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:46.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.706+0000 7f7182ffd700 1 -- 172.21.15.60:0/1715163604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f718414aa40 msgr2=0x7f71841e0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:46.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.706+0000 7f7182ffd700 1 --2- 172.21.15.60:0/1715163604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f718414aa40 0x7f71841e0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:46.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.706+0000 7f7182ffd700 1 -- 172.21.15.60:0/1715163604 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f716c0094a0 con 0x7f718406b120 2023-07-12T02:02:46.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.706+0000 7f7182ffd700 1 --2- 172.21.15.60:0/1715163604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f718406b120 0x7f718414e3a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f717400c520 tx=0x7f717400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:46.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.706+0000 7f717bfff700 1 -- 172.21.15.60:0/1715163604 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71740052d0 con 0x7f718406b120 2023-07-12T02:02:46.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.706+0000 7f717bfff700 1 -- 172.21.15.60:0/1715163604 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7174005430 con 0x7f718406b120 2023-07-12T02:02:46.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.706+0000 7f717bfff700 1 -- 172.21.15.60:0/1715163604 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71740038c0 con 0x7f718406b120 2023-07-12T02:02:46.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.706+0000 7f718950a700 1 -- 172.21.15.60:0/1715163604 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f718413f650 con 0x7f718406b120 2023-07-12T02:02:46.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.706+0000 7f718950a700 1 -- 172.21.15.60:0/1715163604 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71841e3320 con 0x7f718406b120 2023-07-12T02:02:46.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.707+0000 7f718950a700 1 -- 172.21.15.60:0/1715163604 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7184074360 con 0x7f718406b120 2023-07-12T02:02:46.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.708+0000 7f717bfff700 1 -- 172.21.15.60:0/1715163604 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7174003a20 con 0x7f718406b120 2023-07-12T02:02:46.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.708+0000 7f717bfff700 1 --2- 172.21.15.60:0/1715163604 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f716406ace0 0x7f716406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:46.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.708+0000 7f717bfff700 1 -- 172.21.15.60:0/1715163604 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7174088ae0 con 0x7f718406b120 2023-07-12T02:02:46.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.708+0000 7f717a7fc700 1 --2- 172.21.15.60:0/1715163604 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f716406ace0 0x7f716406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:46.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.709+0000 7f717a7fc700 1 --2- 172.21.15.60:0/1715163604 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f716406ace0 0x7f716406d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f716c009fd0 tx=0x7f716c01c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:46.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.713+0000 7f717bfff700 1 -- 172.21.15.60:0/1715163604 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f7174053b10 con 0x7f718406b120 2023-07-12T02:02:46.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.912+0000 7f718950a700 1 -- 172.21.15.60:0/1715163604 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71840700c0 con 0x7f718406b120 2023-07-12T02:02:46.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.913+0000 7f717bfff700 1 -- 172.21.15.60:0/1715163604 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18173 (secure 0 0 0) 0x7f7174057130 con 0x7f718406b120 2023-07-12T02:02:46.918 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:02:46.918 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":21,"fsid":"97e7c909-e567-472e-a5aa-72fde15171f2","created":"2023-07-12T02:01:53.987086+0000","modified":"2023-07-12T02:02:14.307912+0000","last_up_change":"2023-07-12T02:02:04.031780+0000","last_in_change":"2023-07-12T02:01:56.538621+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-12T02:02:05.375042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-12T02:02:05.857441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:02:10.574633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-12T02:02:11.699872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ed8b71c2-3895-4952-a118-16ede0b4a98c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6801","nonce":2818935979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6803","nonce":2818935979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6807","nonce":2818935979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6805","nonce":2818935979}]},"public_addr":"172.21.15.60:6801/2818935979","cluster_addr":"172.21.15.60:6803/2818935979","heartbeat_back_addr":"172.21.15.60:6807/2818935979","heartbeat_front_addr":"172.21.15.60:6805/2818935979","state":["exists","up"]},{"osd":1,"uuid":"7cf4d354-78e0-43ce-8c09-4a7d2a0b57a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6817","nonce":1678864191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6819","nonce":1678864191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6823","nonce":1678864191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6821","nonce":1678864191}]},"public_addr":"172.21.15.60:6817/1678864191","cluster_addr":"172.21.15.60:6819/1678864191","heartbeat_back_addr":"172.21.15.60:6823/1678864191","heartbeat_front_addr":"172.21.15.60:6821/1678864191","state":["exists","up"]},{"osd":2,"uuid":"02c958b8-9599-4470-92cb-8f7018ec0189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6809","nonce":1459480680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6811","nonce":1459480680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6815","nonce":1459480680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6813","nonce":1459480680}]},"public_addr":"172.21.15.60:6809/1459480680","cluster_addr":"172.21.15.60:6811/1459480680","heartbeat_back_addr":"172.21.15.60:6815/1459480680","heartbeat_front_addr":"172.21.15.60:6813/1459480680","state":["exists","up"]},{"osd":3,"uuid":"bc300432-a228-4257-be5c-e42dd5f2015f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6825","nonce":3295100060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6827","nonce":3295100060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6831","nonce":3295100060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6829","nonce":3295100060}]},"public_addr":"172.21.15.60:6825/3295100060","cluster_addr":"172.21.15.60:6827/3295100060","heartbeat_back_addr":"172.21.15.60:6831/3295100060","heartbeat_front_addr":"172.21.15.60:6829/3295100060","state":["exists","up"]},{"osd":4,"uuid":"ad9f7dc4-7126-466d-a656-2844880c6060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6809","nonce":4127109138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6811","nonce":4127109138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6815","nonce":4127109138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6813","nonce":4127109138}]},"public_addr":"172.21.15.79:6809/4127109138","cluster_addr":"172.21.15.79:6811/4127109138","heartbeat_back_addr":"172.21.15.79:6815/4127109138","heartbeat_front_addr":"172.21.15.79:6813/4127109138","state":["exists","up"]},{"osd":5,"uuid":"e88d16ca-0b01-4ab9-8aa8-c4aff7f210f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6801","nonce":421449406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6803","nonce":421449406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6807","nonce":421449406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6805","nonce":421449406}]},"public_addr":"172.21.15.79:6801/421449406","cluster_addr":"172.21.15.79:6803/421449406","heartbeat_back_addr":"172.21.15.79:6807/421449406","heartbeat_front_addr":"172.21.15.79:6805/421449406","state":["exists","up"]},{"osd":6,"uuid":"6898cb84-56d1-48a9-bd45-97e4668e2fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6825","nonce":4144355139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6827","nonce":4144355139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6831","nonce":4144355139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6829","nonce":4144355139}]},"public_addr":"172.21.15.79:6825/4144355139","cluster_addr":"172.21.15.79:6827/4144355139","heartbeat_back_addr":"172.21.15.79:6831/4144355139","heartbeat_front_addr":"172.21.15.79:6829/4144355139","state":["exists","up"]},{"osd":7,"uuid":"65c10882-371e-4762-b384-9c3a48f332ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6817","nonce":2845223299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6819","nonce":2845223299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6823","nonce":2845223299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6821","nonce":2845223299}]},"public_addr":"172.21.15.79:6817/2845223299","cluster_addr":"172.21.15.79:6819/2845223299","heartbeat_back_addr":"172.21.15.79:6823/2845223299","heartbeat_front_addr":"172.21.15.79:6821/2845223299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.634716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.758349+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.728366+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.777395+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707262+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.649705+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.693021+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:02:46.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.915+0000 7f718950a700 1 -- 172.21.15.60:0/1715163604 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f716406ace0 msgr2=0x7f716406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:46.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.915+0000 7f718950a700 1 --2- 172.21.15.60:0/1715163604 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f716406ace0 0x7f716406d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f716c009fd0 tx=0x7f716c01c040 comp rx=0 tx=0).stop 2023-07-12T02:02:46.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.915+0000 7f718950a700 1 -- 172.21.15.60:0/1715163604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f718406b120 msgr2=0x7f718414e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:46.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.915+0000 7f718950a700 1 --2- 172.21.15.60:0/1715163604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f718406b120 0x7f718414e3a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f717400c520 tx=0x7f717400c8e0 comp rx=0 tx=0).stop 2023-07-12T02:02:46.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.915+0000 7f718950a700 1 -- 172.21.15.60:0/1715163604 shutdown_connections 2023-07-12T02:02:46.920 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.915+0000 7f718950a700 1 --2- 172.21.15.60:0/1715163604 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f716406ace0 0x7f716406d190 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:46.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.915+0000 7f718950a700 1 --2- 172.21.15.60:0/1715163604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f718406b120 0x7f718414e3a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:46.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.915+0000 7f718950a700 1 --2- 172.21.15.60:0/1715163604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f718414aa40 0x7f71841e0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:46.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.916+0000 7f718950a700 1 --2- 172.21.15.60:0/1715163604 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f71841444c0 0x7f71841e3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:46.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.916+0000 7f718950a700 1 -- 172.21.15.60:0/1715163604 >> 172.21.15.60:0/1715163604 conn(0x7f71840bd980 msgr2=0x7f7184071710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:46.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.916+0000 7f718950a700 1 -- 172.21.15.60:0/1715163604 shutdown_connections 2023-07-12T02:02:46.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:46.916+0000 7f718950a700 1 -- 172.21.15.60:0/1715163604 wait complete. 2023-07-12T02:02:46.932 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-12T02:02:46.932 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-12T02:02:47.058 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.054+0000 7f021640d700 1 Processor -- start 2023-07-12T02:02:47.058 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.054+0000 7f021640d700 1 -- start start 2023-07-12T02:02:47.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.054+0000 7f021640d700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f02100b3bf0 0x7f02100b2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:47.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.054+0000 7f021640d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0210071cc0 con 0x7f02100b86d0 2023-07-12T02:02:47.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.054+0000 7f021640d700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0210147800 con 0x7f0210140d20 2023-07-12T02:02:47.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.054+0000 7f021640d700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0210147ae0 con 0x7f02100b3bf0 2023-07-12T02:02:47.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.055+0000 7f02149aa700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f02100b86d0 0x7f0210151400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48720/0 (socket says 172.21.15.60:48720) 2023-07-12T02:02:47.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.055+0000 7f02149aa700 1 -- 172.21.15.60:0/2329608732 learned_addr learned my addr 172.21.15.60:0/2329608732 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:47.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.055+0000 7f020f7fe700 1 --2- 172.21.15.60:0/2329608732 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f02100b3bf0 0x7f02100b2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:47.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.055+0000 7f020effd700 1 -- 172.21.15.60:0/2329608732 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2246349841 0 0) 0x7f0210071cc0 con 0x7f02100b86d0 2023-07-12T02:02:47.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.055+0000 7f020effd700 1 -- 172.21.15.60:0/2329608732 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01fc0035b0 con 0x7f02100b86d0 2023-07-12T02:02:47.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.055+0000 7f020effd700 1 -- 172.21.15.60:0/2329608732 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 598268732 0 0) 0x7f0210147800 con 0x7f0210140d20 2023-07-12T02:02:47.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.055+0000 7f020effd700 1 -- 172.21.15.60:0/2329608732 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0210071cc0 con 0x7f0210140d20 2023-07-12T02:02:47.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.055+0000 7f020effd700 1 -- 172.21.15.60:0/2329608732 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3835389802 0 0) 0x7f01fc0035b0 con 0x7f02100b86d0 2023-07-12T02:02:47.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.055+0000 7f020f7fe700 1 -- 172.21.15.60:0/2329608732 >> v1:172.21.15.79:6789/0 conn(0x7f0210140d20 legacy=0x7f0210147000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:47.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.055+0000 7f020f7fe700 1 -- 172.21.15.60:0/2329608732 >> v1:172.21.15.60:6789/0 conn(0x7f02100b86d0 legacy=0x7f0210151400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:47.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.055+0000 7f020f7fe700 1 -- 172.21.15.60:0/2329608732 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02100b1f00 con 0x7f02100b3bf0 2023-07-12T02:02:47.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.055+0000 7f020f7fe700 1 --2- 172.21.15.60:0/2329608732 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f02100b3bf0 0x7f02100b2700 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0200009870 tx=0x7f0200009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc0a8d6fe1709429 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:47.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.055+0000 7f020effd700 1 -- 172.21.15.60:0/2329608732 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02080019f0 con 0x7f02100b3bf0 2023-07-12T02:02:47.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.056+0000 7f020effd700 1 -- 172.21.15.60:0/2329608732 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0200004030 con 0x7f02100b3bf0 2023-07-12T02:02:47.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.056+0000 7f020effd700 1 -- 172.21.15.60:0/2329608732 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02000043c0 con 0x7f02100b3bf0 2023-07-12T02:02:47.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.056+0000 7f021640d700 1 -- 172.21.15.60:0/2329608732 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f02100b3bf0 msgr2=0x7f02100b2700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:47.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.056+0000 7f021640d700 1 --2- 172.21.15.60:0/2329608732 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f02100b3bf0 0x7f02100b2700 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0200009870 tx=0x7f0200009b80 comp rx=0 tx=0).stop 2023-07-12T02:02:47.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.056+0000 7f021640d700 1 -- 172.21.15.60:0/2329608732 shutdown_connections 2023-07-12T02:02:47.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.056+0000 7f021640d700 1 --2- 172.21.15.60:0/2329608732 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f02100b3bf0 0x7f02100b2700 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:47.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.056+0000 7f021640d700 1 -- 172.21.15.60:0/2329608732 >> 172.21.15.60:0/2329608732 conn(0x7f02100b97c0 msgr2=0x7f02100b9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:47.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.056+0000 7f021640d700 1 -- 172.21.15.60:0/2329608732 shutdown_connections 2023-07-12T02:02:47.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.056+0000 7f021640d700 1 -- 172.21.15.60:0/2329608732 wait complete. 2023-07-12T02:02:47.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.057+0000 7f021640d700 1 Processor -- start 2023-07-12T02:02:47.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.057+0000 7f021640d700 1 -- start start 2023-07-12T02:02:47.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.058+0000 7f021640d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02100b3bf0 0x7f0210145b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:47.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.058+0000 7f021640d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02100b86d0 0x7f0210147f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:47.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.058+0000 7f021640d700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0210140d20 0x7f02101e33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:47.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.058+0000 7f021640d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02100b49c0 con 0x7f02100b3bf0 2023-07-12T02:02:47.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.058+0000 7f021640d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0210146050 con 0x7f02100b86d0 2023-07-12T02:02:47.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.058+0000 7f021640d700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02100b46e0 con 0x7f0210140d20 2023-07-12T02:02:47.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.058+0000 7f020ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02100b3bf0 0x7f0210145b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:47.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.058+0000 7f020ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02100b3bf0 0x7f0210145b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41098/0 (socket says 172.21.15.60:41098) 2023-07-12T02:02:47.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.058+0000 7f020ffff700 1 -- 172.21.15.60:0/2294008689 learned_addr learned my addr 172.21.15.60:0/2294008689 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:47.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.058+0000 7f020f7fe700 1 --2- 172.21.15.60:0/2294008689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02100b86d0 0x7f0210147f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:47.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.058+0000 7f02149aa700 1 --2- 172.21.15.60:0/2294008689 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0210140d20 0x7f02101e33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:47.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.058+0000 7f020ffff700 1 -- 172.21.15.60:0/2294008689 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0210140d20 msgr2=0x7f02101e33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:47.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.058+0000 7f020ffff700 1 --2- 172.21.15.60:0/2294008689 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0210140d20 0x7f02101e33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:47.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.058+0000 7f020ffff700 1 -- 172.21.15.60:0/2294008689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02100b86d0 msgr2=0x7f0210147f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:47.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.058+0000 7f020ffff700 1 --2- 172.21.15.60:0/2294008689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02100b86d0 0x7f0210147f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:47.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.058+0000 7f020ffff700 1 -- 172.21.15.60:0/2294008689 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02000094a0 con 0x7f02100b3bf0 2023-07-12T02:02:47.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.058+0000 7f02149aa700 1 --2- 172.21.15.60:0/2294008689 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0210140d20 0x7f02101e33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:47.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.058+0000 7f020ffff700 1 --2- 172.21.15.60:0/2294008689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02100b3bf0 0x7f0210145b10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f01f800c500 tx=0x7f01f800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:47.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.059+0000 7f020cff9700 1 -- 172.21.15.60:0/2294008689 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f80052d0 con 0x7f02100b3bf0 2023-07-12T02:02:47.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.059+0000 7f020cff9700 1 -- 172.21.15.60:0/2294008689 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f8005450 con 0x7f02100b3bf0 2023-07-12T02:02:47.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.059+0000 7f021640d700 1 -- 172.21.15.60:0/2294008689 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02100b6570 con 0x7f02100b3bf0 2023-07-12T02:02:47.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.059+0000 7f020cff9700 1 -- 172.21.15.60:0/2294008689 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f80038c0 con 0x7f02100b3bf0 2023-07-12T02:02:47.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.059+0000 7f021640d700 1 -- 172.21.15.60:0/2294008689 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02101484a0 con 0x7f02100b3bf0 2023-07-12T02:02:47.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.060+0000 7f021640d700 1 -- 172.21.15.60:0/2294008689 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02100b67b0 con 0x7f02100b3bf0 2023-07-12T02:02:47.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.060+0000 7f020cff9700 1 -- 172.21.15.60:0/2294008689 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f01f8003a20 con 0x7f02100b3bf0 2023-07-12T02:02:47.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.061+0000 7f020cff9700 1 --2- 172.21.15.60:0/2294008689 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f01f006ace0 0x7f01f006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:47.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.061+0000 7f020cff9700 1 -- 172.21.15.60:0/2294008689 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f01f80888c0 con 0x7f02100b3bf0 2023-07-12T02:02:47.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.061+0000 7f020f7fe700 1 --2- 172.21.15.60:0/2294008689 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f01f006ace0 0x7f01f006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:47.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.061+0000 7f020f7fe700 1 --2- 172.21.15.60:0/2294008689 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f01f006ace0 0x7f01f006d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f02000097c0 tx=0x7f0200008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:47.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.065+0000 7f020cff9700 1 -- 172.21.15.60:0/2294008689 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f02100b67b0 con 0x7f02100b3bf0 2023-07-12T02:02:47.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.302+0000 7f021640d700 1 -- 172.21.15.60:0/2294008689 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02100b67b0 con 0x7f02100b3bf0 2023-07-12T02:02:47.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.303+0000 7f020cff9700 1 -- 172.21.15.60:0/2294008689 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3906 (secure 0 0 0) 0x7f02100b67b0 con 0x7f02100b3bf0 2023-07-12T02:02:47.307 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:02:47.307 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2687011977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2687011977},{"type":"v1","addr":"172.21.15.60:6835","nonce":2687011977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/1153134400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1153134400},{"type":"v1","addr":"172.21.15.79:6835","nonce":1153134400}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-12T02:02:12.733570+0000","modified":"2023-07-12T02:02:15.754293+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6833/825430907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":825430907},{"type":"v1","addr":"172.21.15.60:6833","nonce":825430907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-12T02:02:47.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.305+0000 7f021640d700 1 -- 172.21.15.60:0/2294008689 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f01f006ace0 msgr2=0x7f01f006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:47.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.305+0000 7f021640d700 1 --2- 172.21.15.60:0/2294008689 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f01f006ace0 0x7f01f006d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f02000097c0 tx=0x7f0200008030 comp rx=0 tx=0).stop 2023-07-12T02:02:47.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.305+0000 7f021640d700 1 -- 172.21.15.60:0/2294008689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02100b3bf0 msgr2=0x7f0210145b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:47.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.305+0000 7f021640d700 1 --2- 172.21.15.60:0/2294008689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02100b3bf0 0x7f0210145b10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f01f800c500 tx=0x7f01f800c810 comp rx=0 tx=0).stop 2023-07-12T02:02:47.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.305+0000 7f021640d700 1 -- 172.21.15.60:0/2294008689 shutdown_connections 2023-07-12T02:02:47.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.305+0000 7f021640d700 1 --2- 172.21.15.60:0/2294008689 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f01f006ace0 0x7f01f006d190 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:47.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.305+0000 7f021640d700 1 --2- 172.21.15.60:0/2294008689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02100b3bf0 0x7f0210145b10 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:47.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.305+0000 7f021640d700 1 --2- 172.21.15.60:0/2294008689 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0210140d20 0x7f02101e33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:47.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.305+0000 7f021640d700 1 --2- 172.21.15.60:0/2294008689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02100b86d0 0x7f0210147f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:47.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.305+0000 7f021640d700 1 -- 172.21.15.60:0/2294008689 >> 172.21.15.60:0/2294008689 conn(0x7f02100b97c0 msgr2=0x7f0210140290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:47.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.305+0000 7f021640d700 1 -- 172.21.15.60:0/2294008689 shutdown_connections 2023-07-12T02:02:47.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.305+0000 7f021640d700 1 -- 172.21.15.60:0/2294008689 wait complete. 2023-07-12T02:02:47.311 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 7 2023-07-12T02:02:47.321 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-12T02:02:47.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.443+0000 7fbf5661c700 1 Processor -- start 2023-07-12T02:02:47.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.443+0000 7fbf5661c700 1 -- start start 2023-07-12T02:02:47.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.443+0000 7fbf5661c700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf500bc810 0x7fbf500ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:47.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.444+0000 7fbf5661c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbf500b8d90 0x7fbf5006ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:47.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.444+0000 7fbf5661c700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf500b8620 con 0x7fbf501449d0 2023-07-12T02:02:47.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.444+0000 7fbf5661c700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf500b97a0 con 0x7fbf500b8d90 2023-07-12T02:02:47.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.444+0000 7fbf5661c700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf50144da0 con 0x7fbf500bc810 2023-07-12T02:02:47.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.444+0000 7fbf54bb9700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbf500b8d90 0x7fbf5006ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:47.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.444+0000 7fbf4f7fe700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf500bc810 0x7fbf500ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:47.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.444+0000 7fbf54bb9700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbf500b8d90 0x7fbf5006ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.60:54846/0 (socket says 172.21.15.60:54846) 2023-07-12T02:02:47.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.444+0000 7fbf4ffff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fbf501449d0 0x7fbf5014db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.60:34458/0 (socket says 172.21.15.60:34458) 2023-07-12T02:02:47.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.444+0000 7fbf54bb9700 1 -- 172.21.15.60:0/3429292222 learned_addr learned my addr 172.21.15.60:0/3429292222 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:47.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.444+0000 7fbf54bb9700 1 -- 172.21.15.60:0/3429292222 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf500bc810 msgr2=0x7fbf500ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:47.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.444+0000 7fbf54bb9700 1 --2- 172.21.15.60:0/3429292222 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf500bc810 0x7fbf500ba530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:47.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.444+0000 7fbf54bb9700 1 -- 172.21.15.60:0/3429292222 >> v1:172.21.15.79:6789/0 conn(0x7fbf501449d0 legacy=0x7fbf5014db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:47.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.444+0000 7fbf54bb9700 1 -- 172.21.15.60:0/3429292222 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf500b8900 con 0x7fbf500b8d90 2023-07-12T02:02:47.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.444+0000 7fbf4effd700 1 -- 172.21.15.60:0/3429292222 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2133323904 0 0) 0x7fbf500b8620 con 0x7fbf501449d0 2023-07-12T02:02:47.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.444+0000 7fbf4f7fe700 1 --2- 172.21.15.60:0/3429292222 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf500bc810 0x7fbf500ba530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:02:47.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.444+0000 7fbf54bb9700 1 --2- 172.21.15.60:0/3429292222 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf500b8d90 0x7fbf5006ade0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbf48009e50 tx=0x7fbf4800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31742d3c3ebbbf04 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:47.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.445+0000 7fbf4effd700 1 -- 172.21.15.60:0/3429292222 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4800e070 con 0x7fbf500b8d90 2023-07-12T02:02:47.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.445+0000 7fbf4effd700 1 -- 172.21.15.60:0/3429292222 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4800b910 con 0x7fbf500b8d90 2023-07-12T02:02:47.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.445+0000 7fbf4effd700 1 -- 172.21.15.60:0/3429292222 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4800bcc0 con 0x7fbf500b8d90 2023-07-12T02:02:47.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.445+0000 7fbf5661c700 1 -- 172.21.15.60:0/3429292222 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf500b8d90 msgr2=0x7fbf5006ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:47.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.445+0000 7fbf5661c700 1 --2- 172.21.15.60:0/3429292222 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf500b8d90 0x7fbf5006ade0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbf48009e50 tx=0x7fbf4800b330 comp rx=0 tx=0).stop 2023-07-12T02:02:47.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.445+0000 7fbf5661c700 1 -- 172.21.15.60:0/3429292222 shutdown_connections 2023-07-12T02:02:47.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.445+0000 7fbf5661c700 1 --2- 172.21.15.60:0/3429292222 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf500b8d90 0x7fbf5006ade0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:47.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.445+0000 7fbf5661c700 1 --2- 172.21.15.60:0/3429292222 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf500bc810 0x7fbf500ba530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:47.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.445+0000 7fbf5661c700 1 -- 172.21.15.60:0/3429292222 >> 172.21.15.60:0/3429292222 conn(0x7fbf500c0860 msgr2=0x7fbf500c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:47.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.445+0000 7fbf5661c700 1 -- 172.21.15.60:0/3429292222 shutdown_connections 2023-07-12T02:02:47.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.445+0000 7fbf5661c700 1 -- 172.21.15.60:0/3429292222 wait complete. 2023-07-12T02:02:47.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.446+0000 7fbf5661c700 1 Processor -- start 2023-07-12T02:02:47.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.446+0000 7fbf5661c700 1 -- start start 2023-07-12T02:02:47.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.447+0000 7fbf5661c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf500b8d90 0x7fbf501d3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:47.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.447+0000 7fbf5661c700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf500bc810 0x7fbf500b6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:47.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.447+0000 7fbf5661c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf501449d0 0x7fbf500b5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:47.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.447+0000 7fbf5661c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf500b69c0 con 0x7fbf500b8d90 2023-07-12T02:02:47.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.447+0000 7fbf5661c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf500b7470 con 0x7fbf501449d0 2023-07-12T02:02:47.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.447+0000 7fbf5661c700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf501d7350 con 0x7fbf500bc810 2023-07-12T02:02:47.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.447+0000 7fbf4ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf500b8d90 0x7fbf501d3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:47.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.447+0000 7fbf4ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf500b8d90 0x7fbf501d3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58442/0 (socket says 172.21.15.60:58442) 2023-07-12T02:02:47.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.447+0000 7fbf54bb9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf501449d0 0x7fbf500b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:47.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.447+0000 7fbf4ffff700 1 -- 172.21.15.60:0/4015157740 learned_addr learned my addr 172.21.15.60:0/4015157740 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:47.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.447+0000 7fbf4f7fe700 1 --2- 172.21.15.60:0/4015157740 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf500bc810 0x7fbf500b6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:47.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.447+0000 7fbf4ffff700 1 -- 172.21.15.60:0/4015157740 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf500bc810 msgr2=0x7fbf500b6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:47.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.447+0000 7fbf4ffff700 1 --2- 172.21.15.60:0/4015157740 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf500bc810 0x7fbf500b6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:47.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.447+0000 7fbf4ffff700 1 -- 172.21.15.60:0/4015157740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf501449d0 msgr2=0x7fbf500b5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:47.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.448+0000 7fbf4ffff700 1 --2- 172.21.15.60:0/4015157740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf501449d0 0x7fbf500b5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:47.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.448+0000 7fbf4ffff700 1 -- 172.21.15.60:0/4015157740 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf440094a0 con 0x7fbf500b8d90 2023-07-12T02:02:47.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.448+0000 7fbf54bb9700 1 --2- 172.21.15.60:0/4015157740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf501449d0 0x7fbf500b5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:02:47.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.448+0000 7fbf4ffff700 1 --2- 172.21.15.60:0/4015157740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf500b8d90 0x7fbf501d3860 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbf4000c550 tx=0x7fbf4000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:47.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.448+0000 7fbf4cff9700 1 -- 172.21.15.60:0/4015157740 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf40004c80 con 0x7fbf500b8d90 2023-07-12T02:02:47.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.448+0000 7fbf4cff9700 1 -- 172.21.15.60:0/4015157740 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf40004e00 con 0x7fbf500b8d90 2023-07-12T02:02:47.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.448+0000 7fbf5661c700 1 -- 172.21.15.60:0/4015157740 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf48009b30 con 0x7fbf500b8d90 2023-07-12T02:02:47.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.448+0000 7fbf4cff9700 1 -- 172.21.15.60:0/4015157740 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf40007310 con 0x7fbf500b8d90 2023-07-12T02:02:47.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.448+0000 7fbf5661c700 1 -- 172.21.15.60:0/4015157740 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf501d76e0 con 0x7fbf500b8d90 2023-07-12T02:02:47.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.449+0000 7fbf5661c700 1 -- 172.21.15.60:0/4015157740 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf50074360 con 0x7fbf500b8d90 2023-07-12T02:02:47.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.449+0000 7fbf4cff9700 1 -- 172.21.15.60:0/4015157740 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbf40007470 con 0x7fbf500b8d90 2023-07-12T02:02:47.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.450+0000 7fbf4cff9700 1 --2- 172.21.15.60:0/4015157740 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fbf3c06ace0 0x7fbf3c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:47.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.450+0000 7fbf4cff9700 1 -- 172.21.15.60:0/4015157740 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbf40088fe0 con 0x7fbf500b8d90 2023-07-12T02:02:47.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.450+0000 7fbf4f7fe700 1 --2- 172.21.15.60:0/4015157740 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fbf3c06ace0 0x7fbf3c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:47.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.450+0000 7fbf4f7fe700 1 --2- 172.21.15.60:0/4015157740 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fbf3c06ace0 0x7fbf3c06d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbf50147e00 tx=0x7fbf44009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:47.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.454+0000 7fbf4cff9700 1 -- 172.21.15.60:0/4015157740 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fbf40054120 con 0x7fbf500b8d90 2023-07-12T02:02:47.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.693+0000 7fbf5661c700 1 -- 172.21.15.60:0/4015157740 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf500a6960 con 0x7fbf500b8d90 2023-07-12T02:02:47.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.694+0000 7fbf4cff9700 1 -- 172.21.15.60:0/4015157740 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3906 (secure 0 0 0) 0x7fbf40057740 con 0x7fbf500b8d90 2023-07-12T02:02:47.698 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:02:47.698 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2687011977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2687011977},{"type":"v1","addr":"172.21.15.60:6835","nonce":2687011977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/1153134400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1153134400},{"type":"v1","addr":"172.21.15.79:6835","nonce":1153134400}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-12T02:02:12.733570+0000","modified":"2023-07-12T02:02:15.754293+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6833/825430907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":825430907},{"type":"v1","addr":"172.21.15.60:6833","nonce":825430907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-12T02:02:47.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.696+0000 7fbf5661c700 1 -- 172.21.15.60:0/4015157740 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fbf3c06ace0 msgr2=0x7fbf3c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:47.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.696+0000 7fbf5661c700 1 --2- 172.21.15.60:0/4015157740 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fbf3c06ace0 0x7fbf3c06d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbf50147e00 tx=0x7fbf44009210 comp rx=0 tx=0).stop 2023-07-12T02:02:47.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.696+0000 7fbf5661c700 1 -- 172.21.15.60:0/4015157740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf500b8d90 msgr2=0x7fbf501d3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:47.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.696+0000 7fbf5661c700 1 --2- 172.21.15.60:0/4015157740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf500b8d90 0x7fbf501d3860 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbf4000c550 tx=0x7fbf4000c860 comp rx=0 tx=0).stop 2023-07-12T02:02:47.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.696+0000 7fbf5661c700 1 -- 172.21.15.60:0/4015157740 shutdown_connections 2023-07-12T02:02:47.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.696+0000 7fbf5661c700 1 --2- 172.21.15.60:0/4015157740 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fbf3c06ace0 0x7fbf3c06d190 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:47.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.696+0000 7fbf5661c700 1 --2- 172.21.15.60:0/4015157740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf500b8d90 0x7fbf501d3860 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:47.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.696+0000 7fbf5661c700 1 --2- 172.21.15.60:0/4015157740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf501449d0 0x7fbf500b5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:47.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.696+0000 7fbf5661c700 1 --2- 172.21.15.60:0/4015157740 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf500bc810 0x7fbf500b6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:47.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.696+0000 7fbf5661c700 1 -- 172.21.15.60:0/4015157740 >> 172.21.15.60:0/4015157740 conn(0x7fbf500c0860 msgr2=0x7fbf501438e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:47.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.696+0000 7fbf5661c700 1 -- 172.21.15.60:0/4015157740 shutdown_connections 2023-07-12T02:02:47.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.696+0000 7fbf5661c700 1 -- 172.21.15.60:0/4015157740 wait complete. 2023-07-12T02:02:47.702 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 7 2023-07-12T02:02:47.712 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:02:47.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.833+0000 7f8d55f07700 1 Processor -- start 2023-07-12T02:02:47.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.834+0000 7f8d55f07700 1 -- start start 2023-07-12T02:02:47.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.834+0000 7f8d55f07700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d500bc810 0x7f8d500ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:47.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.834+0000 7f8d55f07700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8d500b8d90 0x7f8d5006ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:47.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.834+0000 7f8d55f07700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d500b8620 con 0x7f8d501449d0 2023-07-12T02:02:47.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.834+0000 7f8d55f07700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d500b97a0 con 0x7f8d500b8d90 2023-07-12T02:02:47.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.834+0000 7f8d55f07700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d50144da0 con 0x7f8d500bc810 2023-07-12T02:02:47.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.835+0000 7f8d4effd700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d500bc810 0x7f8d500ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:47.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.835+0000 7f8d4ffff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8d500b8d90 0x7f8d5006ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:47.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.835+0000 7f8d4effd700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d500bc810 0x7f8d500ba530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.60:36180/0 (socket says 172.21.15.60:36180) 2023-07-12T02:02:47.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.835+0000 7f8d4effd700 1 -- 172.21.15.60:0/349806085 learned_addr learned my addr 172.21.15.60:0/349806085 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:47.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.835+0000 7f8d4f7fe700 1 --1- 172.21.15.60:0/349806085 >> v1:172.21.15.79:6789/0 conn(0x7f8d501449d0 0x7f8d5014db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.60:34468/0 (socket says 172.21.15.60:34468) 2023-07-12T02:02:47.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.835+0000 7f8d4effd700 1 -- 172.21.15.60:0/349806085 >> v2:172.21.15.79:3300/0 conn(0x7f8d500b8d90 msgr2=0x7f8d5006ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:47.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.835+0000 7f8d4effd700 1 --2- 172.21.15.60:0/349806085 >> v2:172.21.15.79:3300/0 conn(0x7f8d500b8d90 0x7f8d5006ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:47.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.835+0000 7f8d4effd700 1 -- 172.21.15.60:0/349806085 >> v1:172.21.15.79:6789/0 conn(0x7f8d501449d0 legacy=0x7f8d5014db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:47.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.835+0000 7f8d4effd700 1 -- 172.21.15.60:0/349806085 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d500b8900 con 0x7f8d500bc810 2023-07-12T02:02:47.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.835+0000 7f8d4ffff700 1 --2- 172.21.15.60:0/349806085 >> v2:172.21.15.79:3300/0 conn(0x7f8d500b8d90 0x7f8d5006ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:02:47.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.835+0000 7f8d4effd700 1 --2- 172.21.15.60:0/349806085 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d500bc810 0x7f8d500ba530 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8d380098f0 tx=0x7f8d38009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2c4119941b20b8e server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:47.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.835+0000 7f8d4e7fc700 1 -- 172.21.15.60:0/349806085 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d38011830 con 0x7f8d500bc810 2023-07-12T02:02:47.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.835+0000 7f8d4e7fc700 1 -- 172.21.15.60:0/349806085 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d38011990 con 0x7f8d500bc810 2023-07-12T02:02:47.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.835+0000 7f8d4e7fc700 1 -- 172.21.15.60:0/349806085 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d38011d20 con 0x7f8d500bc810 2023-07-12T02:02:47.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.836+0000 7f8d55f07700 1 -- 172.21.15.60:0/349806085 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d500bc810 msgr2=0x7f8d500ba530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:47.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.836+0000 7f8d55f07700 1 --2- 172.21.15.60:0/349806085 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d500bc810 0x7f8d500ba530 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8d380098f0 tx=0x7f8d38009c00 comp rx=0 tx=0).stop 2023-07-12T02:02:47.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.836+0000 7f8d55f07700 1 -- 172.21.15.60:0/349806085 shutdown_connections 2023-07-12T02:02:47.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.836+0000 7f8d55f07700 1 --2- 172.21.15.60:0/349806085 >> v2:172.21.15.79:3300/0 conn(0x7f8d500b8d90 0x7f8d5006ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:47.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.836+0000 7f8d55f07700 1 --2- 172.21.15.60:0/349806085 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d500bc810 0x7f8d500ba530 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:47.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.836+0000 7f8d55f07700 1 -- 172.21.15.60:0/349806085 >> 172.21.15.60:0/349806085 conn(0x7f8d500c0860 msgr2=0x7f8d500c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:47.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.836+0000 7f8d55f07700 1 -- 172.21.15.60:0/349806085 shutdown_connections 2023-07-12T02:02:47.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.836+0000 7f8d55f07700 1 -- 172.21.15.60:0/349806085 wait complete. 2023-07-12T02:02:47.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.837+0000 7f8d55f07700 1 Processor -- start 2023-07-12T02:02:47.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.837+0000 7f8d55f07700 1 -- start start 2023-07-12T02:02:47.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.838+0000 7f8d55f07700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d500b8d90 0x7f8d50146930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:47.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.838+0000 7f8d55f07700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d500bc810 0x7f8d50147760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:47.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.838+0000 7f8d55f07700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d501449d0 0x7f8d5014a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:47.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.838+0000 7f8d55f07700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d50147f80 con 0x7f8d501449d0 2023-07-12T02:02:47.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.838+0000 7f8d55f07700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d501452c0 con 0x7f8d500bc810 2023-07-12T02:02:47.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.838+0000 7f8d55f07700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d501455a0 con 0x7f8d500b8d90 2023-07-12T02:02:47.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.838+0000 7f8d4ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d501449d0 0x7f8d5014a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:47.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.838+0000 7f8d4ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d501449d0 0x7f8d5014a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58450/0 (socket says 172.21.15.60:58450) 2023-07-12T02:02:47.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.838+0000 7f8d4ffff700 1 -- 172.21.15.60:0/2160701329 learned_addr learned my addr 172.21.15.60:0/2160701329 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:47.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.838+0000 7f8d4f7fe700 1 --2- 172.21.15.60:0/2160701329 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d500b8d90 0x7f8d50146930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:47.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.838+0000 7f8d4effd700 1 --2- 172.21.15.60:0/2160701329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d500bc810 0x7f8d50147760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:47.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.838+0000 7f8d4ffff700 1 -- 172.21.15.60:0/2160701329 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d500b8d90 msgr2=0x7f8d50146930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:47.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.838+0000 7f8d4ffff700 1 --2- 172.21.15.60:0/2160701329 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d500b8d90 0x7f8d50146930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:47.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.838+0000 7f8d4ffff700 1 -- 172.21.15.60:0/2160701329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d500bc810 msgr2=0x7f8d50147760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:47.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.838+0000 7f8d4ffff700 1 --2- 172.21.15.60:0/2160701329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d500bc810 0x7f8d50147760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:47.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.838+0000 7f8d4ffff700 1 -- 172.21.15.60:0/2160701329 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d48009a70 con 0x7f8d501449d0 2023-07-12T02:02:47.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.838+0000 7f8d4ffff700 1 --2- 172.21.15.60:0/2160701329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d501449d0 0x7f8d5014a2b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8d4800efc0 tx=0x7f8d4800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:47.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.838+0000 7f8d47fff700 1 -- 172.21.15.60:0/2160701329 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4800ca90 con 0x7f8d501449d0 2023-07-12T02:02:47.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.838+0000 7f8d47fff700 1 -- 172.21.15.60:0/2160701329 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4800f040 con 0x7f8d501449d0 2023-07-12T02:02:47.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.839+0000 7f8d55f07700 1 -- 172.21.15.60:0/2160701329 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d38009550 con 0x7f8d501449d0 2023-07-12T02:02:47.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.839+0000 7f8d47fff700 1 -- 172.21.15.60:0/2160701329 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4800ce10 con 0x7f8d501449d0 2023-07-12T02:02:47.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.839+0000 7f8d55f07700 1 -- 172.21.15.60:0/2160701329 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d50147ca0 con 0x7f8d501449d0 2023-07-12T02:02:47.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.840+0000 7f8d55f07700 1 -- 172.21.15.60:0/2160701329 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d50146590 con 0x7f8d501449d0 2023-07-12T02:02:47.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.840+0000 7f8d47fff700 1 -- 172.21.15.60:0/2160701329 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8d48014480 con 0x7f8d501449d0 2023-07-12T02:02:47.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.840+0000 7f8d47fff700 1 --2- 172.21.15.60:0/2160701329 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f8d3006ace0 0x7f8d3006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:47.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.841+0000 7f8d47fff700 1 -- 172.21.15.60:0/2160701329 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8d48089ad0 con 0x7f8d501449d0 2023-07-12T02:02:47.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.841+0000 7f8d4f7fe700 1 --2- 172.21.15.60:0/2160701329 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f8d3006ace0 0x7f8d3006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:47.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.841+0000 7f8d4f7fe700 1 --2- 172.21.15.60:0/2160701329 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f8d3006ace0 0x7f8d3006d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8d40000f60 tx=0x7f8d40007ed0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:47.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:47.845+0000 7f8d47fff700 1 -- 172.21.15.60:0/2160701329 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f8d50146590 con 0x7f8d501449d0 2023-07-12T02:02:48.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.045+0000 7f8d55f07700 1 -- 172.21.15.60:0/2160701329 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d50145ac0 con 0x7f8d501449d0 2023-07-12T02:02:48.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.046+0000 7f8d47fff700 1 -- 172.21.15.60:0/2160701329 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18173 (secure 0 0 0) 0x7f8d50145ac0 con 0x7f8d501449d0 2023-07-12T02:02:48.050 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:02:48.050 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":21,"fsid":"97e7c909-e567-472e-a5aa-72fde15171f2","created":"2023-07-12T02:01:53.987086+0000","modified":"2023-07-12T02:02:14.307912+0000","last_up_change":"2023-07-12T02:02:04.031780+0000","last_in_change":"2023-07-12T02:01:56.538621+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-12T02:02:05.375042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-12T02:02:05.857441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:02:10.574633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-12T02:02:11.699872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ed8b71c2-3895-4952-a118-16ede0b4a98c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6801","nonce":2818935979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6803","nonce":2818935979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6807","nonce":2818935979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6805","nonce":2818935979}]},"public_addr":"172.21.15.60:6801/2818935979","cluster_addr":"172.21.15.60:6803/2818935979","heartbeat_back_addr":"172.21.15.60:6807/2818935979","heartbeat_front_addr":"172.21.15.60:6805/2818935979","state":["exists","up"]},{"osd":1,"uuid":"7cf4d354-78e0-43ce-8c09-4a7d2a0b57a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6817","nonce":1678864191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6819","nonce":1678864191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6823","nonce":1678864191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6821","nonce":1678864191}]},"public_addr":"172.21.15.60:6817/1678864191","cluster_addr":"172.21.15.60:6819/1678864191","heartbeat_back_addr":"172.21.15.60:6823/1678864191","heartbeat_front_addr":"172.21.15.60:6821/1678864191","state":["exists","up"]},{"osd":2,"uuid":"02c958b8-9599-4470-92cb-8f7018ec0189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6809","nonce":1459480680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6811","nonce":1459480680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6815","nonce":1459480680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6813","nonce":1459480680}]},"public_addr":"172.21.15.60:6809/1459480680","cluster_addr":"172.21.15.60:6811/1459480680","heartbeat_back_addr":"172.21.15.60:6815/1459480680","heartbeat_front_addr":"172.21.15.60:6813/1459480680","state":["exists","up"]},{"osd":3,"uuid":"bc300432-a228-4257-be5c-e42dd5f2015f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6825","nonce":3295100060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6827","nonce":3295100060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6831","nonce":3295100060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6829","nonce":3295100060}]},"public_addr":"172.21.15.60:6825/3295100060","cluster_addr":"172.21.15.60:6827/3295100060","heartbeat_back_addr":"172.21.15.60:6831/3295100060","heartbeat_front_addr":"172.21.15.60:6829/3295100060","state":["exists","up"]},{"osd":4,"uuid":"ad9f7dc4-7126-466d-a656-2844880c6060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6809","nonce":4127109138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6811","nonce":4127109138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6815","nonce":4127109138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6813","nonce":4127109138}]},"public_addr":"172.21.15.79:6809/4127109138","cluster_addr":"172.21.15.79:6811/4127109138","heartbeat_back_addr":"172.21.15.79:6815/4127109138","heartbeat_front_addr":"172.21.15.79:6813/4127109138","state":["exists","up"]},{"osd":5,"uuid":"e88d16ca-0b01-4ab9-8aa8-c4aff7f210f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6801","nonce":421449406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6803","nonce":421449406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6807","nonce":421449406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6805","nonce":421449406}]},"public_addr":"172.21.15.79:6801/421449406","cluster_addr":"172.21.15.79:6803/421449406","heartbeat_back_addr":"172.21.15.79:6807/421449406","heartbeat_front_addr":"172.21.15.79:6805/421449406","state":["exists","up"]},{"osd":6,"uuid":"6898cb84-56d1-48a9-bd45-97e4668e2fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6825","nonce":4144355139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6827","nonce":4144355139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6831","nonce":4144355139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6829","nonce":4144355139}]},"public_addr":"172.21.15.79:6825/4144355139","cluster_addr":"172.21.15.79:6827/4144355139","heartbeat_back_addr":"172.21.15.79:6831/4144355139","heartbeat_front_addr":"172.21.15.79:6829/4144355139","state":["exists","up"]},{"osd":7,"uuid":"65c10882-371e-4762-b384-9c3a48f332ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6817","nonce":2845223299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6819","nonce":2845223299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6823","nonce":2845223299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6821","nonce":2845223299}]},"public_addr":"172.21.15.79:6817/2845223299","cluster_addr":"172.21.15.79:6819/2845223299","heartbeat_back_addr":"172.21.15.79:6823/2845223299","heartbeat_front_addr":"172.21.15.79:6821/2845223299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.634716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.758349+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.728366+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.777395+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707262+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.649705+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.693021+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:02:48.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.048+0000 7f8d55f07700 1 -- 172.21.15.60:0/2160701329 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f8d3006ace0 msgr2=0x7f8d3006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:48.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.048+0000 7f8d55f07700 1 --2- 172.21.15.60:0/2160701329 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f8d3006ace0 0x7f8d3006d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8d40000f60 tx=0x7f8d40007ed0 comp rx=0 tx=0).stop 2023-07-12T02:02:48.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.048+0000 7f8d55f07700 1 -- 172.21.15.60:0/2160701329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d501449d0 msgr2=0x7f8d5014a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:48.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.048+0000 7f8d55f07700 1 --2- 172.21.15.60:0/2160701329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d501449d0 0x7f8d5014a2b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8d4800efc0 tx=0x7f8d4800c3a0 comp rx=0 tx=0).stop 2023-07-12T02:02:48.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.048+0000 7f8d55f07700 1 -- 172.21.15.60:0/2160701329 shutdown_connections 2023-07-12T02:02:48.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.048+0000 7f8d55f07700 1 --2- 172.21.15.60:0/2160701329 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f8d3006ace0 0x7f8d3006d190 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:48.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.048+0000 7f8d55f07700 1 --2- 172.21.15.60:0/2160701329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d501449d0 0x7f8d5014a2b0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:48.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.048+0000 7f8d55f07700 1 --2- 172.21.15.60:0/2160701329 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d500b8d90 0x7f8d50146930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:48.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.048+0000 7f8d55f07700 1 --2- 172.21.15.60:0/2160701329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d500bc810 0x7f8d50147760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:48.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.048+0000 7f8d55f07700 1 -- 172.21.15.60:0/2160701329 >> 172.21.15.60:0/2160701329 conn(0x7f8d500c0860 msgr2=0x7f8d500baeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:48.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.048+0000 7f8d55f07700 1 -- 172.21.15.60:0/2160701329 shutdown_connections 2023-07-12T02:02:48.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.048+0000 7f8d55f07700 1 -- 172.21.15.60:0/2160701329 wait complete. 2023-07-12T02:02:48.064 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-12T02:02:48.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.187+0000 7f491daa0700 1 Processor -- start 2023-07-12T02:02:48.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.187+0000 7f491daa0700 1 -- start start 2023-07-12T02:02:48.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.188+0000 7f491daa0700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f491814aa40 0x7f491814aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:48.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.188+0000 7f491daa0700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49181444c0 0x7f4918144920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:48.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.188+0000 7f491daa0700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4918070410 con 0x7f491806b120 2023-07-12T02:02:48.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.188+0000 7f491daa0700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49180b9590 con 0x7f491814aa40 2023-07-12T02:02:48.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.188+0000 7f491daa0700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f491814b400 con 0x7f49181444c0 2023-07-12T02:02:48.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.188+0000 7f49177fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f491806b120 0x7f49180b8cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60500/0 (socket says 172.21.15.60:60500) 2023-07-12T02:02:48.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.188+0000 7f49177fe700 1 -- 172.21.15.60:0/1915491252 learned_addr learned my addr 172.21.15.60:0/1915491252 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:48.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.188+0000 7f490ffff700 1 --2- 172.21.15.60:0/1915491252 >> v2:172.21.15.60:3300/0 conn(0x7f491814aa40 0x7f491814aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:48.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.188+0000 7f4916ffd700 1 -- 172.21.15.60:0/1915491252 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1129634430 0 0) 0x7f4918070410 con 0x7f491806b120 2023-07-12T02:02:48.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.188+0000 7f4917fff700 1 --2- 172.21.15.60:0/1915491252 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49181444c0 0x7f4918144920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:48.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.188+0000 7f4916ffd700 1 -- 172.21.15.60:0/1915491252 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49040035b0 con 0x7f491806b120 2023-07-12T02:02:48.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.188+0000 7f490ffff700 1 -- 172.21.15.60:0/1915491252 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49181444c0 msgr2=0x7f4918144920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:48.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.188+0000 7f490ffff700 1 --2- 172.21.15.60:0/1915491252 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49181444c0 0x7f4918144920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:48.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.188+0000 7f490ffff700 1 -- 172.21.15.60:0/1915491252 >> v1:172.21.15.60:6789/0 conn(0x7f491806b120 legacy=0x7f49180b8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:48.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.188+0000 7f490ffff700 1 -- 172.21.15.60:0/1915491252 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491806ef60 con 0x7f491814aa40 2023-07-12T02:02:48.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.188+0000 7f4917fff700 1 --2- 172.21.15.60:0/1915491252 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49181444c0 0x7f4918144920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:02:48.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.189+0000 7f490ffff700 1 --2- 172.21.15.60:0/1915491252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f491814aa40 0x7f491814aec0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4900009840 tx=0x7f4900009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1105b038d4d26e97 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:48.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.189+0000 7f4916ffd700 1 -- 172.21.15.60:0/1915491252 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4900011830 con 0x7f491814aa40 2023-07-12T02:02:48.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.189+0000 7f4916ffd700 1 -- 172.21.15.60:0/1915491252 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4900011990 con 0x7f491814aa40 2023-07-12T02:02:48.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.189+0000 7f4916ffd700 1 -- 172.21.15.60:0/1915491252 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4900011d20 con 0x7f491814aa40 2023-07-12T02:02:48.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.189+0000 7f491daa0700 1 -- 172.21.15.60:0/1915491252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f491814aa40 msgr2=0x7f491814aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:48.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.189+0000 7f491daa0700 1 --2- 172.21.15.60:0/1915491252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f491814aa40 0x7f491814aec0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4900009840 tx=0x7f4900009b50 comp rx=0 tx=0).stop 2023-07-12T02:02:48.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.189+0000 7f491daa0700 1 -- 172.21.15.60:0/1915491252 shutdown_connections 2023-07-12T02:02:48.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.189+0000 7f491daa0700 1 --2- 172.21.15.60:0/1915491252 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49181444c0 0x7f4918144920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:48.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.189+0000 7f491daa0700 1 --2- 172.21.15.60:0/1915491252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f491814aa40 0x7f491814aec0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:48.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.189+0000 7f491daa0700 1 -- 172.21.15.60:0/1915491252 >> 172.21.15.60:0/1915491252 conn(0x7f49180bd980 msgr2=0x7f49180b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:48.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.189+0000 7f491daa0700 1 -- 172.21.15.60:0/1915491252 shutdown_connections 2023-07-12T02:02:48.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.189+0000 7f491daa0700 1 -- 172.21.15.60:0/1915491252 wait complete. 2023-07-12T02:02:48.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.190+0000 7f491daa0700 1 Processor -- start 2023-07-12T02:02:48.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.191+0000 7f491daa0700 1 -- start start 2023-07-12T02:02:48.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.191+0000 7f491daa0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f491806b120 0x7f49180b57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:48.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.191+0000 7f491daa0700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49181444c0 0x7f49181e0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:48.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.191+0000 7f491daa0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f491814aa40 0x7f49181e06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:48.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.191+0000 7f491daa0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49180b6d70 con 0x7f491814aa40 2023-07-12T02:02:48.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.191+0000 7f491daa0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49180b40e0 con 0x7f491806b120 2023-07-12T02:02:48.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.191+0000 7f491daa0700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49180b4330 con 0x7f49181444c0 2023-07-12T02:02:48.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.191+0000 7f4917fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f491814aa40 0x7f49181e06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:48.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.191+0000 7f4917fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f491814aa40 0x7f49181e06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58456/0 (socket says 172.21.15.60:58456) 2023-07-12T02:02:48.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.191+0000 7f4917fff700 1 -- 172.21.15.60:0/108991401 learned_addr learned my addr 172.21.15.60:0/108991401 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:48.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.191+0000 7f49177fe700 1 --2- 172.21.15.60:0/108991401 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f491806b120 0x7f49180b57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:48.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.191+0000 7f490ffff700 1 --2- 172.21.15.60:0/108991401 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49181444c0 0x7f49181e0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:48.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.192+0000 7f4917fff700 1 -- 172.21.15.60:0/108991401 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49181444c0 msgr2=0x7f49181e0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:48.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.192+0000 7f4917fff700 1 --2- 172.21.15.60:0/108991401 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49181444c0 0x7f49181e0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:48.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.192+0000 7f4917fff700 1 -- 172.21.15.60:0/108991401 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f491806b120 msgr2=0x7f49180b57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:48.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.192+0000 7f4917fff700 1 --2- 172.21.15.60:0/108991401 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f491806b120 0x7f49180b57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:48.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.192+0000 7f4917fff700 1 -- 172.21.15.60:0/108991401 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49000094a0 con 0x7f491814aa40 2023-07-12T02:02:48.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.192+0000 7f490ffff700 1 --2- 172.21.15.60:0/108991401 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49181444c0 0x7f49181e0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:02:48.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.192+0000 7f4917fff700 1 --2- 172.21.15.60:0/108991401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f491814aa40 0x7f49181e06c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f491000cef0 tx=0x7f491000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:48.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.192+0000 7f4914ff9700 1 -- 172.21.15.60:0/108991401 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491000ae50 con 0x7f491814aa40 2023-07-12T02:02:48.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.192+0000 7f4914ff9700 1 -- 172.21.15.60:0/108991401 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4910015440 con 0x7f491814aa40 2023-07-12T02:02:48.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.192+0000 7f491daa0700 1 -- 172.21.15.60:0/108991401 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49180b6080 con 0x7f491814aa40 2023-07-12T02:02:48.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.192+0000 7f4914ff9700 1 -- 172.21.15.60:0/108991401 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49100157f0 con 0x7f491814aa40 2023-07-12T02:02:48.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.192+0000 7f491daa0700 1 -- 172.21.15.60:0/108991401 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49180b63f0 con 0x7f491814aa40 2023-07-12T02:02:48.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.193+0000 7f491daa0700 1 -- 172.21.15.60:0/108991401 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f491806da40 con 0x7f491814aa40 2023-07-12T02:02:48.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.194+0000 7f4914ff9700 1 -- 172.21.15.60:0/108991401 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f491000d430 con 0x7f491814aa40 2023-07-12T02:02:48.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.194+0000 7f4914ff9700 1 --2- 172.21.15.60:0/108991401 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f48f806ace0 0x7f48f806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:48.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.194+0000 7f4914ff9700 1 -- 172.21.15.60:0/108991401 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4910089a50 con 0x7f491814aa40 2023-07-12T02:02:48.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.194+0000 7f49177fe700 1 --2- 172.21.15.60:0/108991401 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f48f806ace0 0x7f48f806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:48.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.195+0000 7f49177fe700 1 --2- 172.21.15.60:0/108991401 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f48f806ace0 0x7f48f806d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f49080011e0 tx=0x7f4908009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:48.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.199+0000 7f4914ff9700 1 -- 172.21.15.60:0/108991401 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f4910054b90 con 0x7f491814aa40 2023-07-12T02:02:48.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.438+0000 7f491daa0700 1 -- 172.21.15.60:0/108991401 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4918074360 con 0x7f491814aa40 2023-07-12T02:02:48.442 INFO:tasks.ceph.mon.a.smithi060.stderr:2023-07-12T02:02:48.439+0000 7fa5a1c4b700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-12T02:02:48.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.443+0000 7f4914ff9700 1 -- 172.21.15.60:0/108991401 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7f491001a090 con 0x7f491814aa40 2023-07-12T02:02:48.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.445+0000 7f491daa0700 1 -- 172.21.15.60:0/108991401 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f48f806ace0 msgr2=0x7f48f806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:48.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.445+0000 7f491daa0700 1 --2- 172.21.15.60:0/108991401 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f48f806ace0 0x7f48f806d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f49080011e0 tx=0x7f4908009040 comp rx=0 tx=0).stop 2023-07-12T02:02:48.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.445+0000 7f491daa0700 1 -- 172.21.15.60:0/108991401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f491814aa40 msgr2=0x7f49181e06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:48.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.445+0000 7f491daa0700 1 --2- 172.21.15.60:0/108991401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f491814aa40 0x7f49181e06c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f491000cef0 tx=0x7f491000a340 comp rx=0 tx=0).stop 2023-07-12T02:02:48.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.445+0000 7f491daa0700 1 -- 172.21.15.60:0/108991401 shutdown_connections 2023-07-12T02:02:48.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.445+0000 7f491daa0700 1 --2- 172.21.15.60:0/108991401 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f48f806ace0 0x7f48f806d190 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:48.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.445+0000 7f491daa0700 1 --2- 172.21.15.60:0/108991401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f491814aa40 0x7f49181e06c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:48.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.445+0000 7f491daa0700 1 --2- 172.21.15.60:0/108991401 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f491806b120 0x7f49180b57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:48.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.445+0000 7f491daa0700 1 --2- 172.21.15.60:0/108991401 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49181444c0 0x7f49181e0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:48.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.445+0000 7f491daa0700 1 -- 172.21.15.60:0/108991401 >> 172.21.15.60:0/108991401 conn(0x7f49180bd980 msgr2=0x7f49180714d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:48.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.446+0000 7f491daa0700 1 -- 172.21.15.60:0/108991401 shutdown_connections 2023-07-12T02:02:48.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.446+0000 7f491daa0700 1 -- 172.21.15.60:0/108991401 wait complete. 2023-07-12T02:02:48.451 INFO:teuthology.orchestra.run.smithi060.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-12T02:02:48.452 INFO:tasks.ceph.mds.a.smithi060.stderr: -7856> 2023-07-12T02:02:18.405+0000 7f142f728700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-12T02:02:48.462 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-12T02:02:48.484 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2023-07-12T02:02:48.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.587+0000 7fe5725d8700 1 Processor -- start 2023-07-12T02:02:48.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.587+0000 7fe5725d8700 1 -- start start 2023-07-12T02:02:48.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.588+0000 7fe5725d8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe56c1449d0 0x7fe56c14db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:48.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.588+0000 7fe5725d8700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe56c0b8d90 0x7fe56c06ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:48.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.588+0000 7fe5725d8700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe56c0b8620 con 0x7fe56c0bc810 2023-07-12T02:02:48.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.588+0000 7fe5725d8700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe56c0b97a0 con 0x7fe56c1449d0 2023-07-12T02:02:48.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.588+0000 7fe5725d8700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c144da0 con 0x7fe56c0b8d90 2023-07-12T02:02:48.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.588+0000 7fe56b7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe56c0bc810 0x7fe56c0ba530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60516/0 (socket says 172.21.15.60:60516) 2023-07-12T02:02:48.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.588+0000 7fe56b7fe700 1 -- 172.21.15.60:0/307526520 learned_addr learned my addr 172.21.15.60:0/307526520 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:48.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.588+0000 7fe56bfff700 1 --2- 172.21.15.60:0/307526520 >> v2:172.21.15.79:3300/0 conn(0x7fe56c1449d0 0x7fe56c14db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:48.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.588+0000 7fe570b75700 1 --2- 172.21.15.60:0/307526520 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe56c0b8d90 0x7fe56c06ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:48.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.588+0000 7fe56affd700 1 -- 172.21.15.60:0/307526520 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 811855715 0 0) 0x7fe56c0b8620 con 0x7fe56c0bc810 2023-07-12T02:02:48.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.588+0000 7fe56affd700 1 -- 172.21.15.60:0/307526520 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5540035b0 con 0x7fe56c0bc810 2023-07-12T02:02:48.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.588+0000 7fe56affd700 1 -- 172.21.15.60:0/307526520 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1628729361 0 0) 0x7fe5540035b0 con 0x7fe56c0bc810 2023-07-12T02:02:48.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.588+0000 7fe56bfff700 1 -- 172.21.15.60:0/307526520 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe56c0b8d90 msgr2=0x7fe56c06ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:48.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.588+0000 7fe56bfff700 1 --2- 172.21.15.60:0/307526520 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe56c0b8d90 0x7fe56c06ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:48.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.588+0000 7fe56bfff700 1 -- 172.21.15.60:0/307526520 >> v1:172.21.15.60:6789/0 conn(0x7fe56c0bc810 legacy=0x7fe56c0ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:48.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.588+0000 7fe56bfff700 1 -- 172.21.15.60:0/307526520 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe56c0b8900 con 0x7fe56c1449d0 2023-07-12T02:02:48.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.589+0000 7fe56bfff700 1 --2- 172.21.15.60:0/307526520 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe56c1449d0 0x7fe56c14db50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe55c009840 tx=0x7fe55c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7ecc597d391b662 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:48.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.589+0000 7fe56affd700 1 -- 172.21.15.60:0/307526520 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe560001670 con 0x7fe56c1449d0 2023-07-12T02:02:48.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.589+0000 7fe56affd700 1 -- 172.21.15.60:0/307526520 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55c004030 con 0x7fe56c1449d0 2023-07-12T02:02:48.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.589+0000 7fe56affd700 1 -- 172.21.15.60:0/307526520 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c0043a0 con 0x7fe56c1449d0 2023-07-12T02:02:48.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.589+0000 7fe5725d8700 1 -- 172.21.15.60:0/307526520 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe56c1449d0 msgr2=0x7fe56c14db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:48.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.589+0000 7fe5725d8700 1 --2- 172.21.15.60:0/307526520 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe56c1449d0 0x7fe56c14db50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe55c009840 tx=0x7fe55c009b50 comp rx=0 tx=0).stop 2023-07-12T02:02:48.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.589+0000 7fe5725d8700 1 -- 172.21.15.60:0/307526520 shutdown_connections 2023-07-12T02:02:48.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.589+0000 7fe5725d8700 1 --2- 172.21.15.60:0/307526520 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe56c0b8d90 0x7fe56c06ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:48.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.589+0000 7fe5725d8700 1 --2- 172.21.15.60:0/307526520 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe56c1449d0 0x7fe56c14db50 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:48.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.589+0000 7fe5725d8700 1 -- 172.21.15.60:0/307526520 >> 172.21.15.60:0/307526520 conn(0x7fe56c0c0860 msgr2=0x7fe56c0c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:48.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.589+0000 7fe5725d8700 1 -- 172.21.15.60:0/307526520 shutdown_connections 2023-07-12T02:02:48.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.589+0000 7fe5725d8700 1 -- 172.21.15.60:0/307526520 wait complete. 2023-07-12T02:02:48.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.590+0000 7fe5725d8700 1 Processor -- start 2023-07-12T02:02:48.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.591+0000 7fe5725d8700 1 -- start start 2023-07-12T02:02:48.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.591+0000 7fe5725d8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe56c0b8d90 0x7fe56c0b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:48.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.591+0000 7fe5725d8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe56c0bc810 0x7fe56c149440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:48.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.591+0000 7fe5725d8700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe56c1449d0 0x7fe56c0b2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:48.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.591+0000 7fe5725d8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c0b2e40 con 0x7fe56c0bc810 2023-07-12T02:02:48.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.591+0000 7fe5725d8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c0b24b0 con 0x7fe56c0b8d90 2023-07-12T02:02:48.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.591+0000 7fe5725d8700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c14ae90 con 0x7fe56c1449d0 2023-07-12T02:02:48.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.591+0000 7fe56b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe56c0bc810 0x7fe56c149440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:48.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.591+0000 7fe56b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe56c0bc810 0x7fe56c149440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58478/0 (socket says 172.21.15.60:58478) 2023-07-12T02:02:48.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.591+0000 7fe56b7fe700 1 -- 172.21.15.60:0/870263766 learned_addr learned my addr 172.21.15.60:0/870263766 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:48.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.591+0000 7fe56bfff700 1 --2- 172.21.15.60:0/870263766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe56c0b8d90 0x7fe56c0b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:48.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.592+0000 7fe570b75700 1 --2- 172.21.15.60:0/870263766 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe56c1449d0 0x7fe56c0b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:48.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.592+0000 7fe56b7fe700 1 -- 172.21.15.60:0/870263766 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe56c1449d0 msgr2=0x7fe56c0b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:48.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.592+0000 7fe56b7fe700 1 --2- 172.21.15.60:0/870263766 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe56c1449d0 0x7fe56c0b2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:48.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.592+0000 7fe56b7fe700 1 -- 172.21.15.60:0/870263766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe56c0b8d90 msgr2=0x7fe56c0b1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:48.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.592+0000 7fe56b7fe700 1 --2- 172.21.15.60:0/870263766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe56c0b8d90 0x7fe56c0b1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:48.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.592+0000 7fe56b7fe700 1 -- 172.21.15.60:0/870263766 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe55c0094a0 con 0x7fe56c0bc810 2023-07-12T02:02:48.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.592+0000 7fe570b75700 1 --2- 172.21.15.60:0/870263766 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe56c1449d0 0x7fe56c0b2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:02:48.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.592+0000 7fe56bfff700 1 --2- 172.21.15.60:0/870263766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe56c0b8d90 0x7fe56c0b1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:48.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.592+0000 7fe56b7fe700 1 --2- 172.21.15.60:0/870263766 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe56c0bc810 0x7fe56c149440 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe56000c770 tx=0x7fe56000cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:48.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.592+0000 7fe568ff9700 1 -- 172.21.15.60:0/870263766 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe560007560 con 0x7fe56c0bc810 2023-07-12T02:02:48.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.592+0000 7fe568ff9700 1 -- 172.21.15.60:0/870263766 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5600076c0 con 0x7fe56c0bc810 2023-07-12T02:02:48.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.592+0000 7fe5725d8700 1 -- 172.21.15.60:0/870263766 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe56c147df0 con 0x7fe56c0bc810 2023-07-12T02:02:48.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.592+0000 7fe568ff9700 1 -- 172.21.15.60:0/870263766 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe560004a90 con 0x7fe56c0bc810 2023-07-12T02:02:48.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.592+0000 7fe5725d8700 1 -- 172.21.15.60:0/870263766 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe56c0ba960 con 0x7fe56c0bc810 2023-07-12T02:02:48.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.593+0000 7fe5725d8700 1 -- 172.21.15.60:0/870263766 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe56c0b18a0 con 0x7fe56c0bc810 2023-07-12T02:02:48.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.594+0000 7fe568ff9700 1 -- 172.21.15.60:0/870263766 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe560004bf0 con 0x7fe56c0bc810 2023-07-12T02:02:48.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.594+0000 7fe568ff9700 1 --2- 172.21.15.60:0/870263766 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fe55806ace0 0x7fe55806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:48.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.594+0000 7fe568ff9700 1 -- 172.21.15.60:0/870263766 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fe560089280 con 0x7fe56c0bc810 2023-07-12T02:02:48.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.594+0000 7fe56bfff700 1 --2- 172.21.15.60:0/870263766 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fe55806ace0 0x7fe55806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:48.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.595+0000 7fe56bfff700 1 --2- 172.21.15.60:0/870263766 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fe55806ace0 0x7fe55806d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe55c000c00 tx=0x7fe55c013040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:48.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.599+0000 7fe568ff9700 1 -- 172.21.15.60:0/870263766 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fe56c0b18a0 con 0x7fe56c0bc810 2023-07-12T02:02:48.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:48.840+0000 7fe5725d8700 1 -- 172.21.15.60:0/870263766 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe56c0b18a0 con 0x7fe56c0bc810 2023-07-12T02:02:49.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.443+0000 7fe568ff9700 1 -- 172.21.15.60:0/870263766 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe56c0b18a0 con 0x7fe56c0bc810 2023-07-12T02:02:49.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.446+0000 7fe5725d8700 1 -- 172.21.15.60:0/870263766 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fe55806ace0 msgr2=0x7fe55806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:49.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.446+0000 7fe5725d8700 1 --2- 172.21.15.60:0/870263766 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fe55806ace0 0x7fe55806d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe55c000c00 tx=0x7fe55c013040 comp rx=0 tx=0).stop 2023-07-12T02:02:49.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.446+0000 7fe5725d8700 1 -- 172.21.15.60:0/870263766 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe56c0bc810 msgr2=0x7fe56c149440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:49.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.446+0000 7fe5725d8700 1 --2- 172.21.15.60:0/870263766 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe56c0bc810 0x7fe56c149440 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe56000c770 tx=0x7fe56000cb30 comp rx=0 tx=0).stop 2023-07-12T02:02:49.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.446+0000 7fe5725d8700 1 -- 172.21.15.60:0/870263766 shutdown_connections 2023-07-12T02:02:49.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.447+0000 7fe5725d8700 1 --2- 172.21.15.60:0/870263766 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fe55806ace0 0x7fe55806d190 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:49.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.447+0000 7fe5725d8700 1 --2- 172.21.15.60:0/870263766 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe56c1449d0 0x7fe56c0b2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:49.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.447+0000 7fe5725d8700 1 --2- 172.21.15.60:0/870263766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe56c0b8d90 0x7fe56c0b1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:49.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.447+0000 7fe5725d8700 1 --2- 172.21.15.60:0/870263766 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe56c0bc810 0x7fe56c149440 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:49.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.447+0000 7fe5725d8700 1 -- 172.21.15.60:0/870263766 >> 172.21.15.60:0/870263766 conn(0x7fe56c0c0860 msgr2=0x7fe56c0bf770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:49.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.447+0000 7fe5725d8700 1 -- 172.21.15.60:0/870263766 shutdown_connections 2023-07-12T02:02:49.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.447+0000 7fe5725d8700 1 -- 172.21.15.60:0/870263766 wait complete. 2023-07-12T02:02:49.465 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-12T02:02:49.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.638+0000 7f20f1d01700 1 Processor -- start 2023-07-12T02:02:49.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.638+0000 7f20f1d01700 1 -- start start 2023-07-12T02:02:49.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.639+0000 7f20f1d01700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f20ec06b120 0x7f20ec071350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:49.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.639+0000 7f20f1d01700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20ec0b7180 con 0x7f20ec0ba160 2023-07-12T02:02:49.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.639+0000 7f20f1d01700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20ec071070 con 0x7f20ec0b5fc0 2023-07-12T02:02:49.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.639+0000 7f20f1d01700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20ec0b90b0 con 0x7f20ec06b120 2023-07-12T02:02:49.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.639+0000 7f20eaffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f20ec0ba160 0x7f20ec1485e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60530/0 (socket says 172.21.15.60:60530) 2023-07-12T02:02:49.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.639+0000 7f20eaffd700 1 -- 172.21.15.60:0/2314223259 learned_addr learned my addr 172.21.15.60:0/2314223259 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:49.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.639+0000 7f20eb7fe700 1 --2- 172.21.15.60:0/2314223259 >> v2:172.21.15.79:3300/0 conn(0x7f20ec06b120 0x7f20ec071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:49.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.639+0000 7f20ea7fc700 1 -- 172.21.15.60:0/2314223259 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1482732754 0 0) 0x7f20ec0b7180 con 0x7f20ec0ba160 2023-07-12T02:02:49.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.639+0000 7f20ea7fc700 1 -- 172.21.15.60:0/2314223259 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20d40035b0 con 0x7f20ec0ba160 2023-07-12T02:02:49.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.639+0000 7f20eb7fe700 1 -- 172.21.15.60:0/2314223259 >> v1:172.21.15.79:6789/0 conn(0x7f20ec0b5fc0 legacy=0x7f20ec0b6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:49.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.639+0000 7f20eb7fe700 1 -- 172.21.15.60:0/2314223259 >> v1:172.21.15.60:6789/0 conn(0x7f20ec0ba160 legacy=0x7f20ec1485e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:49.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.639+0000 7f20eb7fe700 1 -- 172.21.15.60:0/2314223259 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ec0b6e10 con 0x7f20ec06b120 2023-07-12T02:02:49.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.640+0000 7f20eb7fe700 1 --2- 172.21.15.60:0/2314223259 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20ec06b120 0x7f20ec071350 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f20dc009840 tx=0x7f20dc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a914cd2104fde92a server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:49.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.640+0000 7f20ea7fc700 1 -- 172.21.15.60:0/2314223259 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e0001670 con 0x7f20ec06b120 2023-07-12T02:02:49.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.640+0000 7f20ea7fc700 1 -- 172.21.15.60:0/2314223259 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20dc004030 con 0x7f20ec06b120 2023-07-12T02:02:49.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.640+0000 7f20ea7fc700 1 -- 172.21.15.60:0/2314223259 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20dc0043c0 con 0x7f20ec06b120 2023-07-12T02:02:49.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.640+0000 7f20f1d01700 1 -- 172.21.15.60:0/2314223259 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20ec06b120 msgr2=0x7f20ec071350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:49.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.640+0000 7f20f1d01700 1 --2- 172.21.15.60:0/2314223259 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20ec06b120 0x7f20ec071350 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f20dc009840 tx=0x7f20dc009b50 comp rx=0 tx=0).stop 2023-07-12T02:02:49.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.640+0000 7f20f1d01700 1 -- 172.21.15.60:0/2314223259 shutdown_connections 2023-07-12T02:02:49.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.640+0000 7f20f1d01700 1 --2- 172.21.15.60:0/2314223259 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20ec06b120 0x7f20ec071350 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:49.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.640+0000 7f20f1d01700 1 -- 172.21.15.60:0/2314223259 >> 172.21.15.60:0/2314223259 conn(0x7f20ec0bd980 msgr2=0x7f20ec0b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:49.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.640+0000 7f20f1d01700 1 -- 172.21.15.60:0/2314223259 shutdown_connections 2023-07-12T02:02:49.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.640+0000 7f20f1d01700 1 -- 172.21.15.60:0/2314223259 wait complete. 2023-07-12T02:02:49.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.641+0000 7f20f1d01700 1 Processor -- start 2023-07-12T02:02:49.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.642+0000 7f20f1d01700 1 -- start start 2023-07-12T02:02:49.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.642+0000 7f20f1d01700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20ec06b120 0x7f20ec13fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:49.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.642+0000 7f20f1d01700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f20ec0b5fc0 0x7f20ec1d2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:49.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.642+0000 7f20f1d01700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20ec0ba160 0x7f20ec147730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:49.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.642+0000 7f20f1d01700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec1d1d60 con 0x7f20ec0ba160 2023-07-12T02:02:49.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.642+0000 7f20f1d01700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec1d18d0 con 0x7f20ec06b120 2023-07-12T02:02:49.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.642+0000 7f20f1d01700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec1d1280 con 0x7f20ec0b5fc0 2023-07-12T02:02:49.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.642+0000 7f20ebfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20ec0ba160 0x7f20ec147730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:49.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.642+0000 7f20ebfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20ec0ba160 0x7f20ec147730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58482/0 (socket says 172.21.15.60:58482) 2023-07-12T02:02:49.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.642+0000 7f20ebfff700 1 -- 172.21.15.60:0/4254420370 learned_addr learned my addr 172.21.15.60:0/4254420370 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:49.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.642+0000 7f20eb7fe700 1 --2- 172.21.15.60:0/4254420370 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20ec06b120 0x7f20ec13fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:49.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.642+0000 7f20eaffd700 1 --2- 172.21.15.60:0/4254420370 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f20ec0b5fc0 0x7f20ec1d2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:49.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.643+0000 7f20ebfff700 1 -- 172.21.15.60:0/4254420370 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f20ec0b5fc0 msgr2=0x7f20ec1d2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:49.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.643+0000 7f20ebfff700 1 --2- 172.21.15.60:0/4254420370 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f20ec0b5fc0 0x7f20ec1d2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:49.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.643+0000 7f20ebfff700 1 -- 172.21.15.60:0/4254420370 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20ec06b120 msgr2=0x7f20ec13fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:49.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.643+0000 7f20ebfff700 1 --2- 172.21.15.60:0/4254420370 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20ec06b120 0x7f20ec13fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:49.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.643+0000 7f20ebfff700 1 -- 172.21.15.60:0/4254420370 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20dc0094a0 con 0x7f20ec0ba160 2023-07-12T02:02:49.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.643+0000 7f20ebfff700 1 --2- 172.21.15.60:0/4254420370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20ec0ba160 0x7f20ec147730 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f20e400cc50 tx=0x7f20e400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:49.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.643+0000 7f20d3fff700 1 -- 172.21.15.60:0/4254420370 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e4003c00 con 0x7f20ec0ba160 2023-07-12T02:02:49.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.643+0000 7f20d3fff700 1 -- 172.21.15.60:0/4254420370 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e4003d60 con 0x7f20ec0ba160 2023-07-12T02:02:49.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.643+0000 7f20f1d01700 1 -- 172.21.15.60:0/4254420370 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20ec1d1560 con 0x7f20ec0ba160 2023-07-12T02:02:49.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.643+0000 7f20d3fff700 1 -- 172.21.15.60:0/4254420370 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e400aaa0 con 0x7f20ec0ba160 2023-07-12T02:02:49.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.643+0000 7f20f1d01700 1 -- 172.21.15.60:0/4254420370 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20ec140530 con 0x7f20ec0ba160 2023-07-12T02:02:49.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.644+0000 7f20f1d01700 1 -- 172.21.15.60:0/4254420370 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20ec074360 con 0x7f20ec0ba160 2023-07-12T02:02:49.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.644+0000 7f20d3fff700 1 -- 172.21.15.60:0/4254420370 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f20e400ac00 con 0x7f20ec0ba160 2023-07-12T02:02:49.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.645+0000 7f20d3fff700 1 --2- 172.21.15.60:0/4254420370 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f20d806ace0 0x7f20d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:49.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.645+0000 7f20d3fff700 1 -- 172.21.15.60:0/4254420370 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f20e40893c0 con 0x7f20ec0ba160 2023-07-12T02:02:49.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.645+0000 7f20eb7fe700 1 --2- 172.21.15.60:0/4254420370 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f20d806ace0 0x7f20d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:49.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.645+0000 7f20eb7fe700 1 --2- 172.21.15.60:0/4254420370 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f20d806ace0 0x7f20d806d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f20dc00a010 tx=0x7f20dc008000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:49.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.649+0000 7f20d3fff700 1 -- 172.21.15.60:0/4254420370 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f20e40544a0 con 0x7f20ec0ba160 2023-07-12T02:02:49.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:49.847+0000 7f20f1d01700 1 -- 172.21.15.60:0/4254420370 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f20ec1d1a10 con 0x7f20ec0ba160 2023-07-12T02:02:50.208 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:02:50.211 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:02:50.213 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:02:50.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.447+0000 7f20d3fff700 1 -- 172.21.15.60:0/4254420370 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) v1 ==== 181+0+0 (secure 0 0 0) 0x7f20e4057ac0 con 0x7f20ec0ba160 2023-07-12T02:02:50.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.451+0000 7f20f1d01700 1 -- 172.21.15.60:0/4254420370 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f20d806ace0 msgr2=0x7f20d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:50.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.451+0000 7f20f1d01700 1 --2- 172.21.15.60:0/4254420370 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f20d806ace0 0x7f20d806d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f20dc00a010 tx=0x7f20dc008000 comp rx=0 tx=0).stop 2023-07-12T02:02:50.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.451+0000 7f20f1d01700 1 -- 172.21.15.60:0/4254420370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20ec0ba160 msgr2=0x7f20ec147730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:50.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.451+0000 7f20f1d01700 1 --2- 172.21.15.60:0/4254420370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20ec0ba160 0x7f20ec147730 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f20e400cc50 tx=0x7f20e400cf60 comp rx=0 tx=0).stop 2023-07-12T02:02:50.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.451+0000 7f20f1d01700 1 -- 172.21.15.60:0/4254420370 shutdown_connections 2023-07-12T02:02:50.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.451+0000 7f20f1d01700 1 --2- 172.21.15.60:0/4254420370 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f20d806ace0 0x7f20d806d190 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:50.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.451+0000 7f20f1d01700 1 --2- 172.21.15.60:0/4254420370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20ec0ba160 0x7f20ec147730 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:50.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.451+0000 7f20f1d01700 1 --2- 172.21.15.60:0/4254420370 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20ec06b120 0x7f20ec13fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:50.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.451+0000 7f20f1d01700 1 --2- 172.21.15.60:0/4254420370 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f20ec0b5fc0 0x7f20ec1d2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:50.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.451+0000 7f20f1d01700 1 -- 172.21.15.60:0/4254420370 >> 172.21.15.60:0/4254420370 conn(0x7f20ec0bd980 msgr2=0x7f20ec0b81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:50.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.452+0000 7f20f1d01700 1 -- 172.21.15.60:0/4254420370 shutdown_connections 2023-07-12T02:02:50.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.452+0000 7f20f1d01700 1 -- 172.21.15.60:0/4254420370 wait complete. 2023-07-12T02:02:50.457 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' removed 2023-07-12T02:02:50.469 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-12T02:02:50.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.597+0000 7f020bae7700 1 Processor -- start 2023-07-12T02:02:50.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.597+0000 7f020bae7700 1 -- start start 2023-07-12T02:02:50.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.597+0000 7f020bae7700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f02040721e0 0x7f0204071130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:50.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.597+0000 7f020bae7700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0204071670 0x7f0204154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:50.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.597+0000 7f020bae7700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f020406a640 con 0x7f0204147dc0 2023-07-12T02:02:50.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.597+0000 7f020bae7700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0204072630 con 0x7f0204071670 2023-07-12T02:02:50.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.597+0000 7f020bae7700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0204070950 con 0x7f02040721e0 2023-07-12T02:02:50.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.598+0000 7f0209082700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f02040721e0 0x7f0204071130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:50.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.598+0000 7f020a084700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0204071670 0x7f0204154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:50.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.598+0000 7f0209082700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f02040721e0 0x7f0204071130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.60:36268/0 (socket says 172.21.15.60:36268) 2023-07-12T02:02:50.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.598+0000 7f0209082700 1 -- 172.21.15.60:0/2048251396 learned_addr learned my addr 172.21.15.60:0/2048251396 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:50.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.598+0000 7f0209883700 1 --1- 172.21.15.60:0/2048251396 >> v1:172.21.15.79:6789/0 conn(0x7f0204147dc0 0x7f0204069f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.60:34478/0 (socket says 172.21.15.60:34478) 2023-07-12T02:02:50.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.598+0000 7f0209082700 1 -- 172.21.15.60:0/2048251396 >> v2:172.21.15.79:3300/0 conn(0x7f0204071670 msgr2=0x7f0204154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:50.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.598+0000 7f0209082700 1 --2- 172.21.15.60:0/2048251396 >> v2:172.21.15.79:3300/0 conn(0x7f0204071670 0x7f0204154ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:50.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.598+0000 7f0209082700 1 -- 172.21.15.60:0/2048251396 >> v1:172.21.15.79:6789/0 conn(0x7f0204147dc0 legacy=0x7f0204069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:50.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.598+0000 7f0209082700 1 -- 172.21.15.60:0/2048251396 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020406f680 con 0x7f02040721e0 2023-07-12T02:02:50.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.598+0000 7f020a084700 1 --2- 172.21.15.60:0/2048251396 >> v2:172.21.15.79:3300/0 conn(0x7f0204071670 0x7f0204154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:02:50.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.598+0000 7f0209082700 1 --2- 172.21.15.60:0/2048251396 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f02040721e0 0x7f0204071130 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f02000098f0 tx=0x7f0200009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fb68f4136146007 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:50.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.599+0000 7f0208881700 1 -- 172.21.15.60:0/2048251396 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0200011830 con 0x7f02040721e0 2023-07-12T02:02:50.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.599+0000 7f0208881700 1 -- 172.21.15.60:0/2048251396 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0200011990 con 0x7f02040721e0 2023-07-12T02:02:50.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.599+0000 7f0208881700 1 -- 172.21.15.60:0/2048251396 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0200011d20 con 0x7f02040721e0 2023-07-12T02:02:50.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.599+0000 7f020bae7700 1 -- 172.21.15.60:0/2048251396 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f02040721e0 msgr2=0x7f0204071130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:50.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.599+0000 7f020bae7700 1 --2- 172.21.15.60:0/2048251396 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f02040721e0 0x7f0204071130 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f02000098f0 tx=0x7f0200009c00 comp rx=0 tx=0).stop 2023-07-12T02:02:50.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.599+0000 7f020bae7700 1 -- 172.21.15.60:0/2048251396 shutdown_connections 2023-07-12T02:02:50.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.599+0000 7f020bae7700 1 --2- 172.21.15.60:0/2048251396 >> v2:172.21.15.79:3300/0 conn(0x7f0204071670 0x7f0204154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:50.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.599+0000 7f020bae7700 1 --2- 172.21.15.60:0/2048251396 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f02040721e0 0x7f0204071130 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:50.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.599+0000 7f020bae7700 1 -- 172.21.15.60:0/2048251396 >> 172.21.15.60:0/2048251396 conn(0x7f020406d0e0 msgr2=0x7f020406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:50.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.600+0000 7f020bae7700 1 -- 172.21.15.60:0/2048251396 shutdown_connections 2023-07-12T02:02:50.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.600+0000 7f020bae7700 1 -- 172.21.15.60:0/2048251396 wait complete. 2023-07-12T02:02:50.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.601+0000 7f020bae7700 1 Processor -- start 2023-07-12T02:02:50.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.601+0000 7f020bae7700 1 -- start start 2023-07-12T02:02:50.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.601+0000 7f020bae7700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0204071670 0x7f020414e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:50.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.601+0000 7f020bae7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02040721e0 0x7f020414a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:50.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.601+0000 7f020bae7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0204147dc0 0x7f02041e2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:50.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.601+0000 7f020bae7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02040b79b0 con 0x7f02040721e0 2023-07-12T02:02:50.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.601+0000 7f020bae7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020414dce0 con 0x7f0204147dc0 2023-07-12T02:02:50.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.601+0000 7f020bae7700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02040b73f0 con 0x7f0204071670 2023-07-12T02:02:50.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.601+0000 7f0209082700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02040721e0 0x7f020414a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:50.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.601+0000 7f0209082700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02040721e0 0x7f020414a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58498/0 (socket says 172.21.15.60:58498) 2023-07-12T02:02:50.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.601+0000 7f0209082700 1 -- 172.21.15.60:0/3697471502 learned_addr learned my addr 172.21.15.60:0/3697471502 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:50.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.602+0000 7f0209883700 1 --2- 172.21.15.60:0/3697471502 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0204071670 0x7f020414e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:50.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.602+0000 7f020a084700 1 --2- 172.21.15.60:0/3697471502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0204147dc0 0x7f02041e2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:50.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.602+0000 7f0209082700 1 -- 172.21.15.60:0/3697471502 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0204071670 msgr2=0x7f020414e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:50.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.602+0000 7f0209082700 1 --2- 172.21.15.60:0/3697471502 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0204071670 0x7f020414e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:50.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.602+0000 7f0209082700 1 -- 172.21.15.60:0/3697471502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0204147dc0 msgr2=0x7f02041e2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:50.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.602+0000 7f0209082700 1 --2- 172.21.15.60:0/3697471502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0204147dc0 0x7f02041e2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:50.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.602+0000 7f0209082700 1 -- 172.21.15.60:0/3697471502 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01fc009a70 con 0x7f02040721e0 2023-07-12T02:02:50.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.602+0000 7f0209082700 1 --2- 172.21.15.60:0/3697471502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02040721e0 0x7f020414a7b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0200000c00 tx=0x7f0200004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:50.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.602+0000 7f01fa7fc700 1 -- 172.21.15.60:0/3697471502 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02000045d0 con 0x7f02040721e0 2023-07-12T02:02:50.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.602+0000 7f01fa7fc700 1 -- 172.21.15.60:0/3697471502 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02000036a0 con 0x7f02040721e0 2023-07-12T02:02:50.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.602+0000 7f01fa7fc700 1 -- 172.21.15.60:0/3697471502 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0200003a50 con 0x7f02040721e0 2023-07-12T02:02:50.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.602+0000 7f020bae7700 1 -- 172.21.15.60:0/3697471502 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0200009550 con 0x7f02040721e0 2023-07-12T02:02:50.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.602+0000 7f020bae7700 1 -- 172.21.15.60:0/3697471502 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f020414ea00 con 0x7f02040721e0 2023-07-12T02:02:50.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.603+0000 7f020bae7700 1 -- 172.21.15.60:0/3697471502 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f020414e1e0 con 0x7f02040721e0 2023-07-12T02:02:50.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.604+0000 7f01fa7fc700 1 -- 172.21.15.60:0/3697471502 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0200021070 con 0x7f02040721e0 2023-07-12T02:02:50.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.604+0000 7f01fa7fc700 1 --2- 172.21.15.60:0/3697471502 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f01e806ace0 0x7f01e806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:50.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.604+0000 7f01fa7fc700 1 -- 172.21.15.60:0/3697471502 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5710+0+0 (secure 0 0 0) 0x7f020008a770 con 0x7f02040721e0 2023-07-12T02:02:50.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.604+0000 7f0209883700 1 --2- 172.21.15.60:0/3697471502 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f01e806ace0 0x7f01e806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:50.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.605+0000 7f0209883700 1 --2- 172.21.15.60:0/3697471502 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f01e806ace0 0x7f01e806d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f01f4000f60 tx=0x7f01f4007ed0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:50.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.608+0000 7f01fa7fc700 1 -- 172.21.15.60:0/3697471502 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f020414e1e0 con 0x7f02040721e0 2023-07-12T02:02:50.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:50.804+0000 7f020bae7700 1 -- 172.21.15.60:0/3697471502 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f020414e1e0 con 0x7f02040721e0 2023-07-12T02:02:51.453 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.449+0000 7f01fa7fc700 1 -- 172.21.15.60:0/3697471502 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7f020414e1e0 con 0x7f02040721e0 2023-07-12T02:02:51.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.453+0000 7f020bae7700 1 -- 172.21.15.60:0/3697471502 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f01e806ace0 msgr2=0x7f01e806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:51.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.453+0000 7f020bae7700 1 --2- 172.21.15.60:0/3697471502 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f01e806ace0 0x7f01e806d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f01f4000f60 tx=0x7f01f4007ed0 comp rx=0 tx=0).stop 2023-07-12T02:02:51.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.453+0000 7f020bae7700 1 -- 172.21.15.60:0/3697471502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02040721e0 msgr2=0x7f020414a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:51.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.453+0000 7f020bae7700 1 --2- 172.21.15.60:0/3697471502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02040721e0 0x7f020414a7b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0200000c00 tx=0x7f0200004750 comp rx=0 tx=0).stop 2023-07-12T02:02:51.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.453+0000 7f020bae7700 1 -- 172.21.15.60:0/3697471502 shutdown_connections 2023-07-12T02:02:51.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.453+0000 7f020bae7700 1 --2- 172.21.15.60:0/3697471502 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f01e806ace0 0x7f01e806d190 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:51.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.453+0000 7f020bae7700 1 --2- 172.21.15.60:0/3697471502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0204147dc0 0x7f02041e2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:51.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.453+0000 7f020bae7700 1 --2- 172.21.15.60:0/3697471502 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0204071670 0x7f020414e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:51.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.453+0000 7f020bae7700 1 --2- 172.21.15.60:0/3697471502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02040721e0 0x7f020414a7b0 secure :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0200000c00 tx=0x7f0200004750 comp rx=0 tx=0).stop 2023-07-12T02:02:51.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.453+0000 7f020bae7700 1 -- 172.21.15.60:0/3697471502 >> 172.21.15.60:0/3697471502 conn(0x7f020406d0e0 msgr2=0x7f02040b9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:51.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.454+0000 7f020bae7700 1 -- 172.21.15.60:0/3697471502 shutdown_connections 2023-07-12T02:02:51.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.454+0000 7f020bae7700 1 -- 172.21.15.60:0/3697471502 wait complete. 2023-07-12T02:02:51.460 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' removed 2023-07-12T02:02:51.474 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-12T02:02:51.474 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-12T02:02:51.475 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-12T02:02:51.475 INFO:teuthology.orchestra.run:waiting for 300 2023-07-12T02:02:51.475 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-12T02:02:51.475 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-12T02:02:51.475 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-12T02:02:51.476 INFO:teuthology.orchestra.run:waiting for 300 2023-07-12T02:02:51.476 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-12T02:02:51.476 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-12T02:02:51.476 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-12T02:02:51.477 INFO:teuthology.orchestra.run:waiting for 300 2023-07-12T02:02:51.485 INFO:tasks.ceph.mds.a:Stopped 2023-07-12T02:02:51.485 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-12T02:02:51.486 INFO:tasks.ceph.mds.c:Stopped 2023-07-12T02:02:51.486 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-12T02:02:51.487 INFO:tasks.ceph.mds.b:Stopped 2023-07-12T02:02:51.487 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-12T02:02:51.527 INFO:tasks.ceph.mds.a:Started 2023-07-12T02:02:51.528 DEBUG:teuthology.parallel:result is None 2023-07-12T02:02:51.529 INFO:tasks.ceph.mds.c:Started 2023-07-12T02:02:51.529 DEBUG:teuthology.parallel:result is None 2023-07-12T02:02:51.530 INFO:tasks.ceph.mds.b:Started 2023-07-12T02:02:51.530 DEBUG:teuthology.parallel:result is None 2023-07-12T02:02:51.530 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-12T02:02:51.622 INFO:tasks.ceph.mds.b.smithi079.stdout:starting mds.b at 2023-07-12T02:02:51.630 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2023-07-12T02:02:51.631 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2023-07-12T02:02:51.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.678+0000 7fc52eb63700 1 Processor -- start 2023-07-12T02:02:51.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.678+0000 7fc52eb63700 1 -- start start 2023-07-12T02:02:51.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.679+0000 7fc52eb63700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc5281449d0 0x7fc52814db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:51.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.679+0000 7fc52eb63700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5280b8620 con 0x7fc5280bc810 2023-07-12T02:02:51.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.679+0000 7fc52eb63700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5280b8900 con 0x7fc5280b8d90 2023-07-12T02:02:51.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.679+0000 7fc52eb63700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5280b97a0 con 0x7fc5281449d0 2023-07-12T02:02:51.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.679+0000 7fc52c8ff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc5281449d0 0x7fc52814db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:51.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.679+0000 7fc527fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc5280bc810 0x7fc5280ba530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60560/0 (socket says 172.21.15.60:60560) 2023-07-12T02:02:51.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.679+0000 7fc527fff700 1 -- 172.21.15.60:0/3146800004 learned_addr learned my addr 172.21.15.60:0/3146800004 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:51.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.679+0000 7fc52c8ff700 1 -- 172.21.15.60:0/3146800004 >> v1:172.21.15.79:6789/0 conn(0x7fc5280b8d90 legacy=0x7fc52806ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:51.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.679+0000 7fc52c8ff700 1 -- 172.21.15.60:0/3146800004 >> v1:172.21.15.60:6789/0 conn(0x7fc5280bc810 legacy=0x7fc5280ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:51.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.679+0000 7fc5277fe700 1 -- 172.21.15.60:0/3146800004 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2001590929 0 0) 0x7fc5280b8620 con 0x7fc5280bc810 2023-07-12T02:02:51.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.679+0000 7fc52c8ff700 1 -- 172.21.15.60:0/3146800004 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5280bac40 con 0x7fc5281449d0 2023-07-12T02:02:51.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.680+0000 7fc52c8ff700 1 --2- 172.21.15.60:0/3146800004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5281449d0 0x7fc52814db50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc51c009840 tx=0x7fc51c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18cd4a44b859220a server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:51.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.680+0000 7fc5277fe700 1 -- 172.21.15.60:0/3146800004 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51c011830 con 0x7fc5281449d0 2023-07-12T02:02:51.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.680+0000 7fc5277fe700 1 -- 172.21.15.60:0/3146800004 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51c011990 con 0x7fc5281449d0 2023-07-12T02:02:51.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.680+0000 7fc5277fe700 1 -- 172.21.15.60:0/3146800004 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51c011d20 con 0x7fc5281449d0 2023-07-12T02:02:51.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.680+0000 7fc52eb63700 1 -- 172.21.15.60:0/3146800004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5281449d0 msgr2=0x7fc52814db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:51.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.680+0000 7fc52eb63700 1 --2- 172.21.15.60:0/3146800004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5281449d0 0x7fc52814db50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc51c009840 tx=0x7fc51c009b50 comp rx=0 tx=0).stop 2023-07-12T02:02:51.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.680+0000 7fc52eb63700 1 -- 172.21.15.60:0/3146800004 shutdown_connections 2023-07-12T02:02:51.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.680+0000 7fc52eb63700 1 --2- 172.21.15.60:0/3146800004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5281449d0 0x7fc52814db50 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:51.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.680+0000 7fc52eb63700 1 -- 172.21.15.60:0/3146800004 >> 172.21.15.60:0/3146800004 conn(0x7fc5280c0860 msgr2=0x7fc5280c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:51.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.680+0000 7fc52eb63700 1 -- 172.21.15.60:0/3146800004 shutdown_connections 2023-07-12T02:02:51.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.680+0000 7fc52eb63700 1 -- 172.21.15.60:0/3146800004 wait complete. 2023-07-12T02:02:51.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.681+0000 7fc52eb63700 1 Processor -- start 2023-07-12T02:02:51.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.681+0000 7fc52eb63700 1 -- start start 2023-07-12T02:02:51.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.682+0000 7fc52eb63700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc5280b8d90 0x7fc52814af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:51.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.682+0000 7fc52eb63700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5280bc810 0x7fc5281e34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:51.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.682+0000 7fc52eb63700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5281449d0 0x7fc5280b6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:51.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.682+0000 7fc52eb63700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52814b440 con 0x7fc5281449d0 2023-07-12T02:02:51.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.682+0000 7fc52eb63700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5281e39e0 con 0x7fc5280bc810 2023-07-12T02:02:51.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.682+0000 7fc52eb63700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5280b6a60 con 0x7fc5280b8d90 2023-07-12T02:02:51.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.682+0000 7fc52d100700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5281449d0 0x7fc5280b6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:51.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.682+0000 7fc52d100700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5281449d0 0x7fc5280b6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58540/0 (socket says 172.21.15.60:58540) 2023-07-12T02:02:51.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.682+0000 7fc52d100700 1 -- 172.21.15.60:0/3375139954 learned_addr learned my addr 172.21.15.60:0/3375139954 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:51.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.682+0000 7fc527fff700 1 --2- 172.21.15.60:0/3375139954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5280bc810 0x7fc5281e34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:51.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.682+0000 7fc52c8ff700 1 --2- 172.21.15.60:0/3375139954 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc5280b8d90 0x7fc52814af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:51.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.683+0000 7fc52d100700 1 -- 172.21.15.60:0/3375139954 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc5280b8d90 msgr2=0x7fc52814af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:51.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.683+0000 7fc52d100700 1 --2- 172.21.15.60:0/3375139954 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc5280b8d90 0x7fc52814af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:51.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.683+0000 7fc52d100700 1 -- 172.21.15.60:0/3375139954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5280bc810 msgr2=0x7fc5281e34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:51.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.683+0000 7fc52d100700 1 --2- 172.21.15.60:0/3375139954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5280bc810 0x7fc5281e34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:51.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.683+0000 7fc52d100700 1 -- 172.21.15.60:0/3375139954 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc51c0094a0 con 0x7fc5281449d0 2023-07-12T02:02:51.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.683+0000 7fc527fff700 1 --2- 172.21.15.60:0/3375139954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5280bc810 0x7fc5281e34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:02:51.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.683+0000 7fc52d100700 1 --2- 172.21.15.60:0/3375139954 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5281449d0 0x7fc5280b6520 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc52000cc80 tx=0x7fc52000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:51.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.683+0000 7fc5257fa700 1 -- 172.21.15.60:0/3375139954 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc520003c00 con 0x7fc5281449d0 2023-07-12T02:02:51.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.683+0000 7fc5257fa700 1 -- 172.21.15.60:0/3375139954 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc520003d60 con 0x7fc5281449d0 2023-07-12T02:02:51.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.683+0000 7fc5257fa700 1 -- 172.21.15.60:0/3375139954 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52000aaa0 con 0x7fc5281449d0 2023-07-12T02:02:51.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.683+0000 7fc52eb63700 1 -- 172.21.15.60:0/3375139954 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc52814a4d0 con 0x7fc5281449d0 2023-07-12T02:02:51.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.683+0000 7fc52eb63700 1 -- 172.21.15.60:0/3375139954 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc52814a7b0 con 0x7fc5281449d0 2023-07-12T02:02:51.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.684+0000 7fc52eb63700 1 -- 172.21.15.60:0/3375139954 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc528148ad0 con 0x7fc5281449d0 2023-07-12T02:02:51.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.684+0000 7fc5257fa700 1 -- 172.21.15.60:0/3375139954 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc52000ac00 con 0x7fc5281449d0 2023-07-12T02:02:51.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.685+0000 7fc5257fa700 1 --2- 172.21.15.60:0/3375139954 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc50c06ad10 0x7fc50c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:51.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.685+0000 7fc5257fa700 1 -- 172.21.15.60:0/3375139954 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fc520089180 con 0x7fc5281449d0 2023-07-12T02:02:51.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.685+0000 7fc52c8ff700 1 --2- 172.21.15.60:0/3375139954 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc50c06ad10 0x7fc50c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:51.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.685+0000 7fc52c8ff700 1 --2- 172.21.15.60:0/3375139954 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc50c06ad10 0x7fc50c06d1c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc51c0090b0 tx=0x7fc51c01c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:51.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.689+0000 7fc5257fa700 1 -- 172.21.15.60:0/3375139954 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fc528148ad0 con 0x7fc5281449d0 2023-07-12T02:02:51.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:51.905+0000 7fc52eb63700 1 -- 172.21.15.60:0/3375139954 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fc528148ad0 con 0x7fc5281449d0 2023-07-12T02:02:52.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.461+0000 7fc5257fa700 1 -- 172.21.15.60:0/3375139954 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc528148ad0 con 0x7fc5281449d0 2023-07-12T02:02:52.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.464+0000 7fc52eb63700 1 -- 172.21.15.60:0/3375139954 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc50c06ad10 msgr2=0x7fc50c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:52.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.464+0000 7fc52eb63700 1 --2- 172.21.15.60:0/3375139954 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc50c06ad10 0x7fc50c06d1c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc51c0090b0 tx=0x7fc51c01c040 comp rx=0 tx=0).stop 2023-07-12T02:02:52.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.464+0000 7fc52eb63700 1 -- 172.21.15.60:0/3375139954 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5281449d0 msgr2=0x7fc5280b6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:52.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.464+0000 7fc52eb63700 1 --2- 172.21.15.60:0/3375139954 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5281449d0 0x7fc5280b6520 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc52000cc80 tx=0x7fc52000cf90 comp rx=0 tx=0).stop 2023-07-12T02:02:52.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.464+0000 7fc52eb63700 1 -- 172.21.15.60:0/3375139954 shutdown_connections 2023-07-12T02:02:52.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.464+0000 7fc52eb63700 1 --2- 172.21.15.60:0/3375139954 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc50c06ad10 0x7fc50c06d1c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:52.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.464+0000 7fc52eb63700 1 --2- 172.21.15.60:0/3375139954 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5281449d0 0x7fc5280b6520 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:52.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.464+0000 7fc52eb63700 1 --2- 172.21.15.60:0/3375139954 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc5280b8d90 0x7fc52814af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:52.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.464+0000 7fc52eb63700 1 --2- 172.21.15.60:0/3375139954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5280bc810 0x7fc5281e34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:52.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.465+0000 7fc52eb63700 1 -- 172.21.15.60:0/3375139954 >> 172.21.15.60:0/3375139954 conn(0x7fc5280c0860 msgr2=0x7fc5280bf810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:52.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.465+0000 7fc52eb63700 1 -- 172.21.15.60:0/3375139954 shutdown_connections 2023-07-12T02:02:52.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.465+0000 7fc52eb63700 1 -- 172.21.15.60:0/3375139954 wait complete. 2023-07-12T02:02:52.470 INFO:teuthology.orchestra.run.smithi060.stderr: removed all blocklist entries 2023-07-12T02:02:52.483 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-12T02:02:52.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.612+0000 7f493dc7a700 1 Processor -- start 2023-07-12T02:02:52.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.612+0000 7f493dc7a700 1 -- start start 2023-07-12T02:02:52.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.612+0000 7f493dc7a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f49381449d0 0x7f493814db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:52.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.612+0000 7f493dc7a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f49380bc810 0x7f49380ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:52.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.612+0000 7f493dc7a700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49380b8620 con 0x7f49380b8d90 2023-07-12T02:02:52.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.612+0000 7f493dc7a700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49380b97a0 con 0x7f49380bc810 2023-07-12T02:02:52.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.612+0000 7f493dc7a700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4938144da0 con 0x7f49381449d0 2023-07-12T02:02:52.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.613+0000 7f4936ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f49380bc810 0x7f49380ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:52.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.613+0000 7f4936ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f49380bc810 0x7f49380ba530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58554/0 (socket says 172.21.15.60:58554) 2023-07-12T02:02:52.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.613+0000 7f4936ffd700 1 -- 172.21.15.60:0/817150162 learned_addr learned my addr 172.21.15.60:0/817150162 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:52.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.613+0000 7f49377fe700 1 --2- 172.21.15.60:0/817150162 >> v2:172.21.15.79:3300/0 conn(0x7f49381449d0 0x7f493814db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:52.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.613+0000 7f4936ffd700 1 -- 172.21.15.60:0/817150162 >> v2:172.21.15.79:3300/0 conn(0x7f49381449d0 msgr2=0x7f493814db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:52.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.613+0000 7f4936ffd700 1 --2- 172.21.15.60:0/817150162 >> v2:172.21.15.79:3300/0 conn(0x7f49381449d0 0x7f493814db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:52.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.613+0000 7f4936ffd700 1 -- 172.21.15.60:0/817150162 >> v1:172.21.15.79:6789/0 conn(0x7f49380b8d90 legacy=0x7f493806ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:52.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.613+0000 7f4936ffd700 1 -- 172.21.15.60:0/817150162 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49380b8900 con 0x7f49380bc810 2023-07-12T02:02:52.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.613+0000 7f4936ffd700 1 --2- 172.21.15.60:0/817150162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49380bc810 0x7f49380ba530 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f493806cbe0 tx=0x7f492c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b9881ab6489ad3 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:52.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.613+0000 7f49367fc700 1 -- 172.21.15.60:0/817150162 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c011830 con 0x7f49380bc810 2023-07-12T02:02:52.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.613+0000 7f49367fc700 1 -- 172.21.15.60:0/817150162 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492c011990 con 0x7f49380bc810 2023-07-12T02:02:52.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.613+0000 7f49367fc700 1 -- 172.21.15.60:0/817150162 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c011d20 con 0x7f49380bc810 2023-07-12T02:02:52.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.614+0000 7f493dc7a700 1 -- 172.21.15.60:0/817150162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49380bc810 msgr2=0x7f49380ba530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:52.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.614+0000 7f493dc7a700 1 --2- 172.21.15.60:0/817150162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49380bc810 0x7f49380ba530 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f493806cbe0 tx=0x7f492c009bd0 comp rx=0 tx=0).stop 2023-07-12T02:02:52.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.614+0000 7f493dc7a700 1 -- 172.21.15.60:0/817150162 shutdown_connections 2023-07-12T02:02:52.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.614+0000 7f493dc7a700 1 --2- 172.21.15.60:0/817150162 >> v2:172.21.15.79:3300/0 conn(0x7f49381449d0 0x7f493814db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:52.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.614+0000 7f493dc7a700 1 --2- 172.21.15.60:0/817150162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49380bc810 0x7f49380ba530 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:52.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.614+0000 7f493dc7a700 1 -- 172.21.15.60:0/817150162 >> 172.21.15.60:0/817150162 conn(0x7f49380c0860 msgr2=0x7f49380c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:52.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.614+0000 7f493dc7a700 1 -- 172.21.15.60:0/817150162 shutdown_connections 2023-07-12T02:02:52.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.614+0000 7f493dc7a700 1 -- 172.21.15.60:0/817150162 wait complete. 2023-07-12T02:02:52.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.615+0000 7f493dc7a700 1 Processor -- start 2023-07-12T02:02:52.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.615+0000 7f493dc7a700 1 -- start start 2023-07-12T02:02:52.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.616+0000 7f493dc7a700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49380b8d90 0x7f49380b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:52.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.616+0000 7f493dc7a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49380bc810 0x7f49381dff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:52.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.616+0000 7f493dc7a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49381449d0 0x7f49380b3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:52.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.616+0000 7f493dc7a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493814b280 con 0x7f49380bc810 2023-07-12T02:02:52.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.616+0000 7f493dc7a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49380b3ec0 con 0x7f49381449d0 2023-07-12T02:02:52.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.616+0000 7f493dc7a700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f493814b030 con 0x7f49380b8d90 2023-07-12T02:02:52.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.616+0000 7f4936ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49380bc810 0x7f49381dff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:52.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.616+0000 7f4936ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49380bc810 0x7f49381dff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58560/0 (socket says 172.21.15.60:58560) 2023-07-12T02:02:52.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.616+0000 7f4936ffd700 1 -- 172.21.15.60:0/3078788164 learned_addr learned my addr 172.21.15.60:0/3078788164 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:52.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.616+0000 7f4937fff700 1 --2- 172.21.15.60:0/3078788164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49381449d0 0x7f49380b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:52.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.616+0000 7f49377fe700 1 --2- 172.21.15.60:0/3078788164 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49380b8d90 0x7f49380b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:52.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.616+0000 7f4936ffd700 1 -- 172.21.15.60:0/3078788164 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49380b8d90 msgr2=0x7f49380b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:52.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.616+0000 7f4936ffd700 1 --2- 172.21.15.60:0/3078788164 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49380b8d90 0x7f49380b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:52.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.616+0000 7f4936ffd700 1 -- 172.21.15.60:0/3078788164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49381449d0 msgr2=0x7f49380b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:52.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.616+0000 7f4936ffd700 1 --2- 172.21.15.60:0/3078788164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49381449d0 0x7f49380b3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:52.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.616+0000 7f4936ffd700 1 -- 172.21.15.60:0/3078788164 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f492c009550 con 0x7f49380bc810 2023-07-12T02:02:52.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.616+0000 7f4936ffd700 1 --2- 172.21.15.60:0/3078788164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49380bc810 0x7f49381dff30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f492c000c00 tx=0x7f492c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:52.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.617+0000 7f491ffff700 1 -- 172.21.15.60:0/3078788164 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c004380 con 0x7f49380bc810 2023-07-12T02:02:52.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.617+0000 7f491ffff700 1 -- 172.21.15.60:0/3078788164 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492c01f070 con 0x7f49380bc810 2023-07-12T02:02:52.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.617+0000 7f493dc7a700 1 -- 172.21.15.60:0/3078788164 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f493814a360 con 0x7f49380bc810 2023-07-12T02:02:52.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.617+0000 7f491ffff700 1 -- 172.21.15.60:0/3078788164 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c0036a0 con 0x7f49380bc810 2023-07-12T02:02:52.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.617+0000 7f493dc7a700 1 -- 172.21.15.60:0/3078788164 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49380b17d0 con 0x7f49380bc810 2023-07-12T02:02:52.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.617+0000 7f493dc7a700 1 -- 172.21.15.60:0/3078788164 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49380b19c0 con 0x7f49380bc810 2023-07-12T02:02:52.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.618+0000 7f491ffff700 1 -- 172.21.15.60:0/3078788164 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f492c021030 con 0x7f49380bc810 2023-07-12T02:02:52.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.618+0000 7f491ffff700 1 --2- 172.21.15.60:0/3078788164 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f492406ace0 0x7f492406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:52.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.619+0000 7f491ffff700 1 -- 172.21.15.60:0/3078788164 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f492c08a4c0 con 0x7f49380bc810 2023-07-12T02:02:52.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.619+0000 7f49377fe700 1 --2- 172.21.15.60:0/3078788164 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f492406ace0 0x7f492406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:52.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.619+0000 7f49377fe700 1 --2- 172.21.15.60:0/3078788164 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f492406ace0 0x7f492406d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4928009b40 tx=0x7f4928009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:52.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.623+0000 7f491ffff700 1 -- 172.21.15.60:0/3078788164 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f492c0558d0 con 0x7f49380bc810 2023-07-12T02:02:52.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.899+0000 7f493dc7a700 1 -- 172.21.15.60:0/3078788164 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f4938074360 con 0x7f49380bc810 2023-07-12T02:02:52.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.900+0000 7f491ffff700 1 -- 172.21.15.60:0/3078788164 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+5491 (secure 0 0 0) 0x7f492c058ef0 con 0x7f49380bc810 2023-07-12T02:02:52.905 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:02:52.905 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-07-12T02:02:52.905 INFO:teuthology.orchestra.run.smithi060.stdout: "auth_dump": [ 2023-07-12T02:02:52.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-07-12T02:02:52.905 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.a", 2023-07-12T02:02:52.906 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQByCa5k4kGoNxAAB0sc013e8ZS1czogTc4c0Q==", 2023-07-12T02:02:52.906 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-07-12T02:02:52.906 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-07-12T02:02:52.906 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-07-12T02:02:52.906 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-07-12T02:02:52.906 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-07-12T02:02:52.906 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-07-12T02:02:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-07-12T02:02:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-07-12T02:02:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.b", 2023-07-12T02:02:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBzCa5kxg+QCBAAPiVj0e6ZgTz6eIigWl8+qQ==", 2023-07-12T02:02:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-07-12T02:02:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-07-12T02:02:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-07-12T02:02:52.908 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-07-12T02:02:52.908 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-07-12T02:02:52.908 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-07-12T02:02:52.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-07-12T02:02:52.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-07-12T02:02:52.908 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.c", 2023-07-12T02:02:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBzCa5kltuNAxAA/7gpWdOo0eN8x9So4gYwhQ==", 2023-07-12T02:02:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-07-12T02:02:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-07-12T02:02:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-07-12T02:02:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-07-12T02:02:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-07-12T02:02:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-07-12T02:02:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-07-12T02:02:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-07-12T02:02:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.0", 2023-07-12T02:02:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQB0Ca5krbesJBAAW2yrWAhl5kZG4G9zy/b3Fw==", 2023-07-12T02:02:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-07-12T02:02:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-07-12T02:02:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-07-12T02:02:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-07-12T02:02:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-07-12T02:02:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-07-12T02:02:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-07-12T02:02:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.1", 2023-07-12T02:02:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQB3Ca5kbQlwIxAAu/GHmpykbQzoNfyOb5/6OQ==", 2023-07-12T02:02:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-07-12T02:02:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-07-12T02:02:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-07-12T02:02:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-07-12T02:02:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-07-12T02:02:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-07-12T02:02:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-07-12T02:02:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.2", 2023-07-12T02:02:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQB6Ca5k5qoYIhAACprR3whRHZCqRBysgRE8Eg==", 2023-07-12T02:02:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-07-12T02:02:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-07-12T02:02:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-07-12T02:02:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-07-12T02:02:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-07-12T02:02:52.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-07-12T02:02:52.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-07-12T02:02:52.914 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.3", 2023-07-12T02:02:52.914 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQB9Ca5kgt5kIBAAju9+pOfla//KjiB9IAZZrg==", 2023-07-12T02:02:52.914 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-07-12T02:02:52.914 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-07-12T02:02:52.914 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-07-12T02:02:52.915 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-07-12T02:02:52.915 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-07-12T02:02:52.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-07-12T02:02:52.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-07-12T02:02:52.915 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.4", 2023-07-12T02:02:52.915 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQCDCa5kpqw2IhAAeTQ2LoJ9k2mgIRcjzE1yJA==", 2023-07-12T02:02:52.915 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-07-12T02:02:52.915 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-07-12T02:02:52.916 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-07-12T02:02:52.916 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-07-12T02:02:52.916 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-07-12T02:02:52.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-07-12T02:02:52.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-07-12T02:02:52.916 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.5", 2023-07-12T02:02:52.916 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQCGCa5k8PUuIBAA/iuLCQ7gjKyM9qfJJJRTOA==", 2023-07-12T02:02:52.917 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-07-12T02:02:52.917 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-07-12T02:02:52.917 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-07-12T02:02:52.917 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-07-12T02:02:52.917 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-07-12T02:02:52.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-07-12T02:02:52.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-07-12T02:02:52.918 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.6", 2023-07-12T02:02:52.918 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQCJCa5keGNbHhAAtq6cMhMcwij3e8N/qNWeQQ==", 2023-07-12T02:02:52.918 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-07-12T02:02:52.918 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-07-12T02:02:52.918 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-07-12T02:02:52.918 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-07-12T02:02:52.918 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-07-12T02:02:52.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-07-12T02:02:52.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-07-12T02:02:52.919 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.7", 2023-07-12T02:02:52.919 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQCMCa5kbgW6HBAA3m/y4pr8E0KX0b9A//nykw==", 2023-07-12T02:02:52.919 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-07-12T02:02:52.919 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-07-12T02:02:52.919 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-07-12T02:02:52.920 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-07-12T02:02:52.920 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-07-12T02:02:52.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-07-12T02:02:52.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-07-12T02:02:52.920 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.0", 2023-07-12T02:02:52.920 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBzCa5kvqP/EBAABFId+TiUCC5lJjpXOFAL7w==", 2023-07-12T02:02:52.920 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-07-12T02:02:52.921 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-07-12T02:02:52.921 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2023-07-12T02:02:52.921 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2023-07-12T02:02:52.921 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2023-07-12T02:02:52.921 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-07-12T02:02:52.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-07-12T02:02:52.921 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-07-12T02:02:52.922 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.admin", 2023-07-12T02:02:52.922 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQByCa5ke/CcDxAAY+pvZk+ZKWFzmiAdhJKT1w==", 2023-07-12T02:02:52.922 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-07-12T02:02:52.922 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2023-07-12T02:02:52.922 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-07-12T02:02:52.922 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-07-12T02:02:52.922 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-07-12T02:02:52.923 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-07-12T02:02:52.923 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-07-12T02:02:52.923 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-07-12T02:02:52.923 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.bootstrap-mds", 2023-07-12T02:02:52.923 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQCRCa5kMh/cOhAA+CmDYwbioKiGoSjovQnGAw==", 2023-07-12T02:02:52.923 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-07-12T02:02:52.923 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile bootstrap-mds" 2023-07-12T02:02:52.924 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-07-12T02:02:52.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-07-12T02:02:52.924 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-07-12T02:02:52.924 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.bootstrap-mgr", 2023-07-12T02:02:52.924 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQCRCa5kmijcOhAAuB42r8dr407ueTvFr4GOdw==", 2023-07-12T02:02:52.924 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-07-12T02:02:52.924 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile bootstrap-mgr" 2023-07-12T02:02:52.925 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-07-12T02:02:52.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-07-12T02:02:52.925 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-07-12T02:02:52.925 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.bootstrap-osd", 2023-07-12T02:02:52.925 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQCRCa5kPjHcOhAAg73PPT4HWXRhV68fKV5BYg==", 2023-07-12T02:02:52.925 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-07-12T02:02:52.925 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile bootstrap-osd" 2023-07-12T02:02:52.926 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-07-12T02:02:52.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-07-12T02:02:52.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-07-12T02:02:52.926 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.bootstrap-rbd", 2023-07-12T02:02:52.926 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQCRCa5kOjrcOhAAn3ZAWeSJE5sVcPl3e5oAng==", 2023-07-12T02:02:52.926 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-07-12T02:02:52.926 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile bootstrap-rbd" 2023-07-12T02:02:52.927 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-07-12T02:02:52.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-07-12T02:02:52.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-07-12T02:02:52.927 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-07-12T02:02:52.927 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQCRCa5k6ULcOhAAx8bfZww2cGKRZzyogHCcIw==", 2023-07-12T02:02:52.927 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-07-12T02:02:52.927 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-07-12T02:02:52.928 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-07-12T02:02:52.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-07-12T02:02:52.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-07-12T02:02:52.928 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.bootstrap-rgw", 2023-07-12T02:02:52.928 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQCRCa5k1WPcOhAAWnW07w03l4rSVnU7rodfVg==", 2023-07-12T02:02:52.928 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-07-12T02:02:52.928 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile bootstrap-rgw" 2023-07-12T02:02:52.929 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-07-12T02:02:52.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-07-12T02:02:52.929 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-07-12T02:02:52.929 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.x", 2023-07-12T02:02:52.929 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQByCa5kOpAmNBAAMrXkO02GwLyNMqUzhM7C4Q==", 2023-07-12T02:02:52.929 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-07-12T02:02:52.929 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2023-07-12T02:02:52.930 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2023-07-12T02:02:52.930 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-07-12T02:02:52.930 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-07-12T02:02:52.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-07-12T02:02:52.930 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-07-12T02:02:52.930 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.y", 2023-07-12T02:02:52.930 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQByCa5kenx6MBAAg4ziV4x7CbquiiM1o2WcxA==", 2023-07-12T02:02:52.931 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-07-12T02:02:52.931 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2023-07-12T02:02:52.931 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2023-07-12T02:02:52.931 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-07-12T02:02:52.931 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-07-12T02:02:52.931 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-07-12T02:02:52.931 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-07-12T02:02:52.932 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-07-12T02:02:52.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.902+0000 7f493dc7a700 1 -- 172.21.15.60:0/3078788164 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f492406ace0 msgr2=0x7f492406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:52.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.902+0000 7f493dc7a700 1 --2- 172.21.15.60:0/3078788164 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f492406ace0 0x7f492406d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4928009b40 tx=0x7f4928009210 comp rx=0 tx=0).stop 2023-07-12T02:02:52.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.902+0000 7f493dc7a700 1 -- 172.21.15.60:0/3078788164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49380bc810 msgr2=0x7f49381dff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:52.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.902+0000 7f493dc7a700 1 --2- 172.21.15.60:0/3078788164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49380bc810 0x7f49381dff30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f492c000c00 tx=0x7f492c004750 comp rx=0 tx=0).stop 2023-07-12T02:02:52.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.902+0000 7f493dc7a700 1 -- 172.21.15.60:0/3078788164 shutdown_connections 2023-07-12T02:02:52.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.902+0000 7f493dc7a700 1 --2- 172.21.15.60:0/3078788164 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f492406ace0 0x7f492406d190 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:52.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.902+0000 7f493dc7a700 1 --2- 172.21.15.60:0/3078788164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49381449d0 0x7f49380b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:52.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.902+0000 7f493dc7a700 1 --2- 172.21.15.60:0/3078788164 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49380b8d90 0x7f49380b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:52.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.902+0000 7f493dc7a700 1 --2- 172.21.15.60:0/3078788164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49380bc810 0x7f49381dff30 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:52.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.902+0000 7f493dc7a700 1 -- 172.21.15.60:0/3078788164 >> 172.21.15.60:0/3078788164 conn(0x7f49380c0860 msgr2=0x7f4938143cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:52.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.902+0000 7f493dc7a700 1 -- 172.21.15.60:0/3078788164 shutdown_connections 2023-07-12T02:02:52.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:52.902+0000 7f493dc7a700 1 -- 172.21.15.60:0/3078788164 wait complete. 2023-07-12T02:02:52.935 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-07-12T02:02:53.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.058+0000 7ff6f9ff8700 1 Processor -- start 2023-07-12T02:02:53.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.058+0000 7ff6f9ff8700 1 -- start start 2023-07-12T02:02:53.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.058+0000 7ff6f9ff8700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6f41449d0 0x7ff6f414db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:53.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.058+0000 7ff6f9ff8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff6f40bc810 0x7ff6f40ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:53.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.059+0000 7ff6f9ff8700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6f40b8620 con 0x7ff6f40b8d90 2023-07-12T02:02:53.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.059+0000 7ff6f9ff8700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6f40b97a0 con 0x7ff6f40bc810 2023-07-12T02:02:53.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.059+0000 7ff6f9ff8700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f4144da0 con 0x7ff6f41449d0 2023-07-12T02:02:53.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.059+0000 7ff6f3fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff6f40b8d90 0x7ff6f406ade0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60564/0 (socket says 172.21.15.60:60564) 2023-07-12T02:02:53.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.059+0000 7ff6f3fff700 1 -- 172.21.15.60:0/3295388077 learned_addr learned my addr 172.21.15.60:0/3295388077 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:53.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.059+0000 7ff6f2ffd700 1 --2- 172.21.15.60:0/3295388077 >> v2:172.21.15.79:3300/0 conn(0x7ff6f40bc810 0x7ff6f40ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:53.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.059+0000 7ff6f37fe700 1 --2- 172.21.15.60:0/3295388077 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6f41449d0 0x7ff6f414db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:53.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.059+0000 7ff6f27fc700 1 -- 172.21.15.60:0/3295388077 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3662623495 0 0) 0x7ff6f40b8620 con 0x7ff6f40b8d90 2023-07-12T02:02:53.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.059+0000 7ff6f27fc700 1 -- 172.21.15.60:0/3295388077 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6dc0035b0 con 0x7ff6f40b8d90 2023-07-12T02:02:53.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.059+0000 7ff6f27fc700 1 -- 172.21.15.60:0/3295388077 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2992550513 0 0) 0x7ff6dc0035b0 con 0x7ff6f40b8d90 2023-07-12T02:02:53.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.059+0000 7ff6f27fc700 1 -- 172.21.15.60:0/3295388077 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6f41449d0 msgr2=0x7ff6f414db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:53.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.059+0000 7ff6f27fc700 1 --2- 172.21.15.60:0/3295388077 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6f41449d0 0x7ff6f414db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:53.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.059+0000 7ff6f27fc700 1 -- 172.21.15.60:0/3295388077 >> v2:172.21.15.79:3300/0 conn(0x7ff6f40bc810 msgr2=0x7ff6f40ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:53.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.059+0000 7ff6f27fc700 1 --2- 172.21.15.60:0/3295388077 >> v2:172.21.15.79:3300/0 conn(0x7ff6f40bc810 0x7ff6f40ba530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:53.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.059+0000 7ff6f27fc700 1 -- 172.21.15.60:0/3295388077 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f40b8900 con 0x7ff6f40b8d90 2023-07-12T02:02:53.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.059+0000 7ff6f27fc700 1 -- 172.21.15.60:0/3295388077 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1141905739 0 0) 0x7ff6ec0019f0 con 0x7ff6f40b8d90 2023-07-12T02:02:53.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.059+0000 7ff6f37fe700 1 --2- 172.21.15.60:0/3295388077 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6f41449d0 0x7ff6f414db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:02:53.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.059+0000 7ff6f27fc700 1 -- 172.21.15.60:0/3295388077 >> v1:172.21.15.60:6789/0 conn(0x7ff6f40b8d90 legacy=0x7ff6f406ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:53.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.059+0000 7ff6f27fc700 1 --2- 172.21.15.60:0/3295388077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6dc003a00 0x7ff6dc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:53.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.059+0000 7ff6f27fc700 1 --2- 172.21.15.60:0/3295388077 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6dc004430 0x7ff6dc0048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:53.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.059+0000 7ff6f27fc700 1 --2- 172.21.15.60:0/3295388077 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6f41449d0 0x7ff6dc004f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:53.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.059+0000 7ff6f27fc700 1 -- 172.21.15.60:0/3295388077 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f40b97a0 con 0x7ff6dc004430 2023-07-12T02:02:53.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.059+0000 7ff6f27fc700 1 -- 172.21.15.60:0/3295388077 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6dc00ba10 con 0x7ff6dc003a00 2023-07-12T02:02:53.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.059+0000 7ff6f27fc700 1 -- 172.21.15.60:0/3295388077 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6dc00bb50 con 0x7ff6f41449d0 2023-07-12T02:02:53.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.059+0000 7ff6f2ffd700 1 --2- 172.21.15.60:0/3295388077 >> v2:172.21.15.79:3300/0 conn(0x7ff6f40bc810 0x7ff6f40ba530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:02:53.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.059+0000 7ff6f37fe700 1 --2- 172.21.15.60:0/3295388077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6dc003a00 0x7ff6dc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:53.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.059+0000 7ff6f2ffd700 1 --2- 172.21.15.60:0/3295388077 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6dc004430 0x7ff6dc0048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:53.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.060+0000 7ff6f3fff700 1 --2- 172.21.15.60:0/3295388077 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6f41449d0 0x7ff6dc004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:53.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.060+0000 7ff6f2ffd700 1 -- 172.21.15.60:0/3295388077 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6f41449d0 msgr2=0x7ff6dc004f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:53.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.060+0000 7ff6f2ffd700 1 --2- 172.21.15.60:0/3295388077 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6f41449d0 0x7ff6dc004f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:53.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.060+0000 7ff6f2ffd700 1 -- 172.21.15.60:0/3295388077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6dc003a00 msgr2=0x7ff6dc003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:53.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.060+0000 7ff6f2ffd700 1 --2- 172.21.15.60:0/3295388077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6dc003a00 0x7ff6dc003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:53.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.060+0000 7ff6f2ffd700 1 -- 172.21.15.60:0/3295388077 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e40094a0 con 0x7ff6dc004430 2023-07-12T02:02:53.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.060+0000 7ff6f2ffd700 1 --2- 172.21.15.60:0/3295388077 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6dc004430 0x7ff6dc0048f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8009d40 tx=0x7ff6dc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccc3457e9d053497 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:53.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.060+0000 7ff6f27fc700 1 -- 172.21.15.60:0/3295388077 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e8009e90 con 0x7ff6dc004430 2023-07-12T02:02:53.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.060+0000 7ff6f27fc700 1 -- 172.21.15.60:0/3295388077 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e800e9a0 con 0x7ff6dc004430 2023-07-12T02:02:53.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.060+0000 7ff6f27fc700 1 -- 172.21.15.60:0/3295388077 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e800ed10 con 0x7ff6dc004430 2023-07-12T02:02:53.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.061+0000 7ff6f9ff8700 1 -- 172.21.15.60:0/3295388077 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6dc004430 msgr2=0x7ff6dc0048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:53.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.061+0000 7ff6f9ff8700 1 --2- 172.21.15.60:0/3295388077 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6dc004430 0x7ff6dc0048f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8009d40 tx=0x7ff6dc005880 comp rx=0 tx=0).stop 2023-07-12T02:02:53.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.061+0000 7ff6f3fff700 1 -- 172.21.15.60:0/3295388077 reap_dead start 2023-07-12T02:02:53.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.061+0000 7ff6f9ff8700 1 -- 172.21.15.60:0/3295388077 shutdown_connections 2023-07-12T02:02:53.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.061+0000 7ff6f9ff8700 1 -- 172.21.15.60:0/3295388077 >> 172.21.15.60:0/3295388077 conn(0x7ff6f40c0860 msgr2=0x7ff6f40c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:53.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.061+0000 7ff6f9ff8700 1 -- 172.21.15.60:0/3295388077 shutdown_connections 2023-07-12T02:02:53.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.061+0000 7ff6f9ff8700 1 -- 172.21.15.60:0/3295388077 wait complete. 2023-07-12T02:02:53.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.062+0000 7ff6f9ff8700 1 Processor -- start 2023-07-12T02:02:53.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.062+0000 7ff6f9ff8700 1 -- start start 2023-07-12T02:02:53.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.063+0000 7ff6f9ff8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6dc004430 0x7ff6f40b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:53.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.063+0000 7ff6f9ff8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6f4147cb0 0x7ff6f40b6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:53.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.063+0000 7ff6f9ff8700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6f41462a0 0x7ff6f40a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:53.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.063+0000 7ff6f9ff8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f40b6550 con 0x7ff6dc004430 2023-07-12T02:02:53.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.063+0000 7ff6f9ff8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f4145e10 con 0x7ff6f4147cb0 2023-07-12T02:02:53.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.063+0000 7ff6f9ff8700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f4144ef0 con 0x7ff6f41462a0 2023-07-12T02:02:53.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.063+0000 7ff6f37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6dc004430 0x7ff6f40b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:53.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.063+0000 7ff6f37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6dc004430 0x7ff6f40b2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58568/0 (socket says 172.21.15.60:58568) 2023-07-12T02:02:53.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.063+0000 7ff6f37fe700 1 -- 172.21.15.60:0/2985042461 learned_addr learned my addr 172.21.15.60:0/2985042461 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:53.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.063+0000 7ff6f3fff700 1 --2- 172.21.15.60:0/2985042461 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6f41462a0 0x7ff6f40a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:53.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.063+0000 7ff6f37fe700 1 -- 172.21.15.60:0/2985042461 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6f41462a0 msgr2=0x7ff6f40a6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:53.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.063+0000 7ff6f2ffd700 1 --2- 172.21.15.60:0/2985042461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6f4147cb0 0x7ff6f40b6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:53.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.063+0000 7ff6f37fe700 1 --2- 172.21.15.60:0/2985042461 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6f41462a0 0x7ff6f40a6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:53.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.063+0000 7ff6f37fe700 1 -- 172.21.15.60:0/2985042461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6f4147cb0 msgr2=0x7ff6f40b6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:53.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.063+0000 7ff6f37fe700 1 --2- 172.21.15.60:0/2985042461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6f4147cb0 0x7ff6f40b6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:53.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.063+0000 7ff6f37fe700 1 -- 172.21.15.60:0/2985042461 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f4146720 con 0x7ff6dc004430 2023-07-12T02:02:53.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.063+0000 7ff6f3fff700 1 --2- 172.21.15.60:0/2985042461 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6f41462a0 0x7ff6f40a6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:02:53.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.063+0000 7ff6f2ffd700 1 --2- 172.21.15.60:0/2985042461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6f4147cb0 0x7ff6f40b6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:02:53.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.063+0000 7ff6f37fe700 1 --2- 172.21.15.60:0/2985042461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6dc004430 0x7ff6f40b2170 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4011ca0 tx=0x7ff6e400f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:53.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.063+0000 7ff6dbfff700 1 -- 172.21.15.60:0/2985042461 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e400fb30 con 0x7ff6dc004430 2023-07-12T02:02:53.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.063+0000 7ff6dbfff700 1 -- 172.21.15.60:0/2985042461 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e400fc90 con 0x7ff6dc004430 2023-07-12T02:02:53.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.063+0000 7ff6f9ff8700 1 -- 172.21.15.60:0/2985042461 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6f40b3d90 con 0x7ff6dc004430 2023-07-12T02:02:53.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.063+0000 7ff6dbfff700 1 -- 172.21.15.60:0/2985042461 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e4004020 con 0x7ff6dc004430 2023-07-12T02:02:53.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.063+0000 7ff6f9ff8700 1 -- 172.21.15.60:0/2985042461 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6f40bfe60 con 0x7ff6dc004430 2023-07-12T02:02:53.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.064+0000 7ff6f9ff8700 1 -- 172.21.15.60:0/2985042461 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6f406b470 con 0x7ff6dc004430 2023-07-12T02:02:53.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.065+0000 7ff6dbfff700 1 -- 172.21.15.60:0/2985042461 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff6e4004180 con 0x7ff6dc004430 2023-07-12T02:02:53.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.065+0000 7ff6dbfff700 1 --2- 172.21.15.60:0/2985042461 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ff6e006ace0 0x7ff6e006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:53.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.065+0000 7ff6dbfff700 1 -- 172.21.15.60:0/2985042461 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff6e4089540 con 0x7ff6dc004430 2023-07-12T02:02:53.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.065+0000 7ff6f2ffd700 1 --2- 172.21.15.60:0/2985042461 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ff6e006ace0 0x7ff6e006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:53.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.066+0000 7ff6f2ffd700 1 --2- 172.21.15.60:0/2985042461 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ff6e006ace0 0x7ff6e006d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff6f40b3cc0 tx=0x7ff6e8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:53.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.070+0000 7ff6dbfff700 1 -- 172.21.15.60:0/2985042461 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7ff6e40549d0 con 0x7ff6dc004430 2023-07-12T02:02:53.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.347+0000 7ff6f9ff8700 1 -- 172.21.15.60:0/2985042461 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7ff6f40bcf50 con 0x7ff6dc004430 2023-07-12T02:02:53.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.350+0000 7ff6dbfff700 1 -- 172.21.15.60:0/2985042461 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff6e4057ff0 con 0x7ff6dc004430 2023-07-12T02:02:53.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.352+0000 7ff6f9ff8700 1 -- 172.21.15.60:0/2985042461 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ff6e006ace0 msgr2=0x7ff6e006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:53.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.352+0000 7ff6f9ff8700 1 --2- 172.21.15.60:0/2985042461 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ff6e006ace0 0x7ff6e006d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff6f40b3cc0 tx=0x7ff6e8008030 comp rx=0 tx=0).stop 2023-07-12T02:02:53.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.352+0000 7ff6f9ff8700 1 -- 172.21.15.60:0/2985042461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6dc004430 msgr2=0x7ff6f40b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:53.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.352+0000 7ff6f9ff8700 1 --2- 172.21.15.60:0/2985042461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6dc004430 0x7ff6f40b2170 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4011ca0 tx=0x7ff6e400f520 comp rx=0 tx=0).stop 2023-07-12T02:02:53.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.352+0000 7ff6f9ff8700 1 -- 172.21.15.60:0/2985042461 shutdown_connections 2023-07-12T02:02:53.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.352+0000 7ff6f9ff8700 1 --2- 172.21.15.60:0/2985042461 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ff6e006ace0 0x7ff6e006d190 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:53.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.353+0000 7ff6f9ff8700 1 --2- 172.21.15.60:0/2985042461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6dc004430 0x7ff6f40b2170 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:53.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.353+0000 7ff6f9ff8700 1 --2- 172.21.15.60:0/2985042461 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6f41462a0 0x7ff6f40a6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:53.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.353+0000 7ff6f9ff8700 1 --2- 172.21.15.60:0/2985042461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6f4147cb0 0x7ff6f40b6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:53.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.353+0000 7ff6f9ff8700 1 -- 172.21.15.60:0/2985042461 >> 172.21.15.60:0/2985042461 conn(0x7ff6f40c0860 msgr2=0x7ff6f4142030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:53.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.353+0000 7ff6f9ff8700 1 -- 172.21.15.60:0/2985042461 shutdown_connections 2023-07-12T02:02:53.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.353+0000 7ff6f9ff8700 1 -- 172.21.15.60:0/2985042461 wait complete. 2023-07-12T02:02:53.369 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-07-12T02:02:53.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.492+0000 7f34b848f700 1 Processor -- start 2023-07-12T02:02:53.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.492+0000 7f34b848f700 1 -- start start 2023-07-12T02:02:53.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.493+0000 7f34b848f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f34b01449d0 0x7f34b014db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:53.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.493+0000 7f34b848f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f34b00b8d90 0x7f34b006ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:53.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.493+0000 7f34b848f700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34b00b8620 con 0x7f34b00bc810 2023-07-12T02:02:53.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.493+0000 7f34b848f700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34b00b97a0 con 0x7f34b01449d0 2023-07-12T02:02:53.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.493+0000 7f34b848f700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34b0144da0 con 0x7f34b00b8d90 2023-07-12T02:02:53.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.493+0000 7f34b622b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f34b01449d0 0x7f34b014db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:53.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.493+0000 7f34b5a2a700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f34b00bc810 0x7f34b00ba530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60580/0 (socket says 172.21.15.60:60580) 2023-07-12T02:02:53.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.493+0000 7f34b5a2a700 1 -- 172.21.15.60:0/1212571707 learned_addr learned my addr 172.21.15.60:0/1212571707 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:53.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.493+0000 7f34b6a2c700 1 --2- 172.21.15.60:0/1212571707 >> v2:172.21.15.79:3300/0 conn(0x7f34b00b8d90 0x7f34b006ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:53.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.493+0000 7f34b622b700 1 -- 172.21.15.60:0/1212571707 >> v2:172.21.15.79:3300/0 conn(0x7f34b00b8d90 msgr2=0x7f34b006ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:53.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.493+0000 7f34b622b700 1 --2- 172.21.15.60:0/1212571707 >> v2:172.21.15.79:3300/0 conn(0x7f34b00b8d90 0x7f34b006ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:53.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.493+0000 7f34b622b700 1 -- 172.21.15.60:0/1212571707 >> v1:172.21.15.60:6789/0 conn(0x7f34b00bc810 legacy=0x7f34b00ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:53.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.494+0000 7f34b622b700 1 -- 172.21.15.60:0/1212571707 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b00b8900 con 0x7f34b01449d0 2023-07-12T02:02:53.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.493+0000 7f34b5229700 1 -- 172.21.15.60:0/1212571707 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3514743812 0 0) 0x7f34b00b8620 con 0x7f34b00bc810 2023-07-12T02:02:53.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.494+0000 7f34b622b700 1 --2- 172.21.15.60:0/1212571707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34b01449d0 0x7f34b014db50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f34b00be710 tx=0x7f34a0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa04c61a16c34d1a server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:53.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.494+0000 7f34b5229700 1 -- 172.21.15.60:0/1212571707 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a0011830 con 0x7f34b01449d0 2023-07-12T02:02:53.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.494+0000 7f34b5229700 1 -- 172.21.15.60:0/1212571707 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a0011990 con 0x7f34b01449d0 2023-07-12T02:02:53.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.494+0000 7f34b5229700 1 -- 172.21.15.60:0/1212571707 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a0011d20 con 0x7f34b01449d0 2023-07-12T02:02:53.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.494+0000 7f34b848f700 1 -- 172.21.15.60:0/1212571707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34b01449d0 msgr2=0x7f34b014db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:53.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.494+0000 7f34b848f700 1 --2- 172.21.15.60:0/1212571707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34b01449d0 0x7f34b014db50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f34b00be710 tx=0x7f34a0009b20 comp rx=0 tx=0).stop 2023-07-12T02:02:53.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.494+0000 7f34b848f700 1 -- 172.21.15.60:0/1212571707 shutdown_connections 2023-07-12T02:02:53.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.494+0000 7f34b848f700 1 --2- 172.21.15.60:0/1212571707 >> v2:172.21.15.79:3300/0 conn(0x7f34b00b8d90 0x7f34b006ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:53.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.494+0000 7f34b848f700 1 --2- 172.21.15.60:0/1212571707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34b01449d0 0x7f34b014db50 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:53.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.494+0000 7f34b848f700 1 -- 172.21.15.60:0/1212571707 >> 172.21.15.60:0/1212571707 conn(0x7f34b00c0860 msgr2=0x7f34b00c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:53.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.494+0000 7f34b848f700 1 -- 172.21.15.60:0/1212571707 shutdown_connections 2023-07-12T02:02:53.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.494+0000 7f34b848f700 1 -- 172.21.15.60:0/1212571707 wait complete. 2023-07-12T02:02:53.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.496+0000 7f34b848f700 1 Processor -- start 2023-07-12T02:02:53.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.496+0000 7f34b848f700 1 -- start start 2023-07-12T02:02:53.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.496+0000 7f34b848f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34b00b8d90 0x7f34b01d4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:53.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.496+0000 7f34b848f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34b00bc810 0x7f34b01d4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:53.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.496+0000 7f34b848f700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f34b01449d0 0x7f34b01d6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:53.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.496+0000 7f34b848f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b01d4570 con 0x7f34b00b8d90 2023-07-12T02:02:53.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.496+0000 7f34b848f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b0143080 con 0x7f34b00bc810 2023-07-12T02:02:53.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.496+0000 7f34b848f700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b014a910 con 0x7f34b01449d0 2023-07-12T02:02:53.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.496+0000 7f34b622b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34b00b8d90 0x7f34b01d4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:53.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.496+0000 7f34b622b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34b00b8d90 0x7f34b01d4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58590/0 (socket says 172.21.15.60:58590) 2023-07-12T02:02:53.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.496+0000 7f34b622b700 1 -- 172.21.15.60:0/1941854754 learned_addr learned my addr 172.21.15.60:0/1941854754 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:53.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.497+0000 7f34b5a2a700 1 --2- 172.21.15.60:0/1941854754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34b00bc810 0x7f34b01d4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:53.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.497+0000 7f34b6a2c700 1 --2- 172.21.15.60:0/1941854754 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f34b01449d0 0x7f34b01d6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:53.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.497+0000 7f34b622b700 1 -- 172.21.15.60:0/1941854754 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f34b01449d0 msgr2=0x7f34b01d6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:53.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.497+0000 7f34b622b700 1 --2- 172.21.15.60:0/1941854754 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f34b01449d0 0x7f34b01d6fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:53.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.497+0000 7f34b622b700 1 -- 172.21.15.60:0/1941854754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34b00bc810 msgr2=0x7f34b01d4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:53.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.497+0000 7f34b622b700 1 --2- 172.21.15.60:0/1941854754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34b00bc810 0x7f34b01d4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:53.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.497+0000 7f34b622b700 1 -- 172.21.15.60:0/1941854754 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a00094a0 con 0x7f34b00b8d90 2023-07-12T02:02:53.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.497+0000 7f34b622b700 1 --2- 172.21.15.60:0/1941854754 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34b00b8d90 0x7f34b01d4f10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f34a0014040 tx=0x7f34a0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:53.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.497+0000 7f34a6ffd700 1 -- 172.21.15.60:0/1941854754 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a00038a0 con 0x7f34b00b8d90 2023-07-12T02:02:53.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.497+0000 7f34a6ffd700 1 -- 172.21.15.60:0/1941854754 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a001e070 con 0x7f34b00b8d90 2023-07-12T02:02:53.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.497+0000 7f34b848f700 1 -- 172.21.15.60:0/1941854754 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34b014abf0 con 0x7f34b00b8d90 2023-07-12T02:02:53.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.497+0000 7f34a6ffd700 1 -- 172.21.15.60:0/1941854754 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a0003c20 con 0x7f34b00b8d90 2023-07-12T02:02:53.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.497+0000 7f34b848f700 1 -- 172.21.15.60:0/1941854754 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34b00c13d0 con 0x7f34b00b8d90 2023-07-12T02:02:53.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.498+0000 7f34b848f700 1 -- 172.21.15.60:0/1941854754 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34b00c15c0 con 0x7f34b00b8d90 2023-07-12T02:02:53.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.498+0000 7f34a6ffd700 1 -- 172.21.15.60:0/1941854754 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f34a002d450 con 0x7f34b00b8d90 2023-07-12T02:02:53.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.499+0000 7f34a6ffd700 1 --2- 172.21.15.60:0/1941854754 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f349406ace0 0x7f349406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:53.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.499+0000 7f34a6ffd700 1 -- 172.21.15.60:0/1941854754 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f34a008a150 con 0x7f34b00b8d90 2023-07-12T02:02:53.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.499+0000 7f34b5a2a700 1 --2- 172.21.15.60:0/1941854754 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f349406ace0 0x7f349406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:53.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.500+0000 7f34b5a2a700 1 --2- 172.21.15.60:0/1941854754 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f349406ace0 0x7f349406d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f34b00c0150 tx=0x7f34ac007be0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:53.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.503+0000 7f34a6ffd700 1 -- 172.21.15.60:0/1941854754 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f34a00555e0 con 0x7f34b00b8d90 2023-07-12T02:02:53.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.783+0000 7f34b848f700 1 -- 172.21.15.60:0/1941854754 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f34b0074360 con 0x7f34b00b8d90 2023-07-12T02:02:53.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.786+0000 7f34a6ffd700 1 -- 172.21.15.60:0/1941854754 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f34a002c3b0 con 0x7f34b00b8d90 2023-07-12T02:02:53.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.788+0000 7f34b848f700 1 -- 172.21.15.60:0/1941854754 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f349406ace0 msgr2=0x7f349406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:53.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.788+0000 7f34b848f700 1 --2- 172.21.15.60:0/1941854754 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f349406ace0 0x7f349406d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f34b00c0150 tx=0x7f34ac007be0 comp rx=0 tx=0).stop 2023-07-12T02:02:53.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.788+0000 7f34b848f700 1 -- 172.21.15.60:0/1941854754 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34b00b8d90 msgr2=0x7f34b01d4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:53.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.788+0000 7f34b848f700 1 --2- 172.21.15.60:0/1941854754 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34b00b8d90 0x7f34b01d4f10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f34a0014040 tx=0x7f34a0004750 comp rx=0 tx=0).stop 2023-07-12T02:02:53.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.788+0000 7f34b848f700 1 -- 172.21.15.60:0/1941854754 shutdown_connections 2023-07-12T02:02:53.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.788+0000 7f34b848f700 1 --2- 172.21.15.60:0/1941854754 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f349406ace0 0x7f349406d190 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:53.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.788+0000 7f34b848f700 1 --2- 172.21.15.60:0/1941854754 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34b00b8d90 0x7f34b01d4f10 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:53.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.788+0000 7f34b848f700 1 --2- 172.21.15.60:0/1941854754 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f34b01449d0 0x7f34b01d6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:53.794 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.788+0000 7f34b848f700 1 --2- 172.21.15.60:0/1941854754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34b00bc810 0x7f34b01d4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:53.794 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.788+0000 7f34b848f700 1 -- 172.21.15.60:0/1941854754 >> 172.21.15.60:0/1941854754 conn(0x7f34b00c0860 msgr2=0x7f34b014d320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:53.794 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.788+0000 7f34b848f700 1 -- 172.21.15.60:0/1941854754 shutdown_connections 2023-07-12T02:02:53.794 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.788+0000 7f34b848f700 1 -- 172.21.15.60:0/1941854754 wait complete. 2023-07-12T02:02:53.804 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-07-12T02:02:53.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.927+0000 7f53eeeca700 1 Processor -- start 2023-07-12T02:02:53.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.927+0000 7f53eeeca700 1 -- start start 2023-07-12T02:02:53.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.928+0000 7f53eeeca700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f53e80b96b0 0x7f53e8152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:53.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.928+0000 7f53eeeca700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e8070e70 con 0x7f53e8071a30 2023-07-12T02:02:53.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.928+0000 7f53eeeca700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e80ba720 con 0x7f53e8141780 2023-07-12T02:02:53.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.928+0000 7f53eeeca700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53e8071ea0 con 0x7f53e80b96b0 2023-07-12T02:02:53.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.928+0000 7f53e7fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f53e8071a30 0x7f53e814ab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60590/0 (socket says 172.21.15.60:60590) 2023-07-12T02:02:53.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.928+0000 7f53e7fff700 1 -- 172.21.15.60:0/3115343982 learned_addr learned my addr 172.21.15.60:0/3115343982 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:53.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.928+0000 7f53ed467700 1 --2- 172.21.15.60:0/3115343982 >> v2:172.21.15.79:3300/0 conn(0x7f53e80b96b0 0x7f53e8152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:53.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.928+0000 7f53e77fe700 1 -- 172.21.15.60:0/3115343982 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 309570569 0 0) 0x7f53e8070e70 con 0x7f53e8071a30 2023-07-12T02:02:53.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.928+0000 7f53e77fe700 1 -- 172.21.15.60:0/3115343982 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53d80035b0 con 0x7f53e8071a30 2023-07-12T02:02:53.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.929+0000 7f53e77fe700 1 -- 172.21.15.60:0/3115343982 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1898591445 0 0) 0x7f53d80035b0 con 0x7f53e8071a30 2023-07-12T02:02:53.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.929+0000 7f53e77fe700 1 -- 172.21.15.60:0/3115343982 >> v2:172.21.15.79:3300/0 conn(0x7f53e80b96b0 msgr2=0x7f53e8152ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:53.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.929+0000 7f53e77fe700 1 --2- 172.21.15.60:0/3115343982 >> v2:172.21.15.79:3300/0 conn(0x7f53e80b96b0 0x7f53e8152ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:53.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.929+0000 7f53e77fe700 1 -- 172.21.15.60:0/3115343982 >> v1:172.21.15.79:6789/0 conn(0x7f53e8141780 legacy=0x7f53e80ba010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:53.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.929+0000 7f53e77fe700 1 -- 172.21.15.60:0/3115343982 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e80b9b40 con 0x7f53e8071a30 2023-07-12T02:02:53.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.929+0000 7f53e77fe700 1 -- 172.21.15.60:0/3115343982 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1141905739 0 0) 0x7f53d4001670 con 0x7f53e8071a30 2023-07-12T02:02:53.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.929+0000 7f53ed467700 1 --2- 172.21.15.60:0/3115343982 >> v2:172.21.15.79:3300/0 conn(0x7f53e80b96b0 0x7f53e8152ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:02:53.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.929+0000 7f53e77fe700 1 -- 172.21.15.60:0/3115343982 >> v1:172.21.15.60:6789/0 conn(0x7f53e8071a30 legacy=0x7f53e814ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:53.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.929+0000 7f53e77fe700 1 --2- 172.21.15.60:0/3115343982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53d8003a00 0x7f53d8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:53.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.929+0000 7f53e77fe700 1 --2- 172.21.15.60:0/3115343982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53d8004850 0x7f53d8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:53.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.929+0000 7f53e77fe700 1 --2- 172.21.15.60:0/3115343982 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f53d8005200 0x7f53d800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:53.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.929+0000 7f53e77fe700 1 -- 172.21.15.60:0/3115343982 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e8071ea0 con 0x7f53d8004850 2023-07-12T02:02:53.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.929+0000 7f53e77fe700 1 -- 172.21.15.60:0/3115343982 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d800c110 con 0x7f53d8003a00 2023-07-12T02:02:53.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.929+0000 7f53e77fe700 1 -- 172.21.15.60:0/3115343982 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d800c2d0 con 0x7f53d8005200 2023-07-12T02:02:53.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.929+0000 7f53e7fff700 1 --2- 172.21.15.60:0/3115343982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53d8004850 0x7f53d8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:53.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.929+0000 7f53ecc66700 1 --2- 172.21.15.60:0/3115343982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53d8003a00 0x7f53d8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:53.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.929+0000 7f53ed467700 1 --2- 172.21.15.60:0/3115343982 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f53d8005200 0x7f53d800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:53.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.929+0000 7f53e7fff700 1 -- 172.21.15.60:0/3115343982 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f53d8005200 msgr2=0x7f53d800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:53.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.929+0000 7f53e7fff700 1 --2- 172.21.15.60:0/3115343982 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f53d8005200 0x7f53d800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:53.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.929+0000 7f53e7fff700 1 -- 172.21.15.60:0/3115343982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53d8003a00 msgr2=0x7f53d8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:53.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.929+0000 7f53e7fff700 1 --2- 172.21.15.60:0/3115343982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53d8003a00 0x7f53d8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:53.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.929+0000 7f53e7fff700 1 -- 172.21.15.60:0/3115343982 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d80035b0 con 0x7f53d8004850 2023-07-12T02:02:53.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.929+0000 7f53ed467700 1 -- 172.21.15.60:0/3115343982 reap_dead start 2023-07-12T02:02:53.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.929+0000 7f53e7fff700 1 --2- 172.21.15.60:0/3115343982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53d8004850 0x7f53d8004cc0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f53e806f450 tx=0x7f53d8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4f89a39e6cab787 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:53.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.929+0000 7f53e77fe700 1 -- 172.21.15.60:0/3115343982 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d4007c10 con 0x7f53d8004850 2023-07-12T02:02:53.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.929+0000 7f53e77fe700 1 -- 172.21.15.60:0/3115343982 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d400cda0 con 0x7f53d8004850 2023-07-12T02:02:53.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.929+0000 7f53e77fe700 1 -- 172.21.15.60:0/3115343982 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d4005ba0 con 0x7f53d8004850 2023-07-12T02:02:53.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.930+0000 7f53eeeca700 1 -- 172.21.15.60:0/3115343982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53d8004850 msgr2=0x7f53d8004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:53.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.930+0000 7f53eeeca700 1 --2- 172.21.15.60:0/3115343982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53d8004850 0x7f53d8004cc0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f53e806f450 tx=0x7f53d8005880 comp rx=0 tx=0).stop 2023-07-12T02:02:53.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.930+0000 7f53eeeca700 1 -- 172.21.15.60:0/3115343982 shutdown_connections 2023-07-12T02:02:53.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.930+0000 7f53eeeca700 1 --2- 172.21.15.60:0/3115343982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53d8004850 0x7f53d8004cc0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:53.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.930+0000 7f53eeeca700 1 -- 172.21.15.60:0/3115343982 >> 172.21.15.60:0/3115343982 conn(0x7f53e806d0e0 msgr2=0x7f53e806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:53.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.930+0000 7f53eeeca700 1 -- 172.21.15.60:0/3115343982 shutdown_connections 2023-07-12T02:02:53.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.930+0000 7f53eeeca700 1 -- 172.21.15.60:0/3115343982 wait complete. 2023-07-12T02:02:53.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.931+0000 7f53eeeca700 1 Processor -- start 2023-07-12T02:02:53.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.931+0000 7f53eeeca700 1 -- start start 2023-07-12T02:02:53.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.932+0000 7f53eeeca700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53d8004850 0x7f53e814a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:53.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.932+0000 7f53eeeca700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f53e80b7540 0x7f53e81dddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:53.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.932+0000 7f53eeeca700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53e80b5cc0 0x7f53e8134810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:53.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.932+0000 7f53eeeca700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e814a8b0 con 0x7f53e80b5cc0 2023-07-12T02:02:53.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.932+0000 7f53eeeca700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e80bc800 con 0x7f53d8004850 2023-07-12T02:02:53.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.932+0000 7f53eeeca700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e81de2f0 con 0x7f53e80b7540 2023-07-12T02:02:53.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.932+0000 7f53ed467700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53e80b5cc0 0x7f53e8134810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:53.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.932+0000 7f53ed467700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53e80b5cc0 0x7f53e8134810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58614/0 (socket says 172.21.15.60:58614) 2023-07-12T02:02:53.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.932+0000 7f53ed467700 1 -- 172.21.15.60:0/381785313 learned_addr learned my addr 172.21.15.60:0/381785313 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:53.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.932+0000 7f53e7fff700 1 --2- 172.21.15.60:0/381785313 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f53e80b7540 0x7f53e81dddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:53.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.932+0000 7f53ecc66700 1 --2- 172.21.15.60:0/381785313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53d8004850 0x7f53e814a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:53.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.932+0000 7f53ed467700 1 -- 172.21.15.60:0/381785313 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f53e80b7540 msgr2=0x7f53e81dddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:53.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.932+0000 7f53ed467700 1 --2- 172.21.15.60:0/381785313 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f53e80b7540 0x7f53e81dddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:53.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.932+0000 7f53ed467700 1 -- 172.21.15.60:0/381785313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53d8004850 msgr2=0x7f53e814a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:53.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.932+0000 7f53ed467700 1 --2- 172.21.15.60:0/381785313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53d8004850 0x7f53e814a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:53.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.932+0000 7f53ed467700 1 -- 172.21.15.60:0/381785313 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e80bca70 con 0x7f53e80b5cc0 2023-07-12T02:02:53.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.932+0000 7f53ed467700 1 --2- 172.21.15.60:0/381785313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53e80b5cc0 0x7f53e8134810 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f53e80b7be0 tx=0x7f53e0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:53.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.933+0000 7f53e57fa700 1 -- 172.21.15.60:0/381785313 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e000e070 con 0x7f53e80b5cc0 2023-07-12T02:02:53.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.933+0000 7f53e57fa700 1 -- 172.21.15.60:0/381785313 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e0011cd0 con 0x7f53e80b5cc0 2023-07-12T02:02:53.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.933+0000 7f53eeeca700 1 -- 172.21.15.60:0/381785313 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53e80bb480 con 0x7f53e80b5cc0 2023-07-12T02:02:53.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.933+0000 7f53e57fa700 1 -- 172.21.15.60:0/381785313 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e0011e60 con 0x7f53e80b5cc0 2023-07-12T02:02:53.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.933+0000 7f53eeeca700 1 -- 172.21.15.60:0/381785313 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53e80b7020 con 0x7f53e80b5cc0 2023-07-12T02:02:53.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.934+0000 7f53eeeca700 1 -- 172.21.15.60:0/381785313 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53e80b6e80 con 0x7f53e80b5cc0 2023-07-12T02:02:53.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.934+0000 7f53e57fa700 1 -- 172.21.15.60:0/381785313 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f53e0003a20 con 0x7f53e80b5cc0 2023-07-12T02:02:53.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.934+0000 7f53e57fa700 1 --2- 172.21.15.60:0/381785313 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f53cc06ace0 0x7f53cc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:53.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.935+0000 7f53e57fa700 1 -- 172.21.15.60:0/381785313 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f53e0089740 con 0x7f53e80b5cc0 2023-07-12T02:02:53.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.935+0000 7f53ecc66700 1 --2- 172.21.15.60:0/381785313 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f53cc06ace0 0x7f53cc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:53.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.935+0000 7f53ecc66700 1 --2- 172.21.15.60:0/381785313 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f53cc06ace0 0x7f53cc06d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f53dc007fd0 tx=0x7f53dc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:53.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:53.939+0000 7f53e57fa700 1 -- 172.21.15.60:0/381785313 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f53e80b6e80 con 0x7f53e80b5cc0 2023-07-12T02:02:54.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.219+0000 7f53eeeca700 1 -- 172.21.15.60:0/381785313 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f53e80b6e80 con 0x7f53e80b5cc0 2023-07-12T02:02:54.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.223+0000 7f53e57fa700 1 -- 172.21.15.60:0/381785313 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7f53e80b6e80 con 0x7f53e80b5cc0 2023-07-12T02:02:54.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.225+0000 7f53eeeca700 1 -- 172.21.15.60:0/381785313 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f53cc06ace0 msgr2=0x7f53cc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:54.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.225+0000 7f53eeeca700 1 --2- 172.21.15.60:0/381785313 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f53cc06ace0 0x7f53cc06d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f53dc007fd0 tx=0x7f53dc009040 comp rx=0 tx=0).stop 2023-07-12T02:02:54.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.225+0000 7f53eeeca700 1 -- 172.21.15.60:0/381785313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53e80b5cc0 msgr2=0x7f53e8134810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:54.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.225+0000 7f53eeeca700 1 --2- 172.21.15.60:0/381785313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53e80b5cc0 0x7f53e8134810 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f53e80b7be0 tx=0x7f53e0009f90 comp rx=0 tx=0).stop 2023-07-12T02:02:54.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.225+0000 7f53eeeca700 1 -- 172.21.15.60:0/381785313 shutdown_connections 2023-07-12T02:02:54.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.225+0000 7f53eeeca700 1 --2- 172.21.15.60:0/381785313 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f53cc06ace0 0x7f53cc06d190 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:54.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.225+0000 7f53eeeca700 1 --2- 172.21.15.60:0/381785313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53e80b5cc0 0x7f53e8134810 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:54.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.225+0000 7f53eeeca700 1 --2- 172.21.15.60:0/381785313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53d8004850 0x7f53e814a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:54.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.225+0000 7f53eeeca700 1 --2- 172.21.15.60:0/381785313 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f53e80b7540 0x7f53e81dddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:54.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.225+0000 7f53eeeca700 1 -- 172.21.15.60:0/381785313 >> 172.21.15.60:0/381785313 conn(0x7f53e806d0e0 msgr2=0x7f53e813f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:54.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.225+0000 7f53eeeca700 1 -- 172.21.15.60:0/381785313 shutdown_connections 2023-07-12T02:02:54.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.225+0000 7f53eeeca700 1 -- 172.21.15.60:0/381785313 wait complete. 2023-07-12T02:02:54.241 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-07-12T02:02:54.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.364+0000 7fb731d0a700 1 Processor -- start 2023-07-12T02:02:54.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.364+0000 7fb731d0a700 1 -- start start 2023-07-12T02:02:54.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.365+0000 7fb731d0a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb72c070da0 0x7fb72c06c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:54.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.365+0000 7fb731d0a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb72c06cd00 0x7fb72c1551e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:54.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.365+0000 7fb731d0a700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb72c070130 con 0x7fb72c071910 2023-07-12T02:02:54.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.365+0000 7fb731d0a700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb72c071540 con 0x7fb72c06cd00 2023-07-12T02:02:54.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.365+0000 7fb731d0a700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb72c071260 con 0x7fb72c070da0 2023-07-12T02:02:54.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.365+0000 7fb72bfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb72c06cd00 0x7fb72c1551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:54.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.365+0000 7fb72bfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb72c06cd00 0x7fb72c1551e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58622/0 (socket says 172.21.15.60:58622) 2023-07-12T02:02:54.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.365+0000 7fb72bfff700 1 -- 172.21.15.60:0/2990563703 learned_addr learned my addr 172.21.15.60:0/2990563703 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:54.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.365+0000 7fb72affd700 1 --2- 172.21.15.60:0/2990563703 >> v2:172.21.15.79:3300/0 conn(0x7fb72c070da0 0x7fb72c06c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:54.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.365+0000 7fb72bfff700 1 -- 172.21.15.60:0/2990563703 >> v2:172.21.15.79:3300/0 conn(0x7fb72c070da0 msgr2=0x7fb72c06c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:54.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.365+0000 7fb72bfff700 1 --2- 172.21.15.60:0/2990563703 >> v2:172.21.15.79:3300/0 conn(0x7fb72c070da0 0x7fb72c06c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:54.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.365+0000 7fb72bfff700 1 -- 172.21.15.60:0/2990563703 >> v1:172.21.15.79:6789/0 conn(0x7fb72c071910 legacy=0x7fb72c14b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:54.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.365+0000 7fb72bfff700 1 -- 172.21.15.60:0/2990563703 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb72c14aa60 con 0x7fb72c06cd00 2023-07-12T02:02:54.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.365+0000 7fb72bfff700 1 --2- 172.21.15.60:0/2990563703 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb72c06cd00 0x7fb72c1551e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb72c0702c0 tx=0x7fb72400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1160229b37b4374 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:54.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.365+0000 7fb72a7fc700 1 -- 172.21.15.60:0/2990563703 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72400e070 con 0x7fb72c06cd00 2023-07-12T02:02:54.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.365+0000 7fb72a7fc700 1 -- 172.21.15.60:0/2990563703 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb72400b950 con 0x7fb72c06cd00 2023-07-12T02:02:54.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.365+0000 7fb72a7fc700 1 -- 172.21.15.60:0/2990563703 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72400bd00 con 0x7fb72c06cd00 2023-07-12T02:02:54.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.366+0000 7fb731d0a700 1 -- 172.21.15.60:0/2990563703 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb72c06cd00 msgr2=0x7fb72c1551e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:54.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.366+0000 7fb731d0a700 1 --2- 172.21.15.60:0/2990563703 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb72c06cd00 0x7fb72c1551e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb72c0702c0 tx=0x7fb72400b330 comp rx=0 tx=0).stop 2023-07-12T02:02:54.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.366+0000 7fb731d0a700 1 -- 172.21.15.60:0/2990563703 shutdown_connections 2023-07-12T02:02:54.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.366+0000 7fb731d0a700 1 --2- 172.21.15.60:0/2990563703 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb72c06cd00 0x7fb72c1551e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:54.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.366+0000 7fb731d0a700 1 --2- 172.21.15.60:0/2990563703 >> v2:172.21.15.79:3300/0 conn(0x7fb72c070da0 0x7fb72c06c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:54.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.366+0000 7fb731d0a700 1 -- 172.21.15.60:0/2990563703 >> 172.21.15.60:0/2990563703 conn(0x7fb72c0be670 msgr2=0x7fb72c0bea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:54.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.366+0000 7fb731d0a700 1 -- 172.21.15.60:0/2990563703 shutdown_connections 2023-07-12T02:02:54.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.366+0000 7fb731d0a700 1 -- 172.21.15.60:0/2990563703 wait complete. 2023-07-12T02:02:54.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.367+0000 7fb731d0a700 1 Processor -- start 2023-07-12T02:02:54.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.367+0000 7fb731d0a700 1 -- start start 2023-07-12T02:02:54.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.368+0000 7fb731d0a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb72c06cd00 0x7fb72c1d6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:54.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.368+0000 7fb731d0a700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb72c070da0 0x7fb72c143130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:54.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.368+0000 7fb731d0a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb72c071910 0x7fb72c1e34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:54.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.368+0000 7fb731d0a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72c14d060 con 0x7fb72c071910 2023-07-12T02:02:54.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.368+0000 7fb731d0a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72c143670 con 0x7fb72c06cd00 2023-07-12T02:02:54.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.368+0000 7fb731d0a700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb72c143e20 con 0x7fb72c070da0 2023-07-12T02:02:54.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.368+0000 7fb72bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb72c071910 0x7fb72c1e34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:54.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.368+0000 7fb72bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb72c071910 0x7fb72c1e34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58638/0 (socket says 172.21.15.60:58638) 2023-07-12T02:02:54.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.368+0000 7fb72bfff700 1 -- 172.21.15.60:0/1753323180 learned_addr learned my addr 172.21.15.60:0/1753323180 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:54.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.368+0000 7fb72affd700 1 --2- 172.21.15.60:0/1753323180 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb72c070da0 0x7fb72c143130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:54.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.368+0000 7fb72b7fe700 1 --2- 172.21.15.60:0/1753323180 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb72c06cd00 0x7fb72c1d6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:54.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.368+0000 7fb72bfff700 1 -- 172.21.15.60:0/1753323180 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb72c070da0 msgr2=0x7fb72c143130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:54.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.368+0000 7fb72bfff700 1 --2- 172.21.15.60:0/1753323180 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb72c070da0 0x7fb72c143130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:54.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.368+0000 7fb72bfff700 1 -- 172.21.15.60:0/1753323180 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb72c06cd00 msgr2=0x7fb72c1d6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:54.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.368+0000 7fb72bfff700 1 --2- 172.21.15.60:0/1753323180 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb72c06cd00 0x7fb72c1d6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:54.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.368+0000 7fb72bfff700 1 -- 172.21.15.60:0/1753323180 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb724009b30 con 0x7fb72c071910 2023-07-12T02:02:54.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.368+0000 7fb72bfff700 1 --2- 172.21.15.60:0/1753323180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb72c071910 0x7fb72c1e34b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb72c14a990 tx=0x7fb724004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:54.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.369+0000 7fb723fff700 1 -- 172.21.15.60:0/1753323180 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb724003ea0 con 0x7fb72c071910 2023-07-12T02:02:54.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.369+0000 7fb723fff700 1 -- 172.21.15.60:0/1753323180 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb724004800 con 0x7fb72c071910 2023-07-12T02:02:54.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.369+0000 7fb731d0a700 1 -- 172.21.15.60:0/1753323180 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb72c1d6900 con 0x7fb72c071910 2023-07-12T02:02:54.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.369+0000 7fb723fff700 1 -- 172.21.15.60:0/1753323180 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb724004970 con 0x7fb72c071910 2023-07-12T02:02:54.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.369+0000 7fb731d0a700 1 -- 172.21.15.60:0/1753323180 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb72c14bea0 con 0x7fb72c071910 2023-07-12T02:02:54.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.369+0000 7fb731d0a700 1 -- 172.21.15.60:0/1753323180 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb72c14ba00 con 0x7fb72c071910 2023-07-12T02:02:54.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.370+0000 7fb723fff700 1 -- 172.21.15.60:0/1753323180 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb72401c660 con 0x7fb72c071910 2023-07-12T02:02:54.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.370+0000 7fb723fff700 1 --2- 172.21.15.60:0/1753323180 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fb70c06ace0 0x7fb70c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:54.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.370+0000 7fb723fff700 1 -- 172.21.15.60:0/1753323180 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb72408a990 con 0x7fb72c071910 2023-07-12T02:02:54.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.371+0000 7fb72b7fe700 1 --2- 172.21.15.60:0/1753323180 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fb70c06ace0 0x7fb70c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:54.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.371+0000 7fb72b7fe700 1 --2- 172.21.15.60:0/1753323180 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fb70c06ace0 0x7fb70c06d190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb71c009960 tx=0x7fb71c0090e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:54.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.375+0000 7fb723fff700 1 -- 172.21.15.60:0/1753323180 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fb724055e20 con 0x7fb72c071910 2023-07-12T02:02:54.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.658+0000 7fb731d0a700 1 -- 172.21.15.60:0/1753323180 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fb72c1d6af0 con 0x7fb72c071910 2023-07-12T02:02:54.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.662+0000 7fb723fff700 1 -- 172.21.15.60:0/1753323180 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb724059440 con 0x7fb72c071910 2023-07-12T02:02:54.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.664+0000 7fb731d0a700 1 -- 172.21.15.60:0/1753323180 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fb70c06ace0 msgr2=0x7fb70c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:54.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.664+0000 7fb731d0a700 1 --2- 172.21.15.60:0/1753323180 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fb70c06ace0 0x7fb70c06d190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb71c009960 tx=0x7fb71c0090e0 comp rx=0 tx=0).stop 2023-07-12T02:02:54.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.664+0000 7fb731d0a700 1 -- 172.21.15.60:0/1753323180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb72c071910 msgr2=0x7fb72c1e34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:54.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.664+0000 7fb731d0a700 1 --2- 172.21.15.60:0/1753323180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb72c071910 0x7fb72c1e34b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb72c14a990 tx=0x7fb724004ad0 comp rx=0 tx=0).stop 2023-07-12T02:02:54.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.664+0000 7fb731d0a700 1 -- 172.21.15.60:0/1753323180 shutdown_connections 2023-07-12T02:02:54.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.664+0000 7fb731d0a700 1 --2- 172.21.15.60:0/1753323180 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fb70c06ace0 0x7fb70c06d190 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:54.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.664+0000 7fb731d0a700 1 --2- 172.21.15.60:0/1753323180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb72c071910 0x7fb72c1e34b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:54.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.664+0000 7fb731d0a700 1 --2- 172.21.15.60:0/1753323180 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb72c06cd00 0x7fb72c1d6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:54.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.664+0000 7fb731d0a700 1 --2- 172.21.15.60:0/1753323180 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb72c070da0 0x7fb72c143130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:54.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.664+0000 7fb731d0a700 1 -- 172.21.15.60:0/1753323180 >> 172.21.15.60:0/1753323180 conn(0x7fb72c0be670 msgr2=0x7fb72c1d6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:54.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.664+0000 7fb731d0a700 1 -- 172.21.15.60:0/1753323180 shutdown_connections 2023-07-12T02:02:54.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.664+0000 7fb731d0a700 1 -- 172.21.15.60:0/1753323180 wait complete. 2023-07-12T02:02:54.680 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-07-12T02:02:54.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.802+0000 7fa34c700700 1 Processor -- start 2023-07-12T02:02:54.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.802+0000 7fa34c700700 1 -- start start 2023-07-12T02:02:54.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.803+0000 7fa34c700700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa344141780 0x7fa3440ba010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:54.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.803+0000 7fa34c700700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa344070e70 con 0x7fa3440b96b0 2023-07-12T02:02:54.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.803+0000 7fa34c700700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa344071ea0 con 0x7fa344071a30 2023-07-12T02:02:54.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.803+0000 7fa34c700700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3440b9b40 con 0x7fa344141780 2023-07-12T02:02:54.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.803+0000 7fa34a49c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa344141780 0x7fa3440ba010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:54.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.803+0000 7fa34a49c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa344141780 0x7fa3440ba010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58650/0 (socket says 172.21.15.60:58650) 2023-07-12T02:02:54.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.803+0000 7fa34ac9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa3440b96b0 0x7fa344151eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60600/0 (socket says 172.21.15.60:60600) 2023-07-12T02:02:54.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.803+0000 7fa34a49c700 1 -- 172.21.15.60:0/2887170697 learned_addr learned my addr 172.21.15.60:0/2887170697 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:54.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.804+0000 7fa34a49c700 1 -- 172.21.15.60:0/2887170697 >> v1:172.21.15.79:6789/0 conn(0x7fa344071a30 legacy=0x7fa34414ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:54.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.804+0000 7fa34a49c700 1 -- 172.21.15.60:0/2887170697 >> v1:172.21.15.60:6789/0 conn(0x7fa3440b96b0 legacy=0x7fa344151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:54.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.804+0000 7fa34a49c700 1 -- 172.21.15.60:0/2887170697 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa344070670 con 0x7fa344141780 2023-07-12T02:02:54.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.804+0000 7fa34949a700 1 -- 172.21.15.60:0/2887170697 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3105107775 0 0) 0x7fa344070e70 con 0x7fa3440b96b0 2023-07-12T02:02:54.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.804+0000 7fa34a49c700 1 --2- 172.21.15.60:0/2887170697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa344141780 0x7fa3440ba010 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa3400098f0 tx=0x7fa340009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1e674d3ba68b2e5 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:54.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.804+0000 7fa34949a700 1 -- 172.21.15.60:0/2887170697 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa340004230 con 0x7fa344141780 2023-07-12T02:02:54.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.804+0000 7fa34949a700 1 -- 172.21.15.60:0/2887170697 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa340004390 con 0x7fa344141780 2023-07-12T02:02:54.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.804+0000 7fa34949a700 1 -- 172.21.15.60:0/2887170697 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3400036a0 con 0x7fa344141780 2023-07-12T02:02:54.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.805+0000 7fa34c700700 1 -- 172.21.15.60:0/2887170697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa344141780 msgr2=0x7fa3440ba010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:54.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.805+0000 7fa34c700700 1 --2- 172.21.15.60:0/2887170697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa344141780 0x7fa3440ba010 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa3400098f0 tx=0x7fa340009c00 comp rx=0 tx=0).stop 2023-07-12T02:02:54.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.805+0000 7fa34c700700 1 -- 172.21.15.60:0/2887170697 shutdown_connections 2023-07-12T02:02:54.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.805+0000 7fa34c700700 1 --2- 172.21.15.60:0/2887170697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa344141780 0x7fa3440ba010 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:54.813 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.805+0000 7fa34c700700 1 -- 172.21.15.60:0/2887170697 >> 172.21.15.60:0/2887170697 conn(0x7fa34406d0e0 msgr2=0x7fa34406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:54.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.805+0000 7fa34c700700 1 -- 172.21.15.60:0/2887170697 shutdown_connections 2023-07-12T02:02:54.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.805+0000 7fa34c700700 1 -- 172.21.15.60:0/2887170697 wait complete. 2023-07-12T02:02:54.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.806+0000 7fa34c700700 1 Processor -- start 2023-07-12T02:02:54.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.806+0000 7fa34c700700 1 -- start start 2023-07-12T02:02:54.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.806+0000 7fa34c700700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa344071a30 0x7fa344144570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:54.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.806+0000 7fa34c700700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3440b96b0 0x7fa3441de080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:54.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.806+0000 7fa34c700700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa344141780 0x7fa3440b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:54.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.806+0000 7fa34c700700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa344144ab0 con 0x7fa344071a30 2023-07-12T02:02:54.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.806+0000 7fa34c700700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa344141e20 con 0x7fa344141780 2023-07-12T02:02:54.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.806+0000 7fa34c700700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3441e1580 con 0x7fa3440b96b0 2023-07-12T02:02:54.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.806+0000 7fa34a49c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa344071a30 0x7fa344144570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:54.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.806+0000 7fa34a49c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa344071a30 0x7fa344144570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58652/0 (socket says 172.21.15.60:58652) 2023-07-12T02:02:54.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.807+0000 7fa34a49c700 1 -- 172.21.15.60:0/3112791298 learned_addr learned my addr 172.21.15.60:0/3112791298 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:54.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.807+0000 7fa34ac9d700 1 --2- 172.21.15.60:0/3112791298 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa344141780 0x7fa3440b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:54.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.807+0000 7fa34a49c700 1 -- 172.21.15.60:0/3112791298 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3440b96b0 msgr2=0x7fa3441de080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:54.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.807+0000 7fa349c9b700 1 --2- 172.21.15.60:0/3112791298 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3440b96b0 0x7fa3441de080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:54.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.807+0000 7fa34a49c700 1 --2- 172.21.15.60:0/3112791298 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3440b96b0 0x7fa3441de080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:54.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.807+0000 7fa34a49c700 1 -- 172.21.15.60:0/3112791298 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa344141780 msgr2=0x7fa3440b4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:54.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.807+0000 7fa34a49c700 1 --2- 172.21.15.60:0/3112791298 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa344141780 0x7fa3440b4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:54.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.807+0000 7fa34a49c700 1 -- 172.21.15.60:0/3112791298 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa340009550 con 0x7fa344071a30 2023-07-12T02:02:54.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.807+0000 7fa34ac9d700 1 --2- 172.21.15.60:0/3112791298 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa344141780 0x7fa3440b4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:02:54.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.807+0000 7fa34a49c700 1 --2- 172.21.15.60:0/3112791298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa344071a30 0x7fa344144570 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa340009130 tx=0x7fa340004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:54.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.807+0000 7fa336ffd700 1 -- 172.21.15.60:0/3112791298 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34000b660 con 0x7fa344071a30 2023-07-12T02:02:54.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.807+0000 7fa336ffd700 1 -- 172.21.15.60:0/3112791298 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa34000b7e0 con 0x7fa344071a30 2023-07-12T02:02:54.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.807+0000 7fa336ffd700 1 -- 172.21.15.60:0/3112791298 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34000bb90 con 0x7fa344071a30 2023-07-12T02:02:54.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.807+0000 7fa34c700700 1 -- 172.21.15.60:0/3112791298 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3441e1e20 con 0x7fa344071a30 2023-07-12T02:02:54.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.807+0000 7fa34c700700 1 -- 172.21.15.60:0/3112791298 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3441e1ab0 con 0x7fa344071a30 2023-07-12T02:02:54.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.808+0000 7fa34c700700 1 -- 172.21.15.60:0/3112791298 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3441e1c70 con 0x7fa344071a30 2023-07-12T02:02:54.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.808+0000 7fa336ffd700 1 -- 172.21.15.60:0/3112791298 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa34000bcf0 con 0x7fa344071a30 2023-07-12T02:02:54.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.809+0000 7fa336ffd700 1 --2- 172.21.15.60:0/3112791298 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fa32806ace0 0x7fa32806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:54.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.809+0000 7fa336ffd700 1 -- 172.21.15.60:0/3112791298 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa34008aaf0 con 0x7fa344071a30 2023-07-12T02:02:54.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.809+0000 7fa349c9b700 1 --2- 172.21.15.60:0/3112791298 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fa32806ace0 0x7fa32806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:54.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.810+0000 7fa349c9b700 1 --2- 172.21.15.60:0/3112791298 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fa32806ace0 0x7fa32806d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa34413b780 tx=0x7fa338009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:54.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:54.813+0000 7fa336ffd700 1 -- 172.21.15.60:0/3112791298 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fa340055f80 con 0x7fa344071a30 2023-07-12T02:02:55.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.094+0000 7fa34c700700 1 -- 172.21.15.60:0/3112791298 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fa344074360 con 0x7fa344071a30 2023-07-12T02:02:55.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.098+0000 7fa336ffd700 1 -- 172.21.15.60:0/3112791298 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa34005de60 con 0x7fa344071a30 2023-07-12T02:02:55.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.100+0000 7fa34c700700 1 -- 172.21.15.60:0/3112791298 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fa32806ace0 msgr2=0x7fa32806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:55.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.100+0000 7fa34c700700 1 --2- 172.21.15.60:0/3112791298 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fa32806ace0 0x7fa32806d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa34413b780 tx=0x7fa338009040 comp rx=0 tx=0).stop 2023-07-12T02:02:55.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.100+0000 7fa34c700700 1 -- 172.21.15.60:0/3112791298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa344071a30 msgr2=0x7fa344144570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:55.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.100+0000 7fa34c700700 1 --2- 172.21.15.60:0/3112791298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa344071a30 0x7fa344144570 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa340009130 tx=0x7fa340004750 comp rx=0 tx=0).stop 2023-07-12T02:02:55.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.100+0000 7fa34c700700 1 -- 172.21.15.60:0/3112791298 shutdown_connections 2023-07-12T02:02:55.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.100+0000 7fa34c700700 1 --2- 172.21.15.60:0/3112791298 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fa32806ace0 0x7fa32806d190 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:55.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.100+0000 7fa34c700700 1 --2- 172.21.15.60:0/3112791298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa344071a30 0x7fa344144570 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:55.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.100+0000 7fa34c700700 1 --2- 172.21.15.60:0/3112791298 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa344141780 0x7fa3440b4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:55.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.100+0000 7fa34c700700 1 --2- 172.21.15.60:0/3112791298 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa3440b96b0 0x7fa3441de080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:55.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.100+0000 7fa34c700700 1 -- 172.21.15.60:0/3112791298 >> 172.21.15.60:0/3112791298 conn(0x7fa34406d0e0 msgr2=0x7fa3440ba010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:55.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.100+0000 7fa34c700700 1 -- 172.21.15.60:0/3112791298 shutdown_connections 2023-07-12T02:02:55.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.100+0000 7fa34c700700 1 -- 172.21.15.60:0/3112791298 wait complete. 2023-07-12T02:02:55.116 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-07-12T02:02:55.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.238+0000 7fd862db3700 1 Processor -- start 2023-07-12T02:02:55.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.238+0000 7fd862db3700 1 -- start start 2023-07-12T02:02:55.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.239+0000 7fd862db3700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd85c147dc0 0x7fd85c0721e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:55.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.239+0000 7fd862db3700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd85c069f30 0x7fd85c071130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:55.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.239+0000 7fd862db3700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd85c06f680 con 0x7fd85c06a380 2023-07-12T02:02:55.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.239+0000 7fd862db3700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd85c070950 con 0x7fd85c147dc0 2023-07-12T02:02:55.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.239+0000 7fd862db3700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c06f920 con 0x7fd85c069f30 2023-07-12T02:02:55.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.239+0000 7fd860b4f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd85c147dc0 0x7fd85c0721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:55.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.239+0000 7fd860b4f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd85c147dc0 0x7fd85c0721e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58666/0 (socket says 172.21.15.60:58666) 2023-07-12T02:02:55.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.239+0000 7fd860b4f700 1 -- 172.21.15.60:0/2473464337 learned_addr learned my addr 172.21.15.60:0/2473464337 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:55.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.239+0000 7fd85bfff700 1 --2- 172.21.15.60:0/2473464337 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd85c069f30 0x7fd85c071130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:55.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.239+0000 7fd860b4f700 1 -- 172.21.15.60:0/2473464337 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd85c069f30 msgr2=0x7fd85c071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:55.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.239+0000 7fd860b4f700 1 --2- 172.21.15.60:0/2473464337 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd85c069f30 0x7fd85c071130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:55.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.239+0000 7fd860b4f700 1 -- 172.21.15.60:0/2473464337 >> v1:172.21.15.79:6789/0 conn(0x7fd85c06a380 legacy=0x7fd85c14dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:55.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.239+0000 7fd860b4f700 1 -- 172.21.15.60:0/2473464337 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd85c0b9660 con 0x7fd85c147dc0 2023-07-12T02:02:55.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.239+0000 7fd860b4f700 1 --2- 172.21.15.60:0/2473464337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd85c147dc0 0x7fd85c0721e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd8500098f0 tx=0x7fd850009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c82200ad40449ab server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:55.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.239+0000 7fd85b7fe700 1 -- 172.21.15.60:0/2473464337 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85000b8a0 con 0x7fd85c147dc0 2023-07-12T02:02:55.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.239+0000 7fd85b7fe700 1 -- 172.21.15.60:0/2473464337 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85000ba00 con 0x7fd85c147dc0 2023-07-12T02:02:55.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.239+0000 7fd85b7fe700 1 -- 172.21.15.60:0/2473464337 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85000bd90 con 0x7fd85c147dc0 2023-07-12T02:02:55.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.240+0000 7fd862db3700 1 -- 172.21.15.60:0/2473464337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd85c147dc0 msgr2=0x7fd85c0721e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:55.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.240+0000 7fd862db3700 1 --2- 172.21.15.60:0/2473464337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd85c147dc0 0x7fd85c0721e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd8500098f0 tx=0x7fd850009c00 comp rx=0 tx=0).stop 2023-07-12T02:02:55.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.240+0000 7fd862db3700 1 -- 172.21.15.60:0/2473464337 shutdown_connections 2023-07-12T02:02:55.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.240+0000 7fd862db3700 1 --2- 172.21.15.60:0/2473464337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd85c147dc0 0x7fd85c0721e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:55.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.240+0000 7fd862db3700 1 --2- 172.21.15.60:0/2473464337 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd85c069f30 0x7fd85c071130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:55.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.240+0000 7fd862db3700 1 -- 172.21.15.60:0/2473464337 >> 172.21.15.60:0/2473464337 conn(0x7fd85c06d0e0 msgr2=0x7fd85c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:55.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.240+0000 7fd862db3700 1 -- 172.21.15.60:0/2473464337 shutdown_connections 2023-07-12T02:02:55.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.240+0000 7fd862db3700 1 -- 172.21.15.60:0/2473464337 wait complete. 2023-07-12T02:02:55.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.241+0000 7fd862db3700 1 Processor -- start 2023-07-12T02:02:55.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.241+0000 7fd862db3700 1 -- start start 2023-07-12T02:02:55.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.242+0000 7fd862db3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd85c069f30 0x7fd85c0bbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:55.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.242+0000 7fd862db3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd85c06a380 0x7fd85c1dfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:55.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.242+0000 7fd862db3700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd85c147dc0 0x7fd85c1e0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:55.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.242+0000 7fd862db3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c0bc1c0 con 0x7fd85c069f30 2023-07-12T02:02:55.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.242+0000 7fd862db3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c1e34e0 con 0x7fd85c06a380 2023-07-12T02:02:55.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.242+0000 7fd862db3700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c1e37c0 con 0x7fd85c147dc0 2023-07-12T02:02:55.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.242+0000 7fd860b4f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd85c069f30 0x7fd85c0bbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:55.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.242+0000 7fd860b4f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd85c069f30 0x7fd85c0bbc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58672/0 (socket says 172.21.15.60:58672) 2023-07-12T02:02:55.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.242+0000 7fd860b4f700 1 -- 172.21.15.60:0/2211893734 learned_addr learned my addr 172.21.15.60:0/2211893734 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:55.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.242+0000 7fd85bfff700 1 --2- 172.21.15.60:0/2211893734 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd85c06a380 0x7fd85c1dfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:55.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.242+0000 7fd861350700 1 --2- 172.21.15.60:0/2211893734 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd85c147dc0 0x7fd85c1e0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:55.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.242+0000 7fd860b4f700 1 -- 172.21.15.60:0/2211893734 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd85c147dc0 msgr2=0x7fd85c1e0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:55.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.242+0000 7fd860b4f700 1 --2- 172.21.15.60:0/2211893734 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd85c147dc0 0x7fd85c1e0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:55.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.242+0000 7fd860b4f700 1 -- 172.21.15.60:0/2211893734 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd85c06a380 msgr2=0x7fd85c1dfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:55.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.242+0000 7fd860b4f700 1 --2- 172.21.15.60:0/2211893734 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd85c06a380 0x7fd85c1dfcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:55.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.242+0000 7fd860b4f700 1 -- 172.21.15.60:0/2211893734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd850009550 con 0x7fd85c069f30 2023-07-12T02:02:55.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.242+0000 7fd861350700 1 --2- 172.21.15.60:0/2211893734 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd85c147dc0 0x7fd85c1e0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:55.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.242+0000 7fd85bfff700 1 --2- 172.21.15.60:0/2211893734 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd85c06a380 0x7fd85c1dfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:55.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.242+0000 7fd860b4f700 1 --2- 172.21.15.60:0/2211893734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd85c069f30 0x7fd85c0bbc80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd850009c40 tx=0x7fd850004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:55.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.243+0000 7fd8597fa700 1 -- 172.21.15.60:0/2211893734 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8500036a0 con 0x7fd85c069f30 2023-07-12T02:02:55.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.243+0000 7fd8597fa700 1 -- 172.21.15.60:0/2211893734 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85001e070 con 0x7fd85c069f30 2023-07-12T02:02:55.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.243+0000 7fd8597fa700 1 -- 172.21.15.60:0/2211893734 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd850003a60 con 0x7fd85c069f30 2023-07-12T02:02:55.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.243+0000 7fd862db3700 1 -- 172.21.15.60:0/2211893734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd85c1e3aa0 con 0x7fd85c069f30 2023-07-12T02:02:55.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.243+0000 7fd862db3700 1 -- 172.21.15.60:0/2211893734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd85c1e3d80 con 0x7fd85c069f30 2023-07-12T02:02:55.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.244+0000 7fd862db3700 1 -- 172.21.15.60:0/2211893734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd85c1e3620 con 0x7fd85c069f30 2023-07-12T02:02:55.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.244+0000 7fd8597fa700 1 -- 172.21.15.60:0/2211893734 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd850003bc0 con 0x7fd85c069f30 2023-07-12T02:02:55.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.245+0000 7fd8597fa700 1 --2- 172.21.15.60:0/2211893734 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fd84006ace0 0x7fd84006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:55.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.245+0000 7fd8597fa700 1 -- 172.21.15.60:0/2211893734 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd850020070 con 0x7fd85c069f30 2023-07-12T02:02:55.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.245+0000 7fd85bfff700 1 --2- 172.21.15.60:0/2211893734 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fd84006ace0 0x7fd84006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:55.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.246+0000 7fd85bfff700 1 --2- 172.21.15.60:0/2211893734 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fd84006ace0 0x7fd84006d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd85c144eb0 tx=0x7fd848008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:55.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.249+0000 7fd8597fa700 1 -- 172.21.15.60:0/2211893734 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fd85c1e3620 con 0x7fd85c069f30 2023-07-12T02:02:55.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.528+0000 7fd862db3700 1 -- 172.21.15.60:0/2211893734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fd85c1e3620 con 0x7fd85c069f30 2023-07-12T02:02:55.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.531+0000 7fd8597fa700 1 -- 172.21.15.60:0/2211893734 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd85c1e3620 con 0x7fd85c069f30 2023-07-12T02:02:55.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.533+0000 7fd862db3700 1 -- 172.21.15.60:0/2211893734 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fd84006ace0 msgr2=0x7fd84006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:55.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.533+0000 7fd862db3700 1 --2- 172.21.15.60:0/2211893734 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fd84006ace0 0x7fd84006d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd85c144eb0 tx=0x7fd848008040 comp rx=0 tx=0).stop 2023-07-12T02:02:55.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.533+0000 7fd862db3700 1 -- 172.21.15.60:0/2211893734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd85c069f30 msgr2=0x7fd85c0bbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:55.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.533+0000 7fd862db3700 1 --2- 172.21.15.60:0/2211893734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd85c069f30 0x7fd85c0bbc80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd850009c40 tx=0x7fd850004750 comp rx=0 tx=0).stop 2023-07-12T02:02:55.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.533+0000 7fd862db3700 1 -- 172.21.15.60:0/2211893734 shutdown_connections 2023-07-12T02:02:55.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.533+0000 7fd862db3700 1 --2- 172.21.15.60:0/2211893734 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fd84006ace0 0x7fd84006d190 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:55.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.533+0000 7fd862db3700 1 --2- 172.21.15.60:0/2211893734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd85c069f30 0x7fd85c0bbc80 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:55.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.533+0000 7fd862db3700 1 --2- 172.21.15.60:0/2211893734 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd85c147dc0 0x7fd85c1e0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:55.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.533+0000 7fd862db3700 1 --2- 172.21.15.60:0/2211893734 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd85c06a380 0x7fd85c1dfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:55.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.533+0000 7fd862db3700 1 -- 172.21.15.60:0/2211893734 >> 172.21.15.60:0/2211893734 conn(0x7fd85c06d0e0 msgr2=0x7fd85c0b9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:55.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.533+0000 7fd862db3700 1 -- 172.21.15.60:0/2211893734 shutdown_connections 2023-07-12T02:02:55.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.533+0000 7fd862db3700 1 -- 172.21.15.60:0/2211893734 wait complete. 2023-07-12T02:02:55.549 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:02:55.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.671+0000 7fc1c6bdc700 1 Processor -- start 2023-07-12T02:02:55.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.671+0000 7fc1c6bdc700 1 -- start start 2023-07-12T02:02:55.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.672+0000 7fc1c6bdc700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc1c014aa40 0x7fc1c014ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:55.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.672+0000 7fc1c6bdc700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1c0070410 con 0x7fc1c01444c0 2023-07-12T02:02:55.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.672+0000 7fc1c6bdc700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1c014b3d0 con 0x7fc1c006b120 2023-07-12T02:02:55.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.672+0000 7fc1c6bdc700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c00b9590 con 0x7fc1c014aa40 2023-07-12T02:02:55.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.672+0000 7fc1c5179700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc1c01444c0 0x7fc1c0144920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60604/0 (socket says 172.21.15.60:60604) 2023-07-12T02:02:55.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.672+0000 7fc1c5179700 1 -- 172.21.15.60:0/2221488228 learned_addr learned my addr 172.21.15.60:0/2221488228 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:55.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.673+0000 7fc1bffff700 1 --2- 172.21.15.60:0/2221488228 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc1c014aa40 0x7fc1c014ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:55.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.673+0000 7fc1bf7fe700 1 -- 172.21.15.60:0/2221488228 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2627707101 0 0) 0x7fc1c0070410 con 0x7fc1c01444c0 2023-07-12T02:02:55.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.673+0000 7fc1bf7fe700 1 -- 172.21.15.60:0/2221488228 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1b00035b0 con 0x7fc1c01444c0 2023-07-12T02:02:55.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.673+0000 7fc1bf7fe700 1 -- 172.21.15.60:0/2221488228 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3972643689 0 0) 0x7fc1c014b3d0 con 0x7fc1c006b120 2023-07-12T02:02:55.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.673+0000 7fc1bf7fe700 1 -- 172.21.15.60:0/2221488228 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1c0070410 con 0x7fc1c006b120 2023-07-12T02:02:55.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.673+0000 7fc1bf7fe700 1 -- 172.21.15.60:0/2221488228 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2819654849 0 0) 0x7fc1b00035b0 con 0x7fc1c01444c0 2023-07-12T02:02:55.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.673+0000 7fc1bf7fe700 1 -- 172.21.15.60:0/2221488228 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc1c014aa40 msgr2=0x7fc1c014ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:55.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.673+0000 7fc1bf7fe700 1 --2- 172.21.15.60:0/2221488228 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc1c014aa40 0x7fc1c014ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:55.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.673+0000 7fc1bf7fe700 1 -- 172.21.15.60:0/2221488228 >> v1:172.21.15.79:6789/0 conn(0x7fc1c006b120 legacy=0x7fc1c00b8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:55.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.673+0000 7fc1bf7fe700 1 -- 172.21.15.60:0/2221488228 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c006ef60 con 0x7fc1c01444c0 2023-07-12T02:02:55.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.673+0000 7fc1bf7fe700 1 -- 172.21.15.60:0/2221488228 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1141905739 0 0) 0x7fc1b80019f0 con 0x7fc1c01444c0 2023-07-12T02:02:55.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.673+0000 7fc1bf7fe700 1 -- 172.21.15.60:0/2221488228 >> v1:172.21.15.60:6789/0 conn(0x7fc1c01444c0 legacy=0x7fc1c0144920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:55.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.673+0000 7fc1bf7fe700 1 --2- 172.21.15.60:0/2221488228 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1b0003bc0 0x7fc1b0003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:55.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.673+0000 7fc1bf7fe700 1 --2- 172.21.15.60:0/2221488228 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc1c014aa40 0x7fc1b0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:55.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.673+0000 7fc1bf7fe700 1 --2- 172.21.15.60:0/2221488228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1b0004d90 0x7fc1b0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:55.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.673+0000 7fc1bf7fe700 1 -- 172.21.15.60:0/2221488228 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c00b9590 con 0x7fc1b0004d90 2023-07-12T02:02:55.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.673+0000 7fc1bf7fe700 1 -- 172.21.15.60:0/2221488228 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b000bba0 con 0x7fc1b0003bc0 2023-07-12T02:02:55.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.673+0000 7fc1bf7fe700 1 -- 172.21.15.60:0/2221488228 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b000bd30 con 0x7fc1c014aa40 2023-07-12T02:02:55.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.673+0000 7fc1c5179700 1 --2- 172.21.15.60:0/2221488228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1b0004d90 0x7fc1b0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:55.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.673+0000 7fc1c4978700 1 --2- 172.21.15.60:0/2221488228 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1b0003bc0 0x7fc1b0003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:55.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.673+0000 7fc1bffff700 1 --2- 172.21.15.60:0/2221488228 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc1c014aa40 0x7fc1b0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:55.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.673+0000 7fc1c5179700 1 -- 172.21.15.60:0/2221488228 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc1c014aa40 msgr2=0x7fc1b0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:55.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.673+0000 7fc1c5179700 1 --2- 172.21.15.60:0/2221488228 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc1c014aa40 0x7fc1b0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:55.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.673+0000 7fc1c5179700 1 -- 172.21.15.60:0/2221488228 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1b0003bc0 msgr2=0x7fc1b0003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:55.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.673+0000 7fc1c5179700 1 --2- 172.21.15.60:0/2221488228 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1b0003bc0 0x7fc1b0003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:55.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.673+0000 7fc1c5179700 1 -- 172.21.15.60:0/2221488228 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b00035b0 con 0x7fc1b0004d90 2023-07-12T02:02:55.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.674+0000 7fc1c5179700 1 --2- 172.21.15.60:0/2221488228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1b0004d90 0x7fc1b0005200 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc1b800a6f0 tx=0x7fc1b0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19c29466842fb534 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:55.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.674+0000 7fc1bf7fe700 1 -- 172.21.15.60:0/2221488228 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b80072d0 con 0x7fc1b0004d90 2023-07-12T02:02:55.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.674+0000 7fc1bf7fe700 1 -- 172.21.15.60:0/2221488228 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b8007430 con 0x7fc1b0004d90 2023-07-12T02:02:55.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.674+0000 7fc1bf7fe700 1 -- 172.21.15.60:0/2221488228 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b80077a0 con 0x7fc1b0004d90 2023-07-12T02:02:55.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.674+0000 7fc1c6bdc700 1 -- 172.21.15.60:0/2221488228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1b0004d90 msgr2=0x7fc1b0005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:55.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.674+0000 7fc1c6bdc700 1 --2- 172.21.15.60:0/2221488228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1b0004d90 0x7fc1b0005200 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc1b800a6f0 tx=0x7fc1b0005880 comp rx=0 tx=0).stop 2023-07-12T02:02:55.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.674+0000 7fc1c5179700 1 -- 172.21.15.60:0/2221488228 reap_dead start 2023-07-12T02:02:55.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.674+0000 7fc1c6bdc700 1 -- 172.21.15.60:0/2221488228 shutdown_connections 2023-07-12T02:02:55.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.674+0000 7fc1c6bdc700 1 -- 172.21.15.60:0/2221488228 >> 172.21.15.60:0/2221488228 conn(0x7fc1c00bd980 msgr2=0x7fc1c00b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:55.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.674+0000 7fc1c6bdc700 1 -- 172.21.15.60:0/2221488228 shutdown_connections 2023-07-12T02:02:55.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.674+0000 7fc1c6bdc700 1 -- 172.21.15.60:0/2221488228 wait complete. 2023-07-12T02:02:55.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.676+0000 7fc1c6bdc700 1 Processor -- start 2023-07-12T02:02:55.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.676+0000 7fc1c6bdc700 1 -- start start 2023-07-12T02:02:55.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.677+0000 7fc1c6bdc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1b0004d90 0x7fc1c014e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:55.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.677+0000 7fc1c6bdc700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc1c014d8e0 0x7fc1c01df6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:55.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.677+0000 7fc1c6bdc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1c01dfbf0 0x7fc1c01470c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:55.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.677+0000 7fc1c6bdc700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c014ccc0 con 0x7fc1c01dfbf0 2023-07-12T02:02:55.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.677+0000 7fc1c6bdc700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c014e620 con 0x7fc1b0004d90 2023-07-12T02:02:55.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.677+0000 7fc1c6bdc700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c014c3b0 con 0x7fc1c014d8e0 2023-07-12T02:02:55.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.677+0000 7fc1c5179700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1c01dfbf0 0x7fc1c01470c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:55.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.677+0000 7fc1c5179700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1c01dfbf0 0x7fc1c01470c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58702/0 (socket says 172.21.15.60:58702) 2023-07-12T02:02:55.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.677+0000 7fc1c5179700 1 -- 172.21.15.60:0/1534076885 learned_addr learned my addr 172.21.15.60:0/1534076885 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:55.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.677+0000 7fc1c4978700 1 --2- 172.21.15.60:0/1534076885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1b0004d90 0x7fc1c014e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:55.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.677+0000 7fc1bffff700 1 --2- 172.21.15.60:0/1534076885 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc1c014d8e0 0x7fc1c01df6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:55.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.677+0000 7fc1c5179700 1 -- 172.21.15.60:0/1534076885 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc1c014d8e0 msgr2=0x7fc1c01df6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:55.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.677+0000 7fc1c5179700 1 --2- 172.21.15.60:0/1534076885 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc1c014d8e0 0x7fc1c01df6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:55.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.677+0000 7fc1c5179700 1 -- 172.21.15.60:0/1534076885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1b0004d90 msgr2=0x7fc1c014e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:55.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.677+0000 7fc1c5179700 1 --2- 172.21.15.60:0/1534076885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1b0004d90 0x7fc1c014e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:55.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.677+0000 7fc1c5179700 1 -- 172.21.15.60:0/1534076885 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c0142fa0 con 0x7fc1c01dfbf0 2023-07-12T02:02:55.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.677+0000 7fc1c4978700 1 --2- 172.21.15.60:0/1534076885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1b0004d90 0x7fc1c014e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:55.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.677+0000 7fc1c5179700 1 --2- 172.21.15.60:0/1534076885 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1c01dfbf0 0x7fc1c01470c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc1b8011000 tx=0x7fc1c0145030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:55.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.677+0000 7fc1bd7fa700 1 -- 172.21.15.60:0/1534076885 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b8025070 con 0x7fc1c01dfbf0 2023-07-12T02:02:55.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.677+0000 7fc1bd7fa700 1 -- 172.21.15.60:0/1534076885 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b80011c0 con 0x7fc1c01dfbf0 2023-07-12T02:02:55.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.678+0000 7fc1c6bdc700 1 -- 172.21.15.60:0/1534076885 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1c014c600 con 0x7fc1c01dfbf0 2023-07-12T02:02:55.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.678+0000 7fc1bd7fa700 1 -- 172.21.15.60:0/1534076885 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b80079d0 con 0x7fc1c01dfbf0 2023-07-12T02:02:55.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.678+0000 7fc1c6bdc700 1 -- 172.21.15.60:0/1534076885 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1c014d0e0 con 0x7fc1c01dfbf0 2023-07-12T02:02:55.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.678+0000 7fc1c6bdc700 1 -- 172.21.15.60:0/1534076885 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1c014ce00 con 0x7fc1c01dfbf0 2023-07-12T02:02:55.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.679+0000 7fc1bd7fa700 1 -- 172.21.15.60:0/1534076885 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc1b801a070 con 0x7fc1c01dfbf0 2023-07-12T02:02:55.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.679+0000 7fc1bd7fa700 1 --2- 172.21.15.60:0/1534076885 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc1a406ace0 0x7fc1a406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:55.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.679+0000 7fc1bd7fa700 1 -- 172.21.15.60:0/1534076885 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc1b808a610 con 0x7fc1c01dfbf0 2023-07-12T02:02:55.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.679+0000 7fc1c4978700 1 --2- 172.21.15.60:0/1534076885 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc1a406ace0 0x7fc1a406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:55.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.680+0000 7fc1c4978700 1 --2- 172.21.15.60:0/1534076885 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc1a406ace0 0x7fc1a406d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4007fd0 tx=0x7fc1b4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:55.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.684+0000 7fc1bd7fa700 1 -- 172.21.15.60:0/1534076885 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fc1c014ce00 con 0x7fc1c01dfbf0 2023-07-12T02:02:55.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.883+0000 7fc1c6bdc700 1 -- 172.21.15.60:0/1534076885 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1c014ce00 con 0x7fc1c01dfbf0 2023-07-12T02:02:55.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.884+0000 7fc1bd7fa700 1 -- 172.21.15.60:0/1534076885 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+14533 (secure 0 0 0) 0x7fc1c014ce00 con 0x7fc1c01dfbf0 2023-07-12T02:02:55.888 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:02:55.888 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":27,"fsid":"97e7c909-e567-472e-a5aa-72fde15171f2","created":"2023-07-12T02:01:53.987086+0000","modified":"2023-07-12T02:02:52.461952+0000","last_up_change":"2023-07-12T02:02:04.031780+0000","last_in_change":"2023-07-12T02:01:56.538621+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-12T02:02:05.375042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-12T02:02:05.857441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ed8b71c2-3895-4952-a118-16ede0b4a98c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6801","nonce":2818935979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6803","nonce":2818935979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6807","nonce":2818935979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6805","nonce":2818935979}]},"public_addr":"172.21.15.60:6801/2818935979","cluster_addr":"172.21.15.60:6803/2818935979","heartbeat_back_addr":"172.21.15.60:6807/2818935979","heartbeat_front_addr":"172.21.15.60:6805/2818935979","state":["exists","up"]},{"osd":1,"uuid":"7cf4d354-78e0-43ce-8c09-4a7d2a0b57a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6817","nonce":1678864191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6819","nonce":1678864191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6823","nonce":1678864191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6821","nonce":1678864191}]},"public_addr":"172.21.15.60:6817/1678864191","cluster_addr":"172.21.15.60:6819/1678864191","heartbeat_back_addr":"172.21.15.60:6823/1678864191","heartbeat_front_addr":"172.21.15.60:6821/1678864191","state":["exists","up"]},{"osd":2,"uuid":"02c958b8-9599-4470-92cb-8f7018ec0189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6809","nonce":1459480680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6811","nonce":1459480680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6815","nonce":1459480680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6813","nonce":1459480680}]},"public_addr":"172.21.15.60:6809/1459480680","cluster_addr":"172.21.15.60:6811/1459480680","heartbeat_back_addr":"172.21.15.60:6815/1459480680","heartbeat_front_addr":"172.21.15.60:6813/1459480680","state":["exists","up"]},{"osd":3,"uuid":"bc300432-a228-4257-be5c-e42dd5f2015f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6825","nonce":3295100060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6827","nonce":3295100060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6831","nonce":3295100060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6829","nonce":3295100060}]},"public_addr":"172.21.15.60:6825/3295100060","cluster_addr":"172.21.15.60:6827/3295100060","heartbeat_back_addr":"172.21.15.60:6831/3295100060","heartbeat_front_addr":"172.21.15.60:6829/3295100060","state":["exists","up"]},{"osd":4,"uuid":"ad9f7dc4-7126-466d-a656-2844880c6060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6809","nonce":4127109138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6811","nonce":4127109138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6815","nonce":4127109138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6813","nonce":4127109138}]},"public_addr":"172.21.15.79:6809/4127109138","cluster_addr":"172.21.15.79:6811/4127109138","heartbeat_back_addr":"172.21.15.79:6815/4127109138","heartbeat_front_addr":"172.21.15.79:6813/4127109138","state":["exists","up"]},{"osd":5,"uuid":"e88d16ca-0b01-4ab9-8aa8-c4aff7f210f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6801","nonce":421449406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6803","nonce":421449406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6807","nonce":421449406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6805","nonce":421449406}]},"public_addr":"172.21.15.79:6801/421449406","cluster_addr":"172.21.15.79:6803/421449406","heartbeat_back_addr":"172.21.15.79:6807/421449406","heartbeat_front_addr":"172.21.15.79:6805/421449406","state":["exists","up"]},{"osd":6,"uuid":"6898cb84-56d1-48a9-bd45-97e4668e2fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6825","nonce":4144355139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6827","nonce":4144355139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6831","nonce":4144355139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6829","nonce":4144355139}]},"public_addr":"172.21.15.79:6825/4144355139","cluster_addr":"172.21.15.79:6827/4144355139","heartbeat_back_addr":"172.21.15.79:6831/4144355139","heartbeat_front_addr":"172.21.15.79:6829/4144355139","state":["exists","up"]},{"osd":7,"uuid":"65c10882-371e-4762-b384-9c3a48f332ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6817","nonce":2845223299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6819","nonce":2845223299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6823","nonce":2845223299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6821","nonce":2845223299}]},"public_addr":"172.21.15.79:6817/2845223299","cluster_addr":"172.21.15.79:6819/2845223299","heartbeat_back_addr":"172.21.15.79:6823/2845223299","heartbeat_front_addr":"172.21.15.79:6821/2845223299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.634716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.758349+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.728366+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.777395+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707262+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.649705+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.693021+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:02:55.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.886+0000 7fc1c6bdc700 1 -- 172.21.15.60:0/1534076885 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc1a406ace0 msgr2=0x7fc1a406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:55.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.886+0000 7fc1c6bdc700 1 --2- 172.21.15.60:0/1534076885 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc1a406ace0 0x7fc1a406d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4007fd0 tx=0x7fc1b4009040 comp rx=0 tx=0).stop 2023-07-12T02:02:55.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.886+0000 7fc1c6bdc700 1 -- 172.21.15.60:0/1534076885 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1c01dfbf0 msgr2=0x7fc1c01470c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:55.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.886+0000 7fc1c6bdc700 1 --2- 172.21.15.60:0/1534076885 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1c01dfbf0 0x7fc1c01470c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc1b8011000 tx=0x7fc1c0145030 comp rx=0 tx=0).stop 2023-07-12T02:02:55.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.886+0000 7fc1c6bdc700 1 -- 172.21.15.60:0/1534076885 shutdown_connections 2023-07-12T02:02:55.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.886+0000 7fc1c6bdc700 1 --2- 172.21.15.60:0/1534076885 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fc1a406ace0 0x7fc1a406d190 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:55.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.886+0000 7fc1c6bdc700 1 --2- 172.21.15.60:0/1534076885 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1c01dfbf0 0x7fc1c01470c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:55.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.886+0000 7fc1c6bdc700 1 --2- 172.21.15.60:0/1534076885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1b0004d90 0x7fc1c014e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:55.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.886+0000 7fc1c6bdc700 1 --2- 172.21.15.60:0/1534076885 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc1c014d8e0 0x7fc1c01df6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:55.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.886+0000 7fc1c6bdc700 1 -- 172.21.15.60:0/1534076885 >> 172.21.15.60:0/1534076885 conn(0x7fc1c00bd980 msgr2=0x7fc1c00715d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:55.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.886+0000 7fc1c6bdc700 1 -- 172.21.15.60:0/1534076885 shutdown_connections 2023-07-12T02:02:55.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:55.886+0000 7fc1c6bdc700 1 -- 172.21.15.60:0/1534076885 wait complete. 2023-07-12T02:02:55.902 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-12T02:02:05.375042+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-12T02:02:05.857441+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-12T02:02:55.903 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-12T02:02:56.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.027+0000 7fc0086a8700 1 Processor -- start 2023-07-12T02:02:56.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.027+0000 7fc0086a8700 1 -- start start 2023-07-12T02:02:56.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.028+0000 7fc0086a8700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc0000bc810 0x7fc0000ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:56.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.028+0000 7fc0086a8700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc0000b8d90 0x7fc00006ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:56.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.028+0000 7fc0086a8700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0000b8620 con 0x7fc0001449d0 2023-07-12T02:02:56.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.028+0000 7fc0086a8700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0000b97a0 con 0x7fc0000bc810 2023-07-12T02:02:56.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.028+0000 7fc0086a8700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc000144da0 con 0x7fc0000b8d90 2023-07-12T02:02:56.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.028+0000 7fc005c43700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc0000bc810 0x7fc0000ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:56.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.028+0000 7fc006444700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc0001449d0 0x7fc00014db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60614/0 (socket says 172.21.15.60:60614) 2023-07-12T02:02:56.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.028+0000 7fc006444700 1 -- 172.21.15.60:0/1000658373 learned_addr learned my addr 172.21.15.60:0/1000658373 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:56.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.028+0000 7fc006c45700 1 --2- 172.21.15.60:0/1000658373 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc0000b8d90 0x7fc00006ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:56.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.028+0000 7fc005c43700 1 -- 172.21.15.60:0/1000658373 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc0000b8d90 msgr2=0x7fc00006ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:56.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.028+0000 7fc005c43700 1 --2- 172.21.15.60:0/1000658373 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc0000b8d90 0x7fc00006ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:56.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.028+0000 7fc005c43700 1 -- 172.21.15.60:0/1000658373 >> v1:172.21.15.60:6789/0 conn(0x7fc0001449d0 legacy=0x7fc00014db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:56.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.028+0000 7fc005c43700 1 -- 172.21.15.60:0/1000658373 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0000b8900 con 0x7fc0000bc810 2023-07-12T02:02:56.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.028+0000 7fc005442700 1 -- 172.21.15.60:0/1000658373 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3926791864 0 0) 0x7fc0000b8620 con 0x7fc0001449d0 2023-07-12T02:02:56.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.028+0000 7fc005c43700 1 --2- 172.21.15.60:0/1000658373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0000bc810 0x7fc0000ba530 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbffc009840 tx=0x7fbffc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fc70105450ce0cf server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:56.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.029+0000 7fc005442700 1 -- 172.21.15.60:0/1000658373 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc011830 con 0x7fc0000bc810 2023-07-12T02:02:56.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.029+0000 7fc005442700 1 -- 172.21.15.60:0/1000658373 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbffc011990 con 0x7fc0000bc810 2023-07-12T02:02:56.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.029+0000 7fc005442700 1 -- 172.21.15.60:0/1000658373 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc011d20 con 0x7fc0000bc810 2023-07-12T02:02:56.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.029+0000 7fc0086a8700 1 -- 172.21.15.60:0/1000658373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0000bc810 msgr2=0x7fc0000ba530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:56.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.029+0000 7fc0086a8700 1 --2- 172.21.15.60:0/1000658373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0000bc810 0x7fc0000ba530 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbffc009840 tx=0x7fbffc009b50 comp rx=0 tx=0).stop 2023-07-12T02:02:56.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.029+0000 7fc0086a8700 1 -- 172.21.15.60:0/1000658373 shutdown_connections 2023-07-12T02:02:56.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.029+0000 7fc0086a8700 1 --2- 172.21.15.60:0/1000658373 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc0000b8d90 0x7fc00006ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:56.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.029+0000 7fc0086a8700 1 --2- 172.21.15.60:0/1000658373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0000bc810 0x7fc0000ba530 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:56.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.029+0000 7fc0086a8700 1 -- 172.21.15.60:0/1000658373 >> 172.21.15.60:0/1000658373 conn(0x7fc0000c0860 msgr2=0x7fc0000c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:56.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.029+0000 7fc0086a8700 1 -- 172.21.15.60:0/1000658373 shutdown_connections 2023-07-12T02:02:56.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.029+0000 7fc0086a8700 1 -- 172.21.15.60:0/1000658373 wait complete. 2023-07-12T02:02:56.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.030+0000 7fc0086a8700 1 Processor -- start 2023-07-12T02:02:56.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.030+0000 7fc0086a8700 1 -- start start 2023-07-12T02:02:56.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.031+0000 7fc0086a8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0000b8d90 0x7fc0001d4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:56.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.031+0000 7fc0086a8700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc0000bc810 0x7fc0001dff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:56.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.031+0000 7fc0086a8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0001449d0 0x7fc0000b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:56.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.031+0000 7fc0086a8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0000b2530 con 0x7fc0001449d0 2023-07-12T02:02:56.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.031+0000 7fc0086a8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0000b3220 con 0x7fc0000b8d90 2023-07-12T02:02:56.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.031+0000 7fc0086a8700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0000b42a0 con 0x7fc0000bc810 2023-07-12T02:02:56.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.031+0000 7fc006c45700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0001449d0 0x7fc0000b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:56.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.031+0000 7fc006c45700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0001449d0 0x7fc0000b1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58724/0 (socket says 172.21.15.60:58724) 2023-07-12T02:02:56.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.031+0000 7fc006c45700 1 -- 172.21.15.60:0/3253337989 learned_addr learned my addr 172.21.15.60:0/3253337989 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:56.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.031+0000 7fc005c43700 1 --2- 172.21.15.60:0/3253337989 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc0000bc810 0x7fc0001dff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:56.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.031+0000 7fc006444700 1 --2- 172.21.15.60:0/3253337989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0000b8d90 0x7fc0001d4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:56.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.031+0000 7fc006c45700 1 -- 172.21.15.60:0/3253337989 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc0000bc810 msgr2=0x7fc0001dff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:56.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.031+0000 7fc006c45700 1 --2- 172.21.15.60:0/3253337989 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc0000bc810 0x7fc0001dff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:56.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.031+0000 7fc006c45700 1 -- 172.21.15.60:0/3253337989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0000b8d90 msgr2=0x7fc0001d4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:56.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.031+0000 7fc006c45700 1 --2- 172.21.15.60:0/3253337989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0000b8d90 0x7fc0001d4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:56.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.031+0000 7fc006c45700 1 -- 172.21.15.60:0/3253337989 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbffc0094a0 con 0x7fc0001449d0 2023-07-12T02:02:56.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.031+0000 7fc006444700 1 --2- 172.21.15.60:0/3253337989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0000b8d90 0x7fc0001d4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:02:56.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.032+0000 7fc006c45700 1 --2- 172.21.15.60:0/3253337989 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0001449d0 0x7fc0000b1b90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbff8007e40 tx=0x7fbff800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:56.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.032+0000 7fbff6ffd700 1 -- 172.21.15.60:0/3253337989 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff800eea0 con 0x7fc0001449d0 2023-07-12T02:02:56.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.032+0000 7fbff6ffd700 1 -- 172.21.15.60:0/3253337989 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff8014420 con 0x7fc0001449d0 2023-07-12T02:02:56.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.032+0000 7fc0086a8700 1 -- 172.21.15.60:0/3253337989 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0000b4580 con 0x7fc0001449d0 2023-07-12T02:02:56.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.032+0000 7fbff6ffd700 1 -- 172.21.15.60:0/3253337989 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff80147b0 con 0x7fc0001449d0 2023-07-12T02:02:56.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.032+0000 7fc0086a8700 1 -- 172.21.15.60:0/3253337989 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0001dfa70 con 0x7fc0001449d0 2023-07-12T02:02:56.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.033+0000 7fc0086a8700 1 -- 172.21.15.60:0/3253337989 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc000074360 con 0x7fc0001449d0 2023-07-12T02:02:56.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.033+0000 7fbff6ffd700 1 -- 172.21.15.60:0/3253337989 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbff8014910 con 0x7fc0001449d0 2023-07-12T02:02:56.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.033+0000 7fbff6ffd700 1 --2- 172.21.15.60:0/3253337989 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fbfe406ace0 0x7fbfe406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:56.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.034+0000 7fbff6ffd700 1 -- 172.21.15.60:0/3253337989 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fbff8089940 con 0x7fc0001449d0 2023-07-12T02:02:56.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.034+0000 7fc006444700 1 --2- 172.21.15.60:0/3253337989 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fbfe406ace0 0x7fbfe406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:56.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.034+0000 7fc006444700 1 --2- 172.21.15.60:0/3253337989 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fbfe406ace0 0x7fbfe406d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbff0007fd0 tx=0x7fbff0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:56.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.038+0000 7fbff6ffd700 1 -- 172.21.15.60:0/3253337989 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fbff8054d40 con 0x7fc0001449d0 2023-07-12T02:02:56.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.235+0000 7fc0086a8700 1 -- 172.21.15.60:0/3253337989 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc0000b1250 con 0x7fc0001449d0 2023-07-12T02:02:56.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.235+0000 7fbff6ffd700 1 -- 172.21.15.60:0/3253337989 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbff8058360 con 0x7fc0001449d0 2023-07-12T02:02:56.239 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2023-07-12T02:02:56.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.237+0000 7fc0086a8700 1 -- 172.21.15.60:0/3253337989 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fbfe406ace0 msgr2=0x7fbfe406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:56.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.237+0000 7fc0086a8700 1 --2- 172.21.15.60:0/3253337989 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fbfe406ace0 0x7fbfe406d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbff0007fd0 tx=0x7fbff0009040 comp rx=0 tx=0).stop 2023-07-12T02:02:56.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.237+0000 7fc0086a8700 1 -- 172.21.15.60:0/3253337989 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0001449d0 msgr2=0x7fc0000b1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:56.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.237+0000 7fc0086a8700 1 --2- 172.21.15.60:0/3253337989 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0001449d0 0x7fc0000b1b90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbff8007e40 tx=0x7fbff800e3c0 comp rx=0 tx=0).stop 2023-07-12T02:02:56.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.237+0000 7fc0086a8700 1 -- 172.21.15.60:0/3253337989 shutdown_connections 2023-07-12T02:02:56.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.237+0000 7fc0086a8700 1 --2- 172.21.15.60:0/3253337989 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fbfe406ace0 0x7fbfe406d190 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:56.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.237+0000 7fc0086a8700 1 --2- 172.21.15.60:0/3253337989 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0001449d0 0x7fc0000b1b90 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:56.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.237+0000 7fc0086a8700 1 --2- 172.21.15.60:0/3253337989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0000b8d90 0x7fc0001d4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:56.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.237+0000 7fc0086a8700 1 --2- 172.21.15.60:0/3253337989 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc0000bc810 0x7fc0001dff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:56.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.237+0000 7fc0086a8700 1 -- 172.21.15.60:0/3253337989 >> 172.21.15.60:0/3253337989 conn(0x7fc0000c0860 msgr2=0x7fc000143900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:56.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.237+0000 7fc0086a8700 1 -- 172.21.15.60:0/3253337989 shutdown_connections 2023-07-12T02:02:56.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.237+0000 7fc0086a8700 1 -- 172.21.15.60:0/3253337989 wait complete. 2023-07-12T02:02:56.253 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-12T02:02:56.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.378+0000 7f0f22014700 1 Processor -- start 2023-07-12T02:02:56.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.378+0000 7f0f22014700 1 -- start start 2023-07-12T02:02:56.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.378+0000 7f0f22014700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0f1c0bc810 0x7f0f1c0ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:56.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.378+0000 7f0f22014700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0f1c0b8d90 0x7f0f1c06ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:56.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.378+0000 7f0f22014700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f1c0b8620 con 0x7f0f1c1449d0 2023-07-12T02:02:56.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.378+0000 7f0f22014700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f1c0b97a0 con 0x7f0f1c0b8d90 2023-07-12T02:02:56.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.378+0000 7f0f22014700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1c144da0 con 0x7f0f1c0bc810 2023-07-12T02:02:56.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.379+0000 7f0f1bfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0f1c0b8d90 0x7f0f1c06ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:56.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.379+0000 7f0f1bfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0f1c0b8d90 0x7f0f1c06ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58736/0 (socket says 172.21.15.60:58736) 2023-07-12T02:02:56.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.379+0000 7f0f1bfff700 1 -- 172.21.15.60:0/991683825 learned_addr learned my addr 172.21.15.60:0/991683825 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:56.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.379+0000 7f0f1affd700 1 --2- 172.21.15.60:0/991683825 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0f1c0bc810 0x7f0f1c0ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:56.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.379+0000 7f0f1bfff700 1 -- 172.21.15.60:0/991683825 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0f1c0bc810 msgr2=0x7f0f1c0ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:56.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.379+0000 7f0f1bfff700 1 --2- 172.21.15.60:0/991683825 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0f1c0bc810 0x7f0f1c0ba530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:56.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.379+0000 7f0f1bfff700 1 -- 172.21.15.60:0/991683825 >> v1:172.21.15.79:6789/0 conn(0x7f0f1c1449d0 legacy=0x7f0f1c14db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:56.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.379+0000 7f0f1bfff700 1 -- 172.21.15.60:0/991683825 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f1c0b8900 con 0x7f0f1c0b8d90 2023-07-12T02:02:56.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.379+0000 7f0f1bfff700 1 --2- 172.21.15.60:0/991683825 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f1c0b8d90 0x7f0f1c06ade0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0f14009e50 tx=0x7f0f1400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56982cd766f09c37 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:56.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.379+0000 7f0f1a7fc700 1 -- 172.21.15.60:0/991683825 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1400e070 con 0x7f0f1c0b8d90 2023-07-12T02:02:56.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.379+0000 7f0f1a7fc700 1 -- 172.21.15.60:0/991683825 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f1400b910 con 0x7f0f1c0b8d90 2023-07-12T02:02:56.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.379+0000 7f0f1a7fc700 1 -- 172.21.15.60:0/991683825 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1400bcc0 con 0x7f0f1c0b8d90 2023-07-12T02:02:56.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.380+0000 7f0f22014700 1 -- 172.21.15.60:0/991683825 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f1c0b8d90 msgr2=0x7f0f1c06ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:56.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.380+0000 7f0f22014700 1 --2- 172.21.15.60:0/991683825 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f1c0b8d90 0x7f0f1c06ade0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0f14009e50 tx=0x7f0f1400b330 comp rx=0 tx=0).stop 2023-07-12T02:02:56.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.380+0000 7f0f22014700 1 -- 172.21.15.60:0/991683825 shutdown_connections 2023-07-12T02:02:56.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.380+0000 7f0f22014700 1 --2- 172.21.15.60:0/991683825 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f1c0b8d90 0x7f0f1c06ade0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:56.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.380+0000 7f0f22014700 1 --2- 172.21.15.60:0/991683825 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0f1c0bc810 0x7f0f1c0ba530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:56.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.380+0000 7f0f22014700 1 -- 172.21.15.60:0/991683825 >> 172.21.15.60:0/991683825 conn(0x7f0f1c0c0860 msgr2=0x7f0f1c0c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:56.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.380+0000 7f0f22014700 1 -- 172.21.15.60:0/991683825 shutdown_connections 2023-07-12T02:02:56.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.380+0000 7f0f22014700 1 -- 172.21.15.60:0/991683825 wait complete. 2023-07-12T02:02:56.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.381+0000 7f0f22014700 1 Processor -- start 2023-07-12T02:02:56.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.381+0000 7f0f22014700 1 -- start start 2023-07-12T02:02:56.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.382+0000 7f0f22014700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f1c0b8d90 0x7f0f1c1e3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:56.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.382+0000 7f0f22014700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0f1c0bc810 0x7f0f1c1d3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:56.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.382+0000 7f0f22014700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f1c1449d0 0x7f0f1c0b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:56.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.382+0000 7f0f22014700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1c14a5c0 con 0x7f0f1c0b8d90 2023-07-12T02:02:56.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.382+0000 7f0f22014700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1c142f80 con 0x7f0f1c1449d0 2023-07-12T02:02:56.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.382+0000 7f0f22014700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1c1d5980 con 0x7f0f1c0bc810 2023-07-12T02:02:56.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.382+0000 7f0f1b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f1c0b8d90 0x7f0f1c1e3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:56.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.382+0000 7f0f1b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f1c0b8d90 0x7f0f1c1e3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58750/0 (socket says 172.21.15.60:58750) 2023-07-12T02:02:56.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.382+0000 7f0f1b7fe700 1 -- 172.21.15.60:0/3229623639 learned_addr learned my addr 172.21.15.60:0/3229623639 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:56.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.382+0000 7f0f1affd700 1 --2- 172.21.15.60:0/3229623639 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0f1c0bc810 0x7f0f1c1d3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:56.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.382+0000 7f0f1bfff700 1 --2- 172.21.15.60:0/3229623639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f1c1449d0 0x7f0f1c0b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:56.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.382+0000 7f0f1b7fe700 1 -- 172.21.15.60:0/3229623639 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0f1c0bc810 msgr2=0x7f0f1c1d3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:56.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.382+0000 7f0f1b7fe700 1 --2- 172.21.15.60:0/3229623639 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0f1c0bc810 0x7f0f1c1d3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:56.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.382+0000 7f0f1b7fe700 1 -- 172.21.15.60:0/3229623639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f1c1449d0 msgr2=0x7f0f1c0b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:56.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.382+0000 7f0f1b7fe700 1 --2- 172.21.15.60:0/3229623639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f1c1449d0 0x7f0f1c0b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:56.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.382+0000 7f0f1b7fe700 1 -- 172.21.15.60:0/3229623639 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f14009b30 con 0x7f0f1c0b8d90 2023-07-12T02:02:56.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.382+0000 7f0f1b7fe700 1 --2- 172.21.15.60:0/3229623639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f1c0b8d90 0x7f0f1c1e3460 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c00c450 tx=0x7f0f0c00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:56.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.382+0000 7f0f03fff700 1 -- 172.21.15.60:0/3229623639 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c0052d0 con 0x7f0f1c0b8d90 2023-07-12T02:02:56.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.382+0000 7f0f03fff700 1 -- 172.21.15.60:0/3229623639 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f0c005430 con 0x7f0f1c0b8d90 2023-07-12T02:02:56.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.382+0000 7f0f03fff700 1 -- 172.21.15.60:0/3229623639 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c0038c0 con 0x7f0f1c0b8d90 2023-07-12T02:02:56.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.382+0000 7f0f22014700 1 -- 172.21.15.60:0/3229623639 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f1c1d5c60 con 0x7f0f1c0b8d90 2023-07-12T02:02:56.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.383+0000 7f0f22014700 1 -- 172.21.15.60:0/3229623639 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f1c1d51a0 con 0x7f0f1c0b8d90 2023-07-12T02:02:56.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.383+0000 7f0f22014700 1 -- 172.21.15.60:0/3229623639 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f1c14a3b0 con 0x7f0f1c0b8d90 2023-07-12T02:02:56.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.384+0000 7f0f03fff700 1 -- 172.21.15.60:0/3229623639 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0f0c003a20 con 0x7f0f1c0b8d90 2023-07-12T02:02:56.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.384+0000 7f0f03fff700 1 --2- 172.21.15.60:0/3229623639 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f0f0806ace0 0x7f0f0806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:56.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.384+0000 7f0f03fff700 1 -- 172.21.15.60:0/3229623639 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0f0c088460 con 0x7f0f1c0b8d90 2023-07-12T02:02:56.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.385+0000 7f0f1affd700 1 --2- 172.21.15.60:0/3229623639 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f0f0806ace0 0x7f0f0806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:56.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.385+0000 7f0f1affd700 1 --2- 172.21.15.60:0/3229623639 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f0f0806ace0 0x7f0f0806d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c14e7b0 tx=0x7f0f10009210 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:56.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.389+0000 7f0f03fff700 1 -- 172.21.15.60:0/3229623639 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f0f1c14a3b0 con 0x7f0f1c0b8d90 2023-07-12T02:02:56.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.585+0000 7f0f22014700 1 -- 172.21.15.60:0/3229623639 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0f1c14a3b0 con 0x7f0f1c0b8d90 2023-07-12T02:02:56.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.585+0000 7f0f03fff700 1 -- 172.21.15.60:0/3229623639 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0f1c14a3b0 con 0x7f0f1c0b8d90 2023-07-12T02:02:56.589 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-07-12T02:02:56.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.587+0000 7f0f22014700 1 -- 172.21.15.60:0/3229623639 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f0f0806ace0 msgr2=0x7f0f0806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:56.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.587+0000 7f0f22014700 1 --2- 172.21.15.60:0/3229623639 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f0f0806ace0 0x7f0f0806d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c14e7b0 tx=0x7f0f10009210 comp rx=0 tx=0).stop 2023-07-12T02:02:56.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.587+0000 7f0f22014700 1 -- 172.21.15.60:0/3229623639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f1c0b8d90 msgr2=0x7f0f1c1e3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:56.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.587+0000 7f0f22014700 1 --2- 172.21.15.60:0/3229623639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f1c0b8d90 0x7f0f1c1e3460 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c00c450 tx=0x7f0f0c00c760 comp rx=0 tx=0).stop 2023-07-12T02:02:56.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.587+0000 7f0f22014700 1 -- 172.21.15.60:0/3229623639 shutdown_connections 2023-07-12T02:02:56.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.587+0000 7f0f22014700 1 --2- 172.21.15.60:0/3229623639 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f0f0806ace0 0x7f0f0806d190 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:56.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.587+0000 7f0f22014700 1 --2- 172.21.15.60:0/3229623639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f1c0b8d90 0x7f0f1c1e3460 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:56.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.587+0000 7f0f22014700 1 --2- 172.21.15.60:0/3229623639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f1c1449d0 0x7f0f1c0b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:56.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.587+0000 7f0f22014700 1 --2- 172.21.15.60:0/3229623639 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0f1c0bc810 0x7f0f1c1d3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:56.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.587+0000 7f0f22014700 1 -- 172.21.15.60:0/3229623639 >> 172.21.15.60:0/3229623639 conn(0x7f0f1c0c0860 msgr2=0x7f0f1c0bf240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:56.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.587+0000 7f0f22014700 1 -- 172.21.15.60:0/3229623639 shutdown_connections 2023-07-12T02:02:56.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.587+0000 7f0f22014700 1 -- 172.21.15.60:0/3229623639 wait complete. 2023-07-12T02:02:56.603 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-12T02:02:56.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.724+0000 7f0357212700 1 Processor -- start 2023-07-12T02:02:56.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.725+0000 7f0357212700 1 -- start start 2023-07-12T02:02:56.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.726+0000 7f0357212700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f035006b120 0x7f03501474f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:56.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.726+0000 7f0357212700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0350071b60 0x7f0350147a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:56.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.726+0000 7f0357212700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f03500b6430 0x7f03500b68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:56.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.726+0000 7f0357212700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0350070800 con 0x7f03500b6430 2023-07-12T02:02:56.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.726+0000 7f0357212700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0350141c90 con 0x7f0350071b60 2023-07-12T02:02:56.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.726+0000 7f0357212700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03500b3bd0 con 0x7f035006b120 2023-07-12T02:02:56.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.726+0000 7f03557af700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f03500b6430 0x7f03500b68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:56.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.726+0000 7f03557af700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f03500b6430 0x7f03500b68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58756/0 (socket says 172.21.15.60:58756) 2023-07-12T02:02:56.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.726+0000 7f03557af700 1 -- 172.21.15.60:0/865600835 learned_addr learned my addr 172.21.15.60:0/865600835 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:56.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.726+0000 7f0347fff700 1 --2- 172.21.15.60:0/865600835 >> v2:172.21.15.79:3300/0 conn(0x7f0350071b60 0x7f0350147a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:56.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.726+0000 7f0354fae700 1 --2- 172.21.15.60:0/865600835 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f035006b120 0x7f03501474f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:56.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.726+0000 7f03557af700 1 -- 172.21.15.60:0/865600835 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f035006b120 msgr2=0x7f03501474f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:56.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.726+0000 7f03557af700 1 --2- 172.21.15.60:0/865600835 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f035006b120 0x7f03501474f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:56.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.726+0000 7f03557af700 1 -- 172.21.15.60:0/865600835 >> v2:172.21.15.79:3300/0 conn(0x7f0350071b60 msgr2=0x7f0350147a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:56.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.726+0000 7f03557af700 1 --2- 172.21.15.60:0/865600835 >> v2:172.21.15.79:3300/0 conn(0x7f0350071b60 0x7f0350147a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:56.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.726+0000 7f03557af700 1 -- 172.21.15.60:0/865600835 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03500714d0 con 0x7f03500b6430 2023-07-12T02:02:56.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.726+0000 7f0347fff700 1 --2- 172.21.15.60:0/865600835 >> v2:172.21.15.79:3300/0 conn(0x7f0350071b60 0x7f0350147a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:02:56.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.726+0000 7f03557af700 1 --2- 172.21.15.60:0/865600835 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03500b6430 0x7f03500b68d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0350067200 tx=0x7f034800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de641dea0442d83f server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:56.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.726+0000 7f03477fe700 1 -- 172.21.15.60:0/865600835 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034800dd30 con 0x7f03500b6430 2023-07-12T02:02:56.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.726+0000 7f03477fe700 1 -- 172.21.15.60:0/865600835 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034800de90 con 0x7f03500b6430 2023-07-12T02:02:56.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.726+0000 7f03477fe700 1 -- 172.21.15.60:0/865600835 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0348010690 con 0x7f03500b6430 2023-07-12T02:02:56.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.727+0000 7f0357212700 1 -- 172.21.15.60:0/865600835 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03500b6430 msgr2=0x7f03500b68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:56.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.727+0000 7f0357212700 1 --2- 172.21.15.60:0/865600835 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03500b6430 0x7f03500b68d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0350067200 tx=0x7f034800be70 comp rx=0 tx=0).stop 2023-07-12T02:02:56.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.727+0000 7f0357212700 1 -- 172.21.15.60:0/865600835 shutdown_connections 2023-07-12T02:02:56.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.727+0000 7f0357212700 1 --2- 172.21.15.60:0/865600835 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03500b6430 0x7f03500b68d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:56.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.727+0000 7f0357212700 1 --2- 172.21.15.60:0/865600835 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f035006b120 0x7f03501474f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:56.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.727+0000 7f0357212700 1 --2- 172.21.15.60:0/865600835 >> v2:172.21.15.79:3300/0 conn(0x7f0350071b60 0x7f0350147a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:56.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.727+0000 7f0357212700 1 -- 172.21.15.60:0/865600835 >> 172.21.15.60:0/865600835 conn(0x7f03500bd980 msgr2=0x7f03500b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:56.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.727+0000 7f0357212700 1 -- 172.21.15.60:0/865600835 shutdown_connections 2023-07-12T02:02:56.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.727+0000 7f0357212700 1 -- 172.21.15.60:0/865600835 wait complete. 2023-07-12T02:02:56.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.728+0000 7f0357212700 1 Processor -- start 2023-07-12T02:02:56.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.728+0000 7f0357212700 1 -- start start 2023-07-12T02:02:56.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.729+0000 7f0357212700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f035006b120 0x7f03501dbef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:56.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.729+0000 7f0357212700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0350071b60 0x7f0350139a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:56.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.729+0000 7f0357212700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03500b6430 0x7f03501485e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:56.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.729+0000 7f0357212700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03501dbad0 con 0x7f03500b6430 2023-07-12T02:02:56.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.729+0000 7f0357212700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0350149dd0 con 0x7f035006b120 2023-07-12T02:02:56.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.729+0000 7f0357212700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f035014ae10 con 0x7f0350071b60 2023-07-12T02:02:56.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.729+0000 7f03557af700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03500b6430 0x7f03501485e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:56.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.729+0000 7f03557af700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03500b6430 0x7f03501485e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58766/0 (socket says 172.21.15.60:58766) 2023-07-12T02:02:56.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.729+0000 7f03557af700 1 -- 172.21.15.60:0/1071771384 learned_addr learned my addr 172.21.15.60:0/1071771384 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:56.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.729+0000 7f0347fff700 1 --2- 172.21.15.60:0/1071771384 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0350071b60 0x7f0350139a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:56.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.729+0000 7f0354fae700 1 --2- 172.21.15.60:0/1071771384 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f035006b120 0x7f03501dbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:56.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.729+0000 7f03557af700 1 -- 172.21.15.60:0/1071771384 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0350071b60 msgr2=0x7f0350139a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:56.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.729+0000 7f03557af700 1 --2- 172.21.15.60:0/1071771384 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0350071b60 0x7f0350139a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:56.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.729+0000 7f03557af700 1 -- 172.21.15.60:0/1071771384 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f035006b120 msgr2=0x7f03501dbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:56.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.729+0000 7f03557af700 1 --2- 172.21.15.60:0/1071771384 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f035006b120 0x7f03501dbef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:56.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.729+0000 7f03557af700 1 -- 172.21.15.60:0/1071771384 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f034800b7f0 con 0x7f03500b6430 2023-07-12T02:02:56.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.729+0000 7f0354fae700 1 --2- 172.21.15.60:0/1071771384 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f035006b120 0x7f03501dbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:56.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.729+0000 7f0347fff700 1 --2- 172.21.15.60:0/1071771384 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0350071b60 0x7f0350139a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:56.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.730+0000 7f03557af700 1 --2- 172.21.15.60:0/1071771384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03500b6430 0x7f03501485e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f034800d5d0 tx=0x7f0348004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:56.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.730+0000 7f03457fa700 1 -- 172.21.15.60:0/1071771384 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034801f070 con 0x7f03500b6430 2023-07-12T02:02:56.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.730+0000 7f03457fa700 1 -- 172.21.15.60:0/1071771384 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0348003b40 con 0x7f03500b6430 2023-07-12T02:02:56.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.730+0000 7f03457fa700 1 -- 172.21.15.60:0/1071771384 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0348010470 con 0x7f03500b6430 2023-07-12T02:02:56.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.730+0000 7f0357212700 1 -- 172.21.15.60:0/1071771384 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03501db6f0 con 0x7f03500b6430 2023-07-12T02:02:56.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.730+0000 7f0357212700 1 -- 172.21.15.60:0/1071771384 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03501db3c0 con 0x7f03500b6430 2023-07-12T02:02:56.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.731+0000 7f0357212700 1 -- 172.21.15.60:0/1071771384 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03501dbc10 con 0x7f03500b6430 2023-07-12T02:02:56.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.731+0000 7f03457fa700 1 -- 172.21.15.60:0/1071771384 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f034802d430 con 0x7f03500b6430 2023-07-12T02:02:56.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.732+0000 7f03457fa700 1 --2- 172.21.15.60:0/1071771384 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f033c06ace0 0x7f033c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:56.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.732+0000 7f03457fa700 1 -- 172.21.15.60:0/1071771384 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f034808cce0 con 0x7f03500b6430 2023-07-12T02:02:56.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.732+0000 7f0354fae700 1 --2- 172.21.15.60:0/1071771384 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f033c06ace0 0x7f033c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:56.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.732+0000 7f0354fae700 1 --2- 172.21.15.60:0/1071771384 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f033c06ace0 0x7f033c06d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f034c00e4a0 tx=0x7f034c007620 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:56.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.736+0000 7f03457fa700 1 -- 172.21.15.60:0/1071771384 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f03501dbc10 con 0x7f03500b6430 2023-07-12T02:02:56.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.935+0000 7f0357212700 1 -- 172.21.15.60:0/1071771384 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f03501dbc10 con 0x7f03500b6430 2023-07-12T02:02:56.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.936+0000 7f03457fa700 1 -- 172.21.15.60:0/1071771384 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v27) v1 ==== 84+0+126 (secure 0 0 0) 0x7f03501dbc10 con 0x7f03500b6430 2023-07-12T02:02:56.940 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:02:56.940 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2023-07-12T02:02:56.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-07-12T02:02:56.941 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 1, 2023-07-12T02:02:56.941 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": "rbd" 2023-07-12T02:02:56.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-07-12T02:02:56.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-07-12T02:02:56.941 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 2, 2023-07-12T02:02:56.941 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": ".mgr" 2023-07-12T02:02:56.941 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-07-12T02:02:56.941 INFO:teuthology.orchestra.run.smithi060.stdout:] 2023-07-12T02:02:56.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.937+0000 7f0357212700 1 -- 172.21.15.60:0/1071771384 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f033c06ace0 msgr2=0x7f033c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:56.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.937+0000 7f0357212700 1 --2- 172.21.15.60:0/1071771384 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f033c06ace0 0x7f033c06d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f034c00e4a0 tx=0x7f034c007620 comp rx=0 tx=0).stop 2023-07-12T02:02:56.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.937+0000 7f0357212700 1 -- 172.21.15.60:0/1071771384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03500b6430 msgr2=0x7f03501485e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:56.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.937+0000 7f0357212700 1 --2- 172.21.15.60:0/1071771384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03500b6430 0x7f03501485e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f034800d5d0 tx=0x7f0348004750 comp rx=0 tx=0).stop 2023-07-12T02:02:56.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.937+0000 7f0357212700 1 -- 172.21.15.60:0/1071771384 shutdown_connections 2023-07-12T02:02:56.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.938+0000 7f0357212700 1 --2- 172.21.15.60:0/1071771384 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f033c06ace0 0x7f033c06d190 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:56.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.938+0000 7f0357212700 1 --2- 172.21.15.60:0/1071771384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03500b6430 0x7f03501485e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:56.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.938+0000 7f0357212700 1 --2- 172.21.15.60:0/1071771384 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f035006b120 0x7f03501dbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:56.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.938+0000 7f0357212700 1 --2- 172.21.15.60:0/1071771384 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0350071b60 0x7f0350139a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:56.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.938+0000 7f0357212700 1 -- 172.21.15.60:0/1071771384 >> 172.21.15.60:0/1071771384 conn(0x7f03500bd980 msgr2=0x7f03500bc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:56.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.938+0000 7f0357212700 1 -- 172.21.15.60:0/1071771384 shutdown_connections 2023-07-12T02:02:56.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:56.938+0000 7f0357212700 1 -- 172.21.15.60:0/1071771384 wait complete. 2023-07-12T02:02:56.954 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-12T02:02:56.954 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-12T02:02:57.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.080+0000 7f6855d7c700 1 Processor -- start 2023-07-12T02:02:57.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.080+0000 7f6855d7c700 1 -- start start 2023-07-12T02:02:57.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.081+0000 7f6855d7c700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f68500b6580 0x7f685014ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:57.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.081+0000 7f6855d7c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f68500c0e90 0x7f6850154e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:57.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.081+0000 7f6855d7c700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f685014a9c0 con 0x7f6850144a20 2023-07-12T02:02:57.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.081+0000 7f6855d7c700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f685014a6c0 con 0x7f68500c0e90 2023-07-12T02:02:57.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.081+0000 7f6855d7c700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68500b6a50 con 0x7f68500b6580 2023-07-12T02:02:57.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.081+0000 7f684f7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f6850144a20 0x7f68500bcac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60616/0 (socket says 172.21.15.60:60616) 2023-07-12T02:02:57.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.081+0000 7f684f7fe700 1 -- 172.21.15.60:0/807859947 learned_addr learned my addr 172.21.15.60:0/807859947 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:57.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.081+0000 7f6847fff700 1 --2- 172.21.15.60:0/807859947 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f68500b6580 0x7f685014ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:57.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.081+0000 7f684ffff700 1 --2- 172.21.15.60:0/807859947 >> v2:172.21.15.79:3300/0 conn(0x7f68500c0e90 0x7f6850154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:57.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.081+0000 7f684effd700 1 -- 172.21.15.60:0/807859947 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3335102765 0 0) 0x7f685014a9c0 con 0x7f6850144a20 2023-07-12T02:02:57.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.081+0000 7f684effd700 1 -- 172.21.15.60:0/807859947 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f683c0035b0 con 0x7f6850144a20 2023-07-12T02:02:57.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.081+0000 7f684ffff700 1 -- 172.21.15.60:0/807859947 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f68500b6580 msgr2=0x7f685014ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:57.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.081+0000 7f684ffff700 1 --2- 172.21.15.60:0/807859947 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f68500b6580 0x7f685014ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:57.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.081+0000 7f684ffff700 1 -- 172.21.15.60:0/807859947 >> v1:172.21.15.60:6789/0 conn(0x7f6850144a20 legacy=0x7f68500bcac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:57.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.081+0000 7f684ffff700 1 -- 172.21.15.60:0/807859947 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68500b5dd0 con 0x7f68500c0e90 2023-07-12T02:02:57.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.081+0000 7f6847fff700 1 --2- 172.21.15.60:0/807859947 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f68500b6580 0x7f685014ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:02:57.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.082+0000 7f684ffff700 1 --2- 172.21.15.60:0/807859947 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68500c0e90 0x7f6850154e50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6848009d90 tx=0x7f684800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4f0f1aab9537549 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:57.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.082+0000 7f684effd700 1 -- 172.21.15.60:0/807859947 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684800e070 con 0x7f68500c0e90 2023-07-12T02:02:57.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.082+0000 7f684effd700 1 -- 172.21.15.60:0/807859947 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f684800bb20 con 0x7f68500c0e90 2023-07-12T02:02:57.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.082+0000 7f684effd700 1 -- 172.21.15.60:0/807859947 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6848012430 con 0x7f68500c0e90 2023-07-12T02:02:57.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.082+0000 7f6855d7c700 1 -- 172.21.15.60:0/807859947 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68500c0e90 msgr2=0x7f6850154e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:57.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.082+0000 7f6855d7c700 1 --2- 172.21.15.60:0/807859947 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68500c0e90 0x7f6850154e50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6848009d90 tx=0x7f684800b330 comp rx=0 tx=0).stop 2023-07-12T02:02:57.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.082+0000 7f6855d7c700 1 -- 172.21.15.60:0/807859947 shutdown_connections 2023-07-12T02:02:57.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.082+0000 7f6855d7c700 1 --2- 172.21.15.60:0/807859947 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68500c0e90 0x7f6850154e50 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:57.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.082+0000 7f6855d7c700 1 --2- 172.21.15.60:0/807859947 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f68500b6580 0x7f685014ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:57.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.082+0000 7f6855d7c700 1 -- 172.21.15.60:0/807859947 >> 172.21.15.60:0/807859947 conn(0x7f685006ba60 msgr2=0x7f68500c0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:57.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.082+0000 7f6855d7c700 1 -- 172.21.15.60:0/807859947 shutdown_connections 2023-07-12T02:02:57.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.082+0000 7f6855d7c700 1 -- 172.21.15.60:0/807859947 wait complete. 2023-07-12T02:02:57.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.083+0000 7f6855d7c700 1 Processor -- start 2023-07-12T02:02:57.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.084+0000 7f6855d7c700 1 -- start start 2023-07-12T02:02:57.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.084+0000 7f6855d7c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68500b6580 0x7f685013c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:57.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.084+0000 7f6855d7c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68500c0e90 0x7f68501e0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:57.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.084+0000 7f6855d7c700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6850144a20 0x7f68501e07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:57.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.084+0000 7f6855d7c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68501e3a50 con 0x7f68500c0e90 2023-07-12T02:02:57.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.084+0000 7f6855d7c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68501e3d30 con 0x7f68500b6580 2023-07-12T02:02:57.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.084+0000 7f6855d7c700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68501e4010 con 0x7f6850144a20 2023-07-12T02:02:57.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.084+0000 7f6847fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68500c0e90 0x7f68501e0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:57.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.084+0000 7f6847fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68500c0e90 0x7f68501e0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58774/0 (socket says 172.21.15.60:58774) 2023-07-12T02:02:57.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.084+0000 7f6847fff700 1 -- 172.21.15.60:0/3690511384 learned_addr learned my addr 172.21.15.60:0/3690511384 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:57.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.084+0000 7f684ffff700 1 --2- 172.21.15.60:0/3690511384 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6850144a20 0x7f68501e07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:57.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.084+0000 7f684f7fe700 1 --2- 172.21.15.60:0/3690511384 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68500b6580 0x7f685013c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:57.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.085+0000 7f6847fff700 1 -- 172.21.15.60:0/3690511384 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6850144a20 msgr2=0x7f68501e07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:57.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.085+0000 7f6847fff700 1 --2- 172.21.15.60:0/3690511384 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6850144a20 0x7f68501e07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:57.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.085+0000 7f6847fff700 1 -- 172.21.15.60:0/3690511384 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68500b6580 msgr2=0x7f685013c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:57.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.085+0000 7f6847fff700 1 --2- 172.21.15.60:0/3690511384 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68500b6580 0x7f685013c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:57.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.085+0000 7f6847fff700 1 -- 172.21.15.60:0/3690511384 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68380094a0 con 0x7f68500c0e90 2023-07-12T02:02:57.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.085+0000 7f6847fff700 1 --2- 172.21.15.60:0/3690511384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68500c0e90 0x7f68501e0270 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f683800ebb0 tx=0x7f683800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:57.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.085+0000 7f684cff9700 1 -- 172.21.15.60:0/3690511384 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683800c910 con 0x7f68500c0e90 2023-07-12T02:02:57.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.085+0000 7f684cff9700 1 -- 172.21.15.60:0/3690511384 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f683800ca70 con 0x7f68500c0e90 2023-07-12T02:02:57.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.085+0000 7f6855d7c700 1 -- 172.21.15.60:0/3690511384 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6848009a70 con 0x7f68500c0e90 2023-07-12T02:02:57.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.085+0000 7f684cff9700 1 -- 172.21.15.60:0/3690511384 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683800ce20 con 0x7f68500c0e90 2023-07-12T02:02:57.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.085+0000 7f6855d7c700 1 -- 172.21.15.60:0/3690511384 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f685014b710 con 0x7f68500c0e90 2023-07-12T02:02:57.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.086+0000 7f6855d7c700 1 -- 172.21.15.60:0/3690511384 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68501e4530 con 0x7f68500c0e90 2023-07-12T02:02:57.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.086+0000 7f684cff9700 1 -- 172.21.15.60:0/3690511384 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6838013470 con 0x7f68500c0e90 2023-07-12T02:02:57.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.087+0000 7f684cff9700 1 --2- 172.21.15.60:0/3690511384 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f683006ace0 0x7f683006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:57.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.087+0000 7f684cff9700 1 -- 172.21.15.60:0/3690511384 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6838088ee0 con 0x7f68500c0e90 2023-07-12T02:02:57.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.087+0000 7f684f7fe700 1 --2- 172.21.15.60:0/3690511384 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f683006ace0 0x7f683006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:57.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.087+0000 7f684f7fe700 1 --2- 172.21.15.60:0/3690511384 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f683006ace0 0x7f683006d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f68400011e0 tx=0x7f6840009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:57.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.091+0000 7f684cff9700 1 -- 172.21.15.60:0/3690511384 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f68501e4530 con 0x7f68500c0e90 2023-07-12T02:02:57.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.286+0000 7f6855d7c700 1 -- 172.21.15.60:0/3690511384 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f68501e4530 con 0x7f68500c0e90 2023-07-12T02:02:57.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.537+0000 7f684cff9700 1 -- 172.21.15.60:0/3690511384 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v28) v1 ==== 138+0+0 (secure 0 0 0) 0x7f68501e4530 con 0x7f68500c0e90 2023-07-12T02:02:57.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.539+0000 7f6855d7c700 1 -- 172.21.15.60:0/3690511384 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f683006ace0 msgr2=0x7f683006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:57.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.539+0000 7f6855d7c700 1 --2- 172.21.15.60:0/3690511384 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f683006ace0 0x7f683006d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f68400011e0 tx=0x7f6840009040 comp rx=0 tx=0).stop 2023-07-12T02:02:57.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.539+0000 7f6855d7c700 1 -- 172.21.15.60:0/3690511384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68500c0e90 msgr2=0x7f68501e0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:57.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.539+0000 7f6855d7c700 1 --2- 172.21.15.60:0/3690511384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68500c0e90 0x7f68501e0270 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f683800ebb0 tx=0x7f683800ef70 comp rx=0 tx=0).stop 2023-07-12T02:02:57.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.539+0000 7f6855d7c700 1 -- 172.21.15.60:0/3690511384 shutdown_connections 2023-07-12T02:02:57.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.539+0000 7f6855d7c700 1 --2- 172.21.15.60:0/3690511384 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f683006ace0 0x7f683006d190 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:57.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.539+0000 7f6855d7c700 1 --2- 172.21.15.60:0/3690511384 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6850144a20 0x7f68501e07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:57.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.539+0000 7f6855d7c700 1 --2- 172.21.15.60:0/3690511384 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68500b6580 0x7f685013c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:57.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.539+0000 7f6855d7c700 1 --2- 172.21.15.60:0/3690511384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68500c0e90 0x7f68501e0270 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:57.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.539+0000 7f6855d7c700 1 -- 172.21.15.60:0/3690511384 >> 172.21.15.60:0/3690511384 conn(0x7f685006ba60 msgr2=0x7f68500bd950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:57.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.539+0000 7f6855d7c700 1 -- 172.21.15.60:0/3690511384 shutdown_connections 2023-07-12T02:02:57.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.539+0000 7f6855d7c700 1 -- 172.21.15.60:0/3690511384 wait complete. 2023-07-12T02:02:57.545 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' created 2023-07-12T02:02:57.559 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-12T02:02:57.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.688+0000 7ff0b2aa6700 1 Processor -- start 2023-07-12T02:02:57.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.688+0000 7ff0b2aa6700 1 -- start start 2023-07-12T02:02:57.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.689+0000 7ff0b2aa6700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff0ac1449d0 0x7ff0ac14db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:57.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.689+0000 7ff0b2aa6700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0ac0bc810 0x7ff0ac0ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:57.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.689+0000 7ff0b2aa6700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0ac0b8620 con 0x7ff0ac0b8d90 2023-07-12T02:02:57.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.689+0000 7ff0b2aa6700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0ac0b97a0 con 0x7ff0ac1449d0 2023-07-12T02:02:57.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.689+0000 7ff0b2aa6700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ac144da0 con 0x7ff0ac0bc810 2023-07-12T02:02:57.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.689+0000 7ff0b0842700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff0ac1449d0 0x7ff0ac14db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:57.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.689+0000 7ff0b0842700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff0ac1449d0 0x7ff0ac14db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59590/0 (socket says 172.21.15.60:59590) 2023-07-12T02:02:57.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.689+0000 7ff0b1043700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff0ac0b8d90 0x7ff0ac06ade0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:38512/0 (socket says 172.21.15.60:38512) 2023-07-12T02:02:57.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.689+0000 7ff0b0842700 1 -- 172.21.15.60:0/2213298372 learned_addr learned my addr 172.21.15.60:0/2213298372 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:57.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.689+0000 7ff0abfff700 1 --2- 172.21.15.60:0/2213298372 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0ac0bc810 0x7ff0ac0ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:57.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.689+0000 7ff0b0842700 1 -- 172.21.15.60:0/2213298372 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0ac0bc810 msgr2=0x7ff0ac0ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:57.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.689+0000 7ff0b0842700 1 --2- 172.21.15.60:0/2213298372 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0ac0bc810 0x7ff0ac0ba530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:57.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.690+0000 7ff0b0842700 1 -- 172.21.15.60:0/2213298372 >> v1:172.21.15.60:6789/0 conn(0x7ff0ac0b8d90 legacy=0x7ff0ac06ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:57.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.690+0000 7ff0b0842700 1 -- 172.21.15.60:0/2213298372 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ac0b8900 con 0x7ff0ac1449d0 2023-07-12T02:02:57.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.690+0000 7ff0ab7fe700 1 -- 172.21.15.60:0/2213298372 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1785088368 0 0) 0x7ff0ac0b8620 con 0x7ff0ac0b8d90 2023-07-12T02:02:57.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.690+0000 7ff0abfff700 1 --2- 172.21.15.60:0/2213298372 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0ac0bc810 0x7ff0ac0ba530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:57.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.690+0000 7ff0b0842700 1 --2- 172.21.15.60:0/2213298372 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0ac1449d0 0x7ff0ac14db50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff0a00098f0 tx=0x7ff0a0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3daaa283a47d48b6 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:57.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.690+0000 7ff0ab7fe700 1 -- 172.21.15.60:0/2213298372 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a000b8a0 con 0x7ff0ac1449d0 2023-07-12T02:02:57.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.690+0000 7ff0ab7fe700 1 -- 172.21.15.60:0/2213298372 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a000ba00 con 0x7ff0ac1449d0 2023-07-12T02:02:57.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.690+0000 7ff0ab7fe700 1 -- 172.21.15.60:0/2213298372 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a000bd90 con 0x7ff0ac1449d0 2023-07-12T02:02:57.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.690+0000 7ff0b2aa6700 1 -- 172.21.15.60:0/2213298372 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0ac1449d0 msgr2=0x7ff0ac14db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:57.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.690+0000 7ff0b2aa6700 1 --2- 172.21.15.60:0/2213298372 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0ac1449d0 0x7ff0ac14db50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff0a00098f0 tx=0x7ff0a0009c00 comp rx=0 tx=0).stop 2023-07-12T02:02:57.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.690+0000 7ff0b2aa6700 1 -- 172.21.15.60:0/2213298372 shutdown_connections 2023-07-12T02:02:57.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.690+0000 7ff0b2aa6700 1 --2- 172.21.15.60:0/2213298372 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0ac1449d0 0x7ff0ac14db50 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:57.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.690+0000 7ff0b2aa6700 1 --2- 172.21.15.60:0/2213298372 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0ac0bc810 0x7ff0ac0ba530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:57.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.690+0000 7ff0b2aa6700 1 -- 172.21.15.60:0/2213298372 >> 172.21.15.60:0/2213298372 conn(0x7ff0ac0c0860 msgr2=0x7ff0ac0c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:57.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.690+0000 7ff0b2aa6700 1 -- 172.21.15.60:0/2213298372 shutdown_connections 2023-07-12T02:02:57.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.690+0000 7ff0b2aa6700 1 -- 172.21.15.60:0/2213298372 wait complete. 2023-07-12T02:02:57.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.692+0000 7ff0b2aa6700 1 Processor -- start 2023-07-12T02:02:57.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.692+0000 7ff0b2aa6700 1 -- start start 2023-07-12T02:02:57.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.692+0000 7ff0b2aa6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0ac0b8d90 0x7ff0ac0a20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:57.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.692+0000 7ff0b2aa6700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0ac0bc810 0x7ff0ac0a6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:57.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.692+0000 7ff0b2aa6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0ac1449d0 0x7ff0ac1df5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:57.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.692+0000 7ff0b2aa6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ac0a3010 con 0x7ff0ac0b8d90 2023-07-12T02:02:57.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.692+0000 7ff0b2aa6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ac0a6550 con 0x7ff0ac1449d0 2023-07-12T02:02:57.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.692+0000 7ff0b2aa6700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ac1dfae0 con 0x7ff0ac0bc810 2023-07-12T02:02:57.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.692+0000 7ff0b0842700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0ac0b8d90 0x7ff0ac0a20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:57.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.692+0000 7ff0b0842700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0ac0b8d90 0x7ff0ac0a20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59596/0 (socket says 172.21.15.60:59596) 2023-07-12T02:02:57.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.692+0000 7ff0b0842700 1 -- 172.21.15.60:0/826346805 learned_addr learned my addr 172.21.15.60:0/826346805 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:57.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.693+0000 7ff0abfff700 1 --2- 172.21.15.60:0/826346805 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0ac0bc810 0x7ff0ac0a6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:57.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.693+0000 7ff0b1043700 1 --2- 172.21.15.60:0/826346805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0ac1449d0 0x7ff0ac1df5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:57.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.693+0000 7ff0b0842700 1 -- 172.21.15.60:0/826346805 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0ac0bc810 msgr2=0x7ff0ac0a6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:57.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.693+0000 7ff0b0842700 1 --2- 172.21.15.60:0/826346805 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0ac0bc810 0x7ff0ac0a6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:57.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.693+0000 7ff0b0842700 1 -- 172.21.15.60:0/826346805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0ac1449d0 msgr2=0x7ff0ac1df5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:57.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.693+0000 7ff0b0842700 1 --2- 172.21.15.60:0/826346805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0ac1449d0 0x7ff0ac1df5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:57.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.693+0000 7ff0b0842700 1 -- 172.21.15.60:0/826346805 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a0009550 con 0x7ff0ac0b8d90 2023-07-12T02:02:57.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.693+0000 7ff0b0842700 1 --2- 172.21.15.60:0/826346805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0ac0b8d90 0x7ff0ac0a20e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0014040 tx=0x7ff0a0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:57.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.693+0000 7ff0a97fa700 1 -- 172.21.15.60:0/826346805 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0004510 con 0x7ff0ac0b8d90 2023-07-12T02:02:57.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.693+0000 7ff0a97fa700 1 -- 172.21.15.60:0/826346805 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a001e070 con 0x7ff0ac0b8d90 2023-07-12T02:02:57.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.693+0000 7ff0a97fa700 1 -- 172.21.15.60:0/826346805 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a00038c0 con 0x7ff0ac0b8d90 2023-07-12T02:02:57.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.693+0000 7ff0b2aa6700 1 -- 172.21.15.60:0/826346805 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0ac0a1970 con 0x7ff0ac0b8d90 2023-07-12T02:02:57.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.693+0000 7ff0b2aa6700 1 -- 172.21.15.60:0/826346805 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0ac0a1c50 con 0x7ff0ac0b8d90 2023-07-12T02:02:57.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.694+0000 7ff0b2aa6700 1 -- 172.21.15.60:0/826346805 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0ac074360 con 0x7ff0ac0b8d90 2023-07-12T02:02:57.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.695+0000 7ff0a97fa700 1 -- 172.21.15.60:0/826346805 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff0a0003a20 con 0x7ff0ac0b8d90 2023-07-12T02:02:57.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.695+0000 7ff0a97fa700 1 --2- 172.21.15.60:0/826346805 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ff09006ace0 0x7ff09006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:57.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.695+0000 7ff0a97fa700 1 -- 172.21.15.60:0/826346805 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5580+0+0 (secure 0 0 0) 0x7ff0a0020070 con 0x7ff0ac0b8d90 2023-07-12T02:02:57.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.695+0000 7ff0abfff700 1 --2- 172.21.15.60:0/826346805 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ff09006ace0 0x7ff09006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:57.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.696+0000 7ff0abfff700 1 --2- 172.21.15.60:0/826346805 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ff09006ace0 0x7ff09006d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac0c0600 tx=0x7ff098008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:57.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.700+0000 7ff0a97fa700 1 -- 172.21.15.60:0/826346805 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7ff0a0055970 con 0x7ff0ac0b8d90 2023-07-12T02:02:57.904 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:57.900+0000 7ff0b2aa6700 1 -- 172.21.15.60:0/826346805 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff0ac0a1f30 con 0x7ff0ac0b8d90 2023-07-12T02:02:58.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.543+0000 7ff0a97fa700 1 -- 172.21.15.60:0/826346805 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v29) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff0a0058f90 con 0x7ff0ac0b8d90 2023-07-12T02:02:58.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.549+0000 7ff0b2aa6700 1 -- 172.21.15.60:0/826346805 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ff09006ace0 msgr2=0x7ff09006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:58.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.549+0000 7ff0b2aa6700 1 --2- 172.21.15.60:0/826346805 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ff09006ace0 0x7ff09006d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac0c0600 tx=0x7ff098008040 comp rx=0 tx=0).stop 2023-07-12T02:02:58.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.549+0000 7ff0b2aa6700 1 -- 172.21.15.60:0/826346805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0ac0b8d90 msgr2=0x7ff0ac0a20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:58.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.549+0000 7ff0b2aa6700 1 --2- 172.21.15.60:0/826346805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0ac0b8d90 0x7ff0ac0a20e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0014040 tx=0x7ff0a0004750 comp rx=0 tx=0).stop 2023-07-12T02:02:58.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.551+0000 7ff0b2aa6700 1 -- 172.21.15.60:0/826346805 shutdown_connections 2023-07-12T02:02:58.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.551+0000 7ff0b2aa6700 1 --2- 172.21.15.60:0/826346805 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ff09006ace0 0x7ff09006d190 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:58.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.551+0000 7ff0b2aa6700 1 --2- 172.21.15.60:0/826346805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0ac0b8d90 0x7ff0ac0a20e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:58.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.551+0000 7ff0b2aa6700 1 --2- 172.21.15.60:0/826346805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0ac1449d0 0x7ff0ac1df5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:58.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.551+0000 7ff0b2aa6700 1 --2- 172.21.15.60:0/826346805 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0ac0bc810 0x7ff0ac0a6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:58.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.551+0000 7ff0b2aa6700 1 -- 172.21.15.60:0/826346805 >> 172.21.15.60:0/826346805 conn(0x7ff0ac0c0860 msgr2=0x7ff0ac143810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:58.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.552+0000 7ff0b2aa6700 1 -- 172.21.15.60:0/826346805 shutdown_connections 2023-07-12T02:02:58.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.553+0000 7ff0b2aa6700 1 -- 172.21.15.60:0/826346805 wait complete. 2023-07-12T02:02:58.564 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' created 2023-07-12T02:02:58.578 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-12T02:02:58.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.708+0000 7feea795b700 1 Processor -- start 2023-07-12T02:02:58.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.708+0000 7feea795b700 1 -- start start 2023-07-12T02:02:58.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.709+0000 7feea795b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7feea00bc810 0x7feea00ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:58.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.709+0000 7feea795b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7feea00b8d90 0x7feea006ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:58.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.709+0000 7feea795b700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea00b8620 con 0x7feea01449d0 2023-07-12T02:02:58.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.709+0000 7feea795b700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feea00b97a0 con 0x7feea00bc810 2023-07-12T02:02:58.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.709+0000 7feea795b700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feea0144da0 con 0x7feea00b8d90 2023-07-12T02:02:58.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.709+0000 7feea4ef6700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7feea00bc810 0x7feea00ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:58.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.709+0000 7feea56f7700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7feea01449d0 0x7feea014db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:38526/0 (socket says 172.21.15.60:38526) 2023-07-12T02:02:58.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.709+0000 7feea56f7700 1 -- 172.21.15.60:0/3111918179 learned_addr learned my addr 172.21.15.60:0/3111918179 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:02:58.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.709+0000 7feea5ef8700 1 --2- 172.21.15.60:0/3111918179 >> v2:172.21.15.79:3300/0 conn(0x7feea00b8d90 0x7feea006ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:58.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.709+0000 7feea4ef6700 1 -- 172.21.15.60:0/3111918179 >> v2:172.21.15.79:3300/0 conn(0x7feea00b8d90 msgr2=0x7feea006ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:58.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.709+0000 7feea4ef6700 1 --2- 172.21.15.60:0/3111918179 >> v2:172.21.15.79:3300/0 conn(0x7feea00b8d90 0x7feea006ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:58.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.709+0000 7feea4ef6700 1 -- 172.21.15.60:0/3111918179 >> v1:172.21.15.60:6789/0 conn(0x7feea01449d0 legacy=0x7feea014db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:58.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.709+0000 7feea4ef6700 1 -- 172.21.15.60:0/3111918179 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea00b8900 con 0x7feea00bc810 2023-07-12T02:02:58.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.709+0000 7fee97fff700 1 -- 172.21.15.60:0/3111918179 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 971075642 0 0) 0x7feea00b8620 con 0x7feea01449d0 2023-07-12T02:02:58.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.709+0000 7feea4ef6700 1 --2- 172.21.15.60:0/3111918179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feea00bc810 0x7feea00ba530 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7feea00be710 tx=0x7fee9c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29843ff02cf2f942 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:58.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.709+0000 7fee97fff700 1 -- 172.21.15.60:0/3111918179 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c011830 con 0x7feea00bc810 2023-07-12T02:02:58.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.710+0000 7fee97fff700 1 -- 172.21.15.60:0/3111918179 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9c011990 con 0x7feea00bc810 2023-07-12T02:02:58.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.710+0000 7fee97fff700 1 -- 172.21.15.60:0/3111918179 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c011d20 con 0x7feea00bc810 2023-07-12T02:02:58.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.710+0000 7feea795b700 1 -- 172.21.15.60:0/3111918179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feea00bc810 msgr2=0x7feea00ba530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:58.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.710+0000 7feea795b700 1 --2- 172.21.15.60:0/3111918179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feea00bc810 0x7feea00ba530 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7feea00be710 tx=0x7fee9c009b20 comp rx=0 tx=0).stop 2023-07-12T02:02:58.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.710+0000 7feea795b700 1 -- 172.21.15.60:0/3111918179 shutdown_connections 2023-07-12T02:02:58.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.710+0000 7feea795b700 1 --2- 172.21.15.60:0/3111918179 >> v2:172.21.15.79:3300/0 conn(0x7feea00b8d90 0x7feea006ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:58.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.710+0000 7feea795b700 1 --2- 172.21.15.60:0/3111918179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feea00bc810 0x7feea00ba530 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:58.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.710+0000 7feea795b700 1 -- 172.21.15.60:0/3111918179 >> 172.21.15.60:0/3111918179 conn(0x7feea00c0860 msgr2=0x7feea00c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:58.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.710+0000 7feea795b700 1 -- 172.21.15.60:0/3111918179 shutdown_connections 2023-07-12T02:02:58.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.710+0000 7feea795b700 1 -- 172.21.15.60:0/3111918179 wait complete. 2023-07-12T02:02:58.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.711+0000 7feea795b700 1 Processor -- start 2023-07-12T02:02:58.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.711+0000 7feea795b700 1 -- start start 2023-07-12T02:02:58.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.712+0000 7feea795b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feea00b8d90 0x7feea00b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:58.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.712+0000 7feea795b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feea00bc810 0x7feea01466b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:58.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.712+0000 7feea795b700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feea01449d0 0x7feea014d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:58.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.712+0000 7feea795b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea014d770 con 0x7feea00bc810 2023-07-12T02:02:58.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.712+0000 7feea795b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea00b4030 con 0x7feea00b8d90 2023-07-12T02:02:58.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.712+0000 7feea795b700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea01456e0 con 0x7feea01449d0 2023-07-12T02:02:58.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.712+0000 7feea4ef6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feea00bc810 0x7feea01466b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:58.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.712+0000 7feea4ef6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feea00bc810 0x7feea01466b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59606/0 (socket says 172.21.15.60:59606) 2023-07-12T02:02:58.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.712+0000 7feea4ef6700 1 -- 172.21.15.60:0/3719061276 learned_addr learned my addr 172.21.15.60:0/3719061276 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:58.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.712+0000 7feea56f7700 1 --2- 172.21.15.60:0/3719061276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feea00b8d90 0x7feea00b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:58.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.712+0000 7feea5ef8700 1 --2- 172.21.15.60:0/3719061276 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feea01449d0 0x7feea014d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:58.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.712+0000 7feea4ef6700 1 -- 172.21.15.60:0/3719061276 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feea01449d0 msgr2=0x7feea014d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:58.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.712+0000 7feea4ef6700 1 --2- 172.21.15.60:0/3719061276 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feea01449d0 0x7feea014d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:58.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.712+0000 7feea4ef6700 1 -- 172.21.15.60:0/3719061276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feea00b8d90 msgr2=0x7feea00b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:58.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.712+0000 7feea4ef6700 1 --2- 172.21.15.60:0/3719061276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feea00b8d90 0x7feea00b24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:58.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.712+0000 7feea4ef6700 1 -- 172.21.15.60:0/3719061276 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee9c0094a0 con 0x7feea00bc810 2023-07-12T02:02:58.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.712+0000 7feea5ef8700 1 --2- 172.21.15.60:0/3719061276 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feea01449d0 0x7feea014d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:58.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.712+0000 7feea56f7700 1 --2- 172.21.15.60:0/3719061276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feea00b8d90 0x7feea00b24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:02:58.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.713+0000 7feea4ef6700 1 --2- 172.21.15.60:0/3719061276 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feea00bc810 0x7feea01466b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fee9c000c00 tx=0x7fee9c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:58.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.713+0000 7fee95ffb700 1 -- 172.21.15.60:0/3719061276 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c0036a0 con 0x7feea00bc810 2023-07-12T02:02:58.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.713+0000 7fee95ffb700 1 -- 172.21.15.60:0/3719061276 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9c01f070 con 0x7feea00bc810 2023-07-12T02:02:58.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.713+0000 7feea795b700 1 -- 172.21.15.60:0/3719061276 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feea01459c0 con 0x7feea00bc810 2023-07-12T02:02:58.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.713+0000 7fee95ffb700 1 -- 172.21.15.60:0/3719061276 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c003a60 con 0x7feea00bc810 2023-07-12T02:02:58.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.713+0000 7feea795b700 1 -- 172.21.15.60:0/3719061276 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea0146190 con 0x7feea00bc810 2023-07-12T02:02:58.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.714+0000 7feea795b700 1 -- 172.21.15.60:0/3719061276 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feea0146380 con 0x7feea00bc810 2023-07-12T02:02:58.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.714+0000 7fee95ffb700 1 -- 172.21.15.60:0/3719061276 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fee9c003bc0 con 0x7feea00bc810 2023-07-12T02:02:58.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.715+0000 7fee95ffb700 1 --2- 172.21.15.60:0/3719061276 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fee8406ace0 0x7fee8406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:58.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.715+0000 7fee95ffb700 1 -- 172.21.15.60:0/3719061276 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fee9c021070 con 0x7feea00bc810 2023-07-12T02:02:58.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.715+0000 7feea56f7700 1 --2- 172.21.15.60:0/3719061276 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fee8406ace0 0x7fee8406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:58.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.716+0000 7feea56f7700 1 --2- 172.21.15.60:0/3719061276 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fee8406ace0 0x7fee8406d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fee90000f60 tx=0x7fee90007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:58.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.720+0000 7fee95ffb700 1 -- 172.21.15.60:0/3719061276 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fee9c055f90 con 0x7feea00bc810 2023-07-12T02:02:58.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:58.959+0000 7feea795b700 1 -- 172.21.15.60:0/3719061276 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7feea0074360 con 0x7feea00bc810 2023-07-12T02:02:59.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.763+0000 7fee95ffb700 1 -- 172.21.15.60:0/3719061276 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7fee9c0150c0 con 0x7feea00bc810 2023-07-12T02:02:59.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.769+0000 7feea795b700 1 -- 172.21.15.60:0/3719061276 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fee8406ace0 msgr2=0x7fee8406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:59.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.769+0000 7feea795b700 1 --2- 172.21.15.60:0/3719061276 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fee8406ace0 0x7fee8406d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fee90000f60 tx=0x7fee90007d30 comp rx=0 tx=0).stop 2023-07-12T02:02:59.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.769+0000 7feea795b700 1 -- 172.21.15.60:0/3719061276 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feea00bc810 msgr2=0x7feea01466b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:59.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.769+0000 7feea795b700 1 --2- 172.21.15.60:0/3719061276 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feea00bc810 0x7feea01466b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fee9c000c00 tx=0x7fee9c004750 comp rx=0 tx=0).stop 2023-07-12T02:02:59.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.769+0000 7feea795b700 1 -- 172.21.15.60:0/3719061276 shutdown_connections 2023-07-12T02:02:59.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.769+0000 7feea795b700 1 --2- 172.21.15.60:0/3719061276 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fee8406ace0 0x7fee8406d190 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:59.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.769+0000 7feea795b700 1 --2- 172.21.15.60:0/3719061276 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feea01449d0 0x7feea014d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:59.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.769+0000 7feea795b700 1 --2- 172.21.15.60:0/3719061276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feea00b8d90 0x7feea00b24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:59.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.769+0000 7feea795b700 1 --2- 172.21.15.60:0/3719061276 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feea00bc810 0x7feea01466b0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:59.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.769+0000 7feea795b700 1 -- 172.21.15.60:0/3719061276 >> 172.21.15.60:0/3719061276 conn(0x7feea00c0860 msgr2=0x7feea0143ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:59.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.770+0000 7feea795b700 1 -- 172.21.15.60:0/3719061276 shutdown_connections 2023-07-12T02:02:59.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.770+0000 7feea795b700 1 -- 172.21.15.60:0/3719061276 wait complete. 2023-07-12T02:02:59.776 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 5 and data pool 6 2023-07-12T02:02:59.791 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:02:59.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.921+0000 7fdbddfbf700 1 Processor -- start 2023-07-12T02:02:59.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.921+0000 7fdbddfbf700 1 -- start start 2023-07-12T02:02:59.926 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.922+0000 7fdbddfbf700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdbd8071910 0x7fdbd8070d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:59.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.922+0000 7fdbddfbf700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdbd814b510 0x7fdbd806bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:59.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.922+0000 7fdbddfbf700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbd806c220 con 0x7fdbd806c770 2023-07-12T02:02:59.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.922+0000 7fdbddfbf700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbd80701a0 con 0x7fdbd8071910 2023-07-12T02:02:59.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.922+0000 7fdbddfbf700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd814b940 con 0x7fdbd814b510 2023-07-12T02:02:59.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.922+0000 7fdbd77fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdbd8071910 0x7fdbd8070d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:59.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.922+0000 7fdbd77fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdbd8071910 0x7fdbd8070d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59608/0 (socket says 172.21.15.60:59608) 2023-07-12T02:02:59.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.922+0000 7fdbd77fe700 1 -- 172.21.15.60:0/984241511 learned_addr learned my addr 172.21.15.60:0/984241511 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:59.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.922+0000 7fdbd6ffd700 1 --2- 172.21.15.60:0/984241511 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdbd814b510 0x7fdbd806bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:59.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.922+0000 7fdbd77fe700 1 -- 172.21.15.60:0/984241511 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdbd814b510 msgr2=0x7fdbd806bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:59.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.922+0000 7fdbd77fe700 1 --2- 172.21.15.60:0/984241511 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdbd814b510 0x7fdbd806bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:59.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.922+0000 7fdbd77fe700 1 -- 172.21.15.60:0/984241511 >> v1:172.21.15.79:6789/0 conn(0x7fdbd806c770 legacy=0x7fdbd814df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:02:59.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.922+0000 7fdbd77fe700 1 -- 172.21.15.60:0/984241511 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd80713d0 con 0x7fdbd8071910 2023-07-12T02:02:59.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.922+0000 7fdbd6ffd700 1 --2- 172.21.15.60:0/984241511 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdbd814b510 0x7fdbd806bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:02:59.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.922+0000 7fdbd77fe700 1 --2- 172.21.15.60:0/984241511 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbd8071910 0x7fdbd8070d80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fdbc00098f0 tx=0x7fdbc0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90cd6b0c792ab730 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:59.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.922+0000 7fdbd67fc700 1 -- 172.21.15.60:0/984241511 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc0004230 con 0x7fdbd8071910 2023-07-12T02:02:59.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.922+0000 7fdbd67fc700 1 -- 172.21.15.60:0/984241511 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc0004390 con 0x7fdbd8071910 2023-07-12T02:02:59.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.922+0000 7fdbd67fc700 1 -- 172.21.15.60:0/984241511 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc00036a0 con 0x7fdbd8071910 2023-07-12T02:02:59.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.923+0000 7fdbddfbf700 1 -- 172.21.15.60:0/984241511 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbd8071910 msgr2=0x7fdbd8070d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:59.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.923+0000 7fdbddfbf700 1 --2- 172.21.15.60:0/984241511 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbd8071910 0x7fdbd8070d80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fdbc00098f0 tx=0x7fdbc0009c00 comp rx=0 tx=0).stop 2023-07-12T02:02:59.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.923+0000 7fdbddfbf700 1 -- 172.21.15.60:0/984241511 shutdown_connections 2023-07-12T02:02:59.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.923+0000 7fdbddfbf700 1 --2- 172.21.15.60:0/984241511 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbd8071910 0x7fdbd8070d80 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:59.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.923+0000 7fdbddfbf700 1 --2- 172.21.15.60:0/984241511 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdbd814b510 0x7fdbd806bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:59.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.923+0000 7fdbddfbf700 1 -- 172.21.15.60:0/984241511 >> 172.21.15.60:0/984241511 conn(0x7fdbd80be670 msgr2=0x7fdbd80bea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:02:59.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.923+0000 7fdbddfbf700 1 -- 172.21.15.60:0/984241511 shutdown_connections 2023-07-12T02:02:59.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.923+0000 7fdbddfbf700 1 -- 172.21.15.60:0/984241511 wait complete. 2023-07-12T02:02:59.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.924+0000 7fdbddfbf700 1 Processor -- start 2023-07-12T02:02:59.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.924+0000 7fdbddfbf700 1 -- start start 2023-07-12T02:02:59.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.925+0000 7fdbddfbf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbd806c770 0x7fdbd80b65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:59.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.925+0000 7fdbddfbf700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdbd8071910 0x7fdbd80b7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:59.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.925+0000 7fdbddfbf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdbd814b510 0x7fdbd8145e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:59.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.925+0000 7fdbddfbf700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd80b7550 con 0x7fdbd806c770 2023-07-12T02:02:59.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.925+0000 7fdbddfbf700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd80b8200 con 0x7fdbd814b510 2023-07-12T02:02:59.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.925+0000 7fdbddfbf700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd80b6bb0 con 0x7fdbd8071910 2023-07-12T02:02:59.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.925+0000 7fdbd77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbd806c770 0x7fdbd80b65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:59.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.925+0000 7fdbd77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbd806c770 0x7fdbd80b65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59616/0 (socket says 172.21.15.60:59616) 2023-07-12T02:02:59.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.925+0000 7fdbd77fe700 1 -- 172.21.15.60:0/3276352885 learned_addr learned my addr 172.21.15.60:0/3276352885 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:02:59.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.925+0000 7fdbd6ffd700 1 --2- 172.21.15.60:0/3276352885 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdbd8071910 0x7fdbd80b7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:59.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.925+0000 7fdbd7fff700 1 --2- 172.21.15.60:0/3276352885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdbd814b510 0x7fdbd8145e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:59.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.925+0000 7fdbd77fe700 1 -- 172.21.15.60:0/3276352885 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdbd8071910 msgr2=0x7fdbd80b7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:59.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.925+0000 7fdbd77fe700 1 --2- 172.21.15.60:0/3276352885 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdbd8071910 0x7fdbd80b7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:59.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.925+0000 7fdbd77fe700 1 -- 172.21.15.60:0/3276352885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdbd814b510 msgr2=0x7fdbd8145e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:02:59.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.925+0000 7fdbd77fe700 1 --2- 172.21.15.60:0/3276352885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdbd814b510 0x7fdbd8145e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:02:59.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.925+0000 7fdbd77fe700 1 -- 172.21.15.60:0/3276352885 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc0009550 con 0x7fdbd806c770 2023-07-12T02:02:59.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.926+0000 7fdbd77fe700 1 --2- 172.21.15.60:0/3276352885 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbd806c770 0x7fdbd80b65b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fdbc0009130 tx=0x7fdbc0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:59.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.926+0000 7fdbcffff700 1 -- 172.21.15.60:0/3276352885 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc0003cd0 con 0x7fdbd806c770 2023-07-12T02:02:59.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.926+0000 7fdbcffff700 1 -- 172.21.15.60:0/3276352885 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc001f070 con 0x7fdbd806c770 2023-07-12T02:02:59.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.926+0000 7fdbddfbf700 1 -- 172.21.15.60:0/3276352885 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbd80b6e90 con 0x7fdbd806c770 2023-07-12T02:02:59.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.926+0000 7fdbcffff700 1 -- 172.21.15.60:0/3276352885 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc000b8a0 con 0x7fdbd806c770 2023-07-12T02:02:59.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.926+0000 7fdbddfbf700 1 -- 172.21.15.60:0/3276352885 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbd80b8800 con 0x7fdbd806c770 2023-07-12T02:02:59.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.927+0000 7fdbddfbf700 1 -- 172.21.15.60:0/3276352885 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbd80672b0 con 0x7fdbd806c770 2023-07-12T02:02:59.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.927+0000 7fdbcffff700 1 -- 172.21.15.60:0/3276352885 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdbc0021030 con 0x7fdbd806c770 2023-07-12T02:02:59.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.928+0000 7fdbcffff700 1 --2- 172.21.15.60:0/3276352885 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fdbb806ace0 0x7fdbb806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:02:59.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.928+0000 7fdbcffff700 1 -- 172.21.15.60:0/3276352885 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdbc008aa20 con 0x7fdbd806c770 2023-07-12T02:02:59.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.928+0000 7fdbd6ffd700 1 --2- 172.21.15.60:0/3276352885 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fdbb806ace0 0x7fdbb806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:02:59.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.929+0000 7fdbd6ffd700 1 --2- 172.21.15.60:0/3276352885 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fdbb806ace0 0x7fdbb806d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8146c90 tx=0x7fdbc8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:02:59.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:02:59.932+0000 7fdbcffff700 1 -- 172.21.15.60:0/3276352885 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fdbc0055ad0 con 0x7fdbd806c770 2023-07-12T02:03:00.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.128+0000 7fdbddfbf700 1 -- 172.21.15.60:0/3276352885 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdbd80672b0 con 0x7fdbd806c770 2023-07-12T02:03:00.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.129+0000 7fdbcffff700 1 -- 172.21.15.60:0/3276352885 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+18258 (secure 0 0 0) 0x7fdbc00590f0 con 0x7fdbd806c770 2023-07-12T02:03:00.133 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:03:00.134 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":30,"fsid":"97e7c909-e567-472e-a5aa-72fde15171f2","created":"2023-07-12T02:01:53.987086+0000","modified":"2023-07-12T02:02:58.961094+0000","last_up_change":"2023-07-12T02:02:04.031780+0000","last_in_change":"2023-07-12T02:01:56.538621+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-12T02:02:05.375042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-12T02:02:05.857441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:02:57.318080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-12T02:02:57.932207+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ed8b71c2-3895-4952-a118-16ede0b4a98c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6801","nonce":2818935979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6803","nonce":2818935979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6807","nonce":2818935979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6805","nonce":2818935979}]},"public_addr":"172.21.15.60:6801/2818935979","cluster_addr":"172.21.15.60:6803/2818935979","heartbeat_back_addr":"172.21.15.60:6807/2818935979","heartbeat_front_addr":"172.21.15.60:6805/2818935979","state":["exists","up"]},{"osd":1,"uuid":"7cf4d354-78e0-43ce-8c09-4a7d2a0b57a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6817","nonce":1678864191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6819","nonce":1678864191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6823","nonce":1678864191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6821","nonce":1678864191}]},"public_addr":"172.21.15.60:6817/1678864191","cluster_addr":"172.21.15.60:6819/1678864191","heartbeat_back_addr":"172.21.15.60:6823/1678864191","heartbeat_front_addr":"172.21.15.60:6821/1678864191","state":["exists","up"]},{"osd":2,"uuid":"02c958b8-9599-4470-92cb-8f7018ec0189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6809","nonce":1459480680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6811","nonce":1459480680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6815","nonce":1459480680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6813","nonce":1459480680}]},"public_addr":"172.21.15.60:6809/1459480680","cluster_addr":"172.21.15.60:6811/1459480680","heartbeat_back_addr":"172.21.15.60:6815/1459480680","heartbeat_front_addr":"172.21.15.60:6813/1459480680","state":["exists","up"]},{"osd":3,"uuid":"bc300432-a228-4257-be5c-e42dd5f2015f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6825","nonce":3295100060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6827","nonce":3295100060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6831","nonce":3295100060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6829","nonce":3295100060}]},"public_addr":"172.21.15.60:6825/3295100060","cluster_addr":"172.21.15.60:6827/3295100060","heartbeat_back_addr":"172.21.15.60:6831/3295100060","heartbeat_front_addr":"172.21.15.60:6829/3295100060","state":["exists","up"]},{"osd":4,"uuid":"ad9f7dc4-7126-466d-a656-2844880c6060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6809","nonce":4127109138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6811","nonce":4127109138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6815","nonce":4127109138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6813","nonce":4127109138}]},"public_addr":"172.21.15.79:6809/4127109138","cluster_addr":"172.21.15.79:6811/4127109138","heartbeat_back_addr":"172.21.15.79:6815/4127109138","heartbeat_front_addr":"172.21.15.79:6813/4127109138","state":["exists","up"]},{"osd":5,"uuid":"e88d16ca-0b01-4ab9-8aa8-c4aff7f210f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6801","nonce":421449406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6803","nonce":421449406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6807","nonce":421449406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6805","nonce":421449406}]},"public_addr":"172.21.15.79:6801/421449406","cluster_addr":"172.21.15.79:6803/421449406","heartbeat_back_addr":"172.21.15.79:6807/421449406","heartbeat_front_addr":"172.21.15.79:6805/421449406","state":["exists","up"]},{"osd":6,"uuid":"6898cb84-56d1-48a9-bd45-97e4668e2fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6825","nonce":4144355139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6827","nonce":4144355139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6831","nonce":4144355139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6829","nonce":4144355139}]},"public_addr":"172.21.15.79:6825/4144355139","cluster_addr":"172.21.15.79:6827/4144355139","heartbeat_back_addr":"172.21.15.79:6831/4144355139","heartbeat_front_addr":"172.21.15.79:6829/4144355139","state":["exists","up"]},{"osd":7,"uuid":"65c10882-371e-4762-b384-9c3a48f332ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6817","nonce":2845223299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6819","nonce":2845223299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6823","nonce":2845223299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6821","nonce":2845223299}]},"public_addr":"172.21.15.79:6817/2845223299","cluster_addr":"172.21.15.79:6819/2845223299","heartbeat_back_addr":"172.21.15.79:6823/2845223299","heartbeat_front_addr":"172.21.15.79:6821/2845223299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.634716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.758349+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.728366+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.777395+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707262+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.649705+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.693021+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:03:00.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.131+0000 7fdbddfbf700 1 -- 172.21.15.60:0/3276352885 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fdbb806ace0 msgr2=0x7fdbb806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:00.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.131+0000 7fdbddfbf700 1 --2- 172.21.15.60:0/3276352885 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fdbb806ace0 0x7fdbb806d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8146c90 tx=0x7fdbc8008040 comp rx=0 tx=0).stop 2023-07-12T02:03:00.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.131+0000 7fdbddfbf700 1 -- 172.21.15.60:0/3276352885 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbd806c770 msgr2=0x7fdbd80b65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:00.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.131+0000 7fdbddfbf700 1 --2- 172.21.15.60:0/3276352885 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbd806c770 0x7fdbd80b65b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fdbc0009130 tx=0x7fdbc0004750 comp rx=0 tx=0).stop 2023-07-12T02:03:00.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.131+0000 7fdbddfbf700 1 -- 172.21.15.60:0/3276352885 shutdown_connections 2023-07-12T02:03:00.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.131+0000 7fdbddfbf700 1 --2- 172.21.15.60:0/3276352885 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fdbb806ace0 0x7fdbb806d190 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:00.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.131+0000 7fdbddfbf700 1 --2- 172.21.15.60:0/3276352885 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbd806c770 0x7fdbd80b65b0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:00.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.131+0000 7fdbddfbf700 1 --2- 172.21.15.60:0/3276352885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdbd814b510 0x7fdbd8145e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:00.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.131+0000 7fdbddfbf700 1 --2- 172.21.15.60:0/3276352885 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdbd8071910 0x7fdbd80b7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:00.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.131+0000 7fdbddfbf700 1 -- 172.21.15.60:0/3276352885 >> 172.21.15.60:0/3276352885 conn(0x7fdbd80be670 msgr2=0x7fdbd8149570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:00.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.131+0000 7fdbddfbf700 1 -- 172.21.15.60:0/3276352885 shutdown_connections 2023-07-12T02:03:00.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.131+0000 7fdbddfbf700 1 -- 172.21.15.60:0/3276352885 wait complete. 2023-07-12T02:03:00.147 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:03:00.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.268+0000 7f0ffdafa700 1 Processor -- start 2023-07-12T02:03:00.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.268+0000 7f0ffdafa700 1 -- start start 2023-07-12T02:03:00.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.269+0000 7f0ffdafa700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0ff8147dc0 0x7f0ff80721e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:00.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.269+0000 7f0ffdafa700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0ff8069f30 0x7f0ff8071130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:00.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.269+0000 7f0ffdafa700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ff806f680 con 0x7f0ff806a3b0 2023-07-12T02:03:00.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.269+0000 7f0ffdafa700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff8070950 con 0x7f0ff8147dc0 2023-07-12T02:03:00.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.269+0000 7f0ffdafa700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff806f920 con 0x7f0ff8069f30 2023-07-12T02:03:00.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.269+0000 7f0ff77fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0ff8147dc0 0x7f0ff80721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:00.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.269+0000 7f0ff7fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f0ff806a3b0 0x7f0ff814dc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:38528/0 (socket says 172.21.15.60:38528) 2023-07-12T02:03:00.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.269+0000 7f0ff7fff700 1 -- 172.21.15.60:0/2257481728 learned_addr learned my addr 172.21.15.60:0/2257481728 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:03:00.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.269+0000 7f0ff6ffd700 1 --2- 172.21.15.60:0/2257481728 >> v2:172.21.15.79:3300/0 conn(0x7f0ff8069f30 0x7f0ff8071130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:00.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.269+0000 7f0ff77fe700 1 -- 172.21.15.60:0/2257481728 >> v2:172.21.15.79:3300/0 conn(0x7f0ff8069f30 msgr2=0x7f0ff8071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:00.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.269+0000 7f0ff77fe700 1 --2- 172.21.15.60:0/2257481728 >> v2:172.21.15.79:3300/0 conn(0x7f0ff8069f30 0x7f0ff8071130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:00.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.270+0000 7f0ff77fe700 1 -- 172.21.15.60:0/2257481728 >> v1:172.21.15.60:6789/0 conn(0x7f0ff806a3b0 legacy=0x7f0ff814dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:00.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.270+0000 7f0ff77fe700 1 -- 172.21.15.60:0/2257481728 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff80b9660 con 0x7f0ff8147dc0 2023-07-12T02:03:00.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.270+0000 7f0ff67fc700 1 -- 172.21.15.60:0/2257481728 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1668384055 0 0) 0x7f0ff806f680 con 0x7f0ff806a3b0 2023-07-12T02:03:00.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.270+0000 7f0ff77fe700 1 --2- 172.21.15.60:0/2257481728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ff8147dc0 0x7f0ff80721e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0ff806f090 tx=0x7f0fe8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2d1d44e104e0d29 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:00.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.270+0000 7f0ff67fc700 1 -- 172.21.15.60:0/2257481728 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe8011830 con 0x7f0ff8147dc0 2023-07-12T02:03:00.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.270+0000 7f0ff67fc700 1 -- 172.21.15.60:0/2257481728 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe8011990 con 0x7f0ff8147dc0 2023-07-12T02:03:00.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.270+0000 7f0ff67fc700 1 -- 172.21.15.60:0/2257481728 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe8011d20 con 0x7f0ff8147dc0 2023-07-12T02:03:00.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.270+0000 7f0ffdafa700 1 -- 172.21.15.60:0/2257481728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ff8147dc0 msgr2=0x7f0ff80721e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:00.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.270+0000 7f0ffdafa700 1 --2- 172.21.15.60:0/2257481728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ff8147dc0 0x7f0ff80721e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0ff806f090 tx=0x7f0fe8009b20 comp rx=0 tx=0).stop 2023-07-12T02:03:00.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.270+0000 7f0ffdafa700 1 -- 172.21.15.60:0/2257481728 shutdown_connections 2023-07-12T02:03:00.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.270+0000 7f0ffdafa700 1 --2- 172.21.15.60:0/2257481728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ff8147dc0 0x7f0ff80721e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:00.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.270+0000 7f0ffdafa700 1 --2- 172.21.15.60:0/2257481728 >> v2:172.21.15.79:3300/0 conn(0x7f0ff8069f30 0x7f0ff8071130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:00.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.270+0000 7f0ffdafa700 1 -- 172.21.15.60:0/2257481728 >> 172.21.15.60:0/2257481728 conn(0x7f0ff806d0e0 msgr2=0x7f0ff806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:00.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.270+0000 7f0ffdafa700 1 -- 172.21.15.60:0/2257481728 shutdown_connections 2023-07-12T02:03:00.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.270+0000 7f0ffdafa700 1 -- 172.21.15.60:0/2257481728 wait complete. 2023-07-12T02:03:00.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.271+0000 7f0ffdafa700 1 Processor -- start 2023-07-12T02:03:00.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.272+0000 7f0ffdafa700 1 -- start start 2023-07-12T02:03:00.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.272+0000 7f0ffdafa700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ff8069f30 0x7f0ff80b6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:00.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.272+0000 7f0ffdafa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ff806a3b0 0x7f0ff81dfe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:00.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.272+0000 7f0ffdafa700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0ff8147dc0 0x7f0ff81e03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:00.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.272+0000 7f0ffdafa700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff80b6890 con 0x7f0ff806a3b0 2023-07-12T02:03:00.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.272+0000 7f0ffdafa700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff814d040 con 0x7f0ff8069f30 2023-07-12T02:03:00.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.272+0000 7f0ffdafa700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff814d380 con 0x7f0ff8147dc0 2023-07-12T02:03:00.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.272+0000 7f0ff6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ff806a3b0 0x7f0ff81dfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:00.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.272+0000 7f0ff6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ff806a3b0 0x7f0ff81dfe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59636/0 (socket says 172.21.15.60:59636) 2023-07-12T02:03:00.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.272+0000 7f0ff6ffd700 1 -- 172.21.15.60:0/2508313305 learned_addr learned my addr 172.21.15.60:0/2508313305 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:03:00.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.273+0000 7f0ff77fe700 1 --2- 172.21.15.60:0/2508313305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ff8069f30 0x7f0ff80b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:00.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.273+0000 7f0ff7fff700 1 --2- 172.21.15.60:0/2508313305 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0ff8147dc0 0x7f0ff81e03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:00.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.273+0000 7f0ff6ffd700 1 -- 172.21.15.60:0/2508313305 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0ff8147dc0 msgr2=0x7f0ff81e03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:00.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.273+0000 7f0ff6ffd700 1 --2- 172.21.15.60:0/2508313305 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0ff8147dc0 0x7f0ff81e03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:00.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.273+0000 7f0ff6ffd700 1 -- 172.21.15.60:0/2508313305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ff8069f30 msgr2=0x7f0ff80b6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:00.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.273+0000 7f0ff6ffd700 1 --2- 172.21.15.60:0/2508313305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ff8069f30 0x7f0ff80b6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:00.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.273+0000 7f0ff6ffd700 1 -- 172.21.15.60:0/2508313305 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe80094a0 con 0x7f0ff806a3b0 2023-07-12T02:03:00.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.273+0000 7f0ff6ffd700 1 --2- 172.21.15.60:0/2508313305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ff806a3b0 0x7f0ff81dfe60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0fe000e840 tx=0x7f0fe000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:00.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.273+0000 7f0feffff700 1 -- 172.21.15.60:0/2508313305 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe0013610 con 0x7f0ff806a3b0 2023-07-12T02:03:00.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.273+0000 7f0feffff700 1 -- 172.21.15.60:0/2508313305 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe0013770 con 0x7f0ff806a3b0 2023-07-12T02:03:00.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.273+0000 7f0ffdafa700 1 -- 172.21.15.60:0/2508313305 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff8149830 con 0x7f0ff806a3b0 2023-07-12T02:03:00.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.273+0000 7f0feffff700 1 -- 172.21.15.60:0/2508313305 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe0013b20 con 0x7f0ff806a3b0 2023-07-12T02:03:00.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.273+0000 7f0ffdafa700 1 -- 172.21.15.60:0/2508313305 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff814cd60 con 0x7f0ff806a3b0 2023-07-12T02:03:00.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.274+0000 7f0ffdafa700 1 -- 172.21.15.60:0/2508313305 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ff814d1e0 con 0x7f0ff806a3b0 2023-07-12T02:03:00.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.275+0000 7f0feffff700 1 -- 172.21.15.60:0/2508313305 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0fe0013c80 con 0x7f0ff806a3b0 2023-07-12T02:03:00.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.275+0000 7f0feffff700 1 --2- 172.21.15.60:0/2508313305 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f0fd806ace0 0x7f0fd806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:00.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.275+0000 7f0feffff700 1 -- 172.21.15.60:0/2508313305 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0fe0088f50 con 0x7f0ff806a3b0 2023-07-12T02:03:00.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.275+0000 7f0ff77fe700 1 --2- 172.21.15.60:0/2508313305 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f0fd806ace0 0x7f0fd806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:00.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.276+0000 7f0ff77fe700 1 --2- 172.21.15.60:0/2508313305 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f0fd806ace0 0x7f0fd806d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0fe80090b0 tx=0x7f0fe801c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:00.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.279+0000 7f0feffff700 1 -- 172.21.15.60:0/2508313305 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f0ff814d1e0 con 0x7f0ff806a3b0 2023-07-12T02:03:00.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.478+0000 7f0ffdafa700 1 -- 172.21.15.60:0/2508313305 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ff814d1e0 con 0x7f0ff806a3b0 2023-07-12T02:03:00.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.479+0000 7f0feffff700 1 -- 172.21.15.60:0/2508313305 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+18258 (secure 0 0 0) 0x7f0ff814d1e0 con 0x7f0ff806a3b0 2023-07-12T02:03:00.484 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:03:00.484 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":30,"fsid":"97e7c909-e567-472e-a5aa-72fde15171f2","created":"2023-07-12T02:01:53.987086+0000","modified":"2023-07-12T02:02:58.961094+0000","last_up_change":"2023-07-12T02:02:04.031780+0000","last_in_change":"2023-07-12T02:01:56.538621+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-12T02:02:05.375042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-12T02:02:05.857441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:02:57.318080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-12T02:02:57.932207+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ed8b71c2-3895-4952-a118-16ede0b4a98c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6801","nonce":2818935979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6803","nonce":2818935979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6807","nonce":2818935979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6805","nonce":2818935979}]},"public_addr":"172.21.15.60:6801/2818935979","cluster_addr":"172.21.15.60:6803/2818935979","heartbeat_back_addr":"172.21.15.60:6807/2818935979","heartbeat_front_addr":"172.21.15.60:6805/2818935979","state":["exists","up"]},{"osd":1,"uuid":"7cf4d354-78e0-43ce-8c09-4a7d2a0b57a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6817","nonce":1678864191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6819","nonce":1678864191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6823","nonce":1678864191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6821","nonce":1678864191}]},"public_addr":"172.21.15.60:6817/1678864191","cluster_addr":"172.21.15.60:6819/1678864191","heartbeat_back_addr":"172.21.15.60:6823/1678864191","heartbeat_front_addr":"172.21.15.60:6821/1678864191","state":["exists","up"]},{"osd":2,"uuid":"02c958b8-9599-4470-92cb-8f7018ec0189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6809","nonce":1459480680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6811","nonce":1459480680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6815","nonce":1459480680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6813","nonce":1459480680}]},"public_addr":"172.21.15.60:6809/1459480680","cluster_addr":"172.21.15.60:6811/1459480680","heartbeat_back_addr":"172.21.15.60:6815/1459480680","heartbeat_front_addr":"172.21.15.60:6813/1459480680","state":["exists","up"]},{"osd":3,"uuid":"bc300432-a228-4257-be5c-e42dd5f2015f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6825","nonce":3295100060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6827","nonce":3295100060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6831","nonce":3295100060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6829","nonce":3295100060}]},"public_addr":"172.21.15.60:6825/3295100060","cluster_addr":"172.21.15.60:6827/3295100060","heartbeat_back_addr":"172.21.15.60:6831/3295100060","heartbeat_front_addr":"172.21.15.60:6829/3295100060","state":["exists","up"]},{"osd":4,"uuid":"ad9f7dc4-7126-466d-a656-2844880c6060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6809","nonce":4127109138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6811","nonce":4127109138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6815","nonce":4127109138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6813","nonce":4127109138}]},"public_addr":"172.21.15.79:6809/4127109138","cluster_addr":"172.21.15.79:6811/4127109138","heartbeat_back_addr":"172.21.15.79:6815/4127109138","heartbeat_front_addr":"172.21.15.79:6813/4127109138","state":["exists","up"]},{"osd":5,"uuid":"e88d16ca-0b01-4ab9-8aa8-c4aff7f210f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6801","nonce":421449406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6803","nonce":421449406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6807","nonce":421449406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6805","nonce":421449406}]},"public_addr":"172.21.15.79:6801/421449406","cluster_addr":"172.21.15.79:6803/421449406","heartbeat_back_addr":"172.21.15.79:6807/421449406","heartbeat_front_addr":"172.21.15.79:6805/421449406","state":["exists","up"]},{"osd":6,"uuid":"6898cb84-56d1-48a9-bd45-97e4668e2fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6825","nonce":4144355139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6827","nonce":4144355139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6831","nonce":4144355139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6829","nonce":4144355139}]},"public_addr":"172.21.15.79:6825/4144355139","cluster_addr":"172.21.15.79:6827/4144355139","heartbeat_back_addr":"172.21.15.79:6831/4144355139","heartbeat_front_addr":"172.21.15.79:6829/4144355139","state":["exists","up"]},{"osd":7,"uuid":"65c10882-371e-4762-b384-9c3a48f332ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6817","nonce":2845223299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6819","nonce":2845223299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6823","nonce":2845223299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6821","nonce":2845223299}]},"public_addr":"172.21.15.79:6817/2845223299","cluster_addr":"172.21.15.79:6819/2845223299","heartbeat_back_addr":"172.21.15.79:6823/2845223299","heartbeat_front_addr":"172.21.15.79:6821/2845223299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.634716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.758349+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.728366+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.777395+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707262+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.649705+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.693021+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:03:00.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.481+0000 7f0ffdafa700 1 -- 172.21.15.60:0/2508313305 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f0fd806ace0 msgr2=0x7f0fd806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:00.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.481+0000 7f0ffdafa700 1 --2- 172.21.15.60:0/2508313305 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f0fd806ace0 0x7f0fd806d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0fe80090b0 tx=0x7f0fe801c040 comp rx=0 tx=0).stop 2023-07-12T02:03:00.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.481+0000 7f0ffdafa700 1 -- 172.21.15.60:0/2508313305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ff806a3b0 msgr2=0x7f0ff81dfe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:00.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.481+0000 7f0ffdafa700 1 --2- 172.21.15.60:0/2508313305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ff806a3b0 0x7f0ff81dfe60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0fe000e840 tx=0x7f0fe000eb50 comp rx=0 tx=0).stop 2023-07-12T02:03:00.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.482+0000 7f0ffdafa700 1 -- 172.21.15.60:0/2508313305 shutdown_connections 2023-07-12T02:03:00.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.482+0000 7f0ffdafa700 1 --2- 172.21.15.60:0/2508313305 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f0fd806ace0 0x7f0fd806d190 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:00.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.482+0000 7f0ffdafa700 1 --2- 172.21.15.60:0/2508313305 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0ff8147dc0 0x7f0ff81e03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:00.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.482+0000 7f0ffdafa700 1 --2- 172.21.15.60:0/2508313305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ff8069f30 0x7f0ff80b6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:00.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.482+0000 7f0ffdafa700 1 --2- 172.21.15.60:0/2508313305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ff806a3b0 0x7f0ff81dfe60 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:00.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.482+0000 7f0ffdafa700 1 -- 172.21.15.60:0/2508313305 >> 172.21.15.60:0/2508313305 conn(0x7f0ff806d0e0 msgr2=0x7f0ff8144cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:00.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.482+0000 7f0ffdafa700 1 -- 172.21.15.60:0/2508313305 shutdown_connections 2023-07-12T02:03:00.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.482+0000 7f0ffdafa700 1 -- 172.21.15.60:0/2508313305 wait complete. 2023-07-12T02:03:00.498 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-12T02:03:00.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.623+0000 7fcff7f80700 1 Processor -- start 2023-07-12T02:03:00.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.624+0000 7fcff7f80700 1 -- start start 2023-07-12T02:03:00.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.624+0000 7fcff7f80700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcff01444f0 0x7fcff0144960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:00.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.624+0000 7fcff7f80700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcff00ba3d0 0x7fcff00ba810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:00.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.624+0000 7fcff7f80700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcff00bc6e0 con 0x7fcff00bd490 2023-07-12T02:03:00.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.624+0000 7fcff7f80700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcff00bad50 con 0x7fcff01444f0 2023-07-12T02:03:00.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.624+0000 7fcff7f80700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcff00bc9c0 con 0x7fcff00ba3d0 2023-07-12T02:03:00.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.625+0000 7fcff651d700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcff00ba3d0 0x7fcff00ba810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:00.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.625+0000 7fcff551b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcff01444f0 0x7fcff0144960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:00.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.625+0000 7fcff651d700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcff00ba3d0 0x7fcff00ba810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.60:56770/0 (socket says 172.21.15.60:56770) 2023-07-12T02:03:00.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.625+0000 7fcff651d700 1 -- 172.21.15.60:0/3814951333 learned_addr learned my addr 172.21.15.60:0/3814951333 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:03:00.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.625+0000 7fcff5d1c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fcff00bd490 0x7fcff00b86c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.60:37864/0 (socket says 172.21.15.60:37864) 2023-07-12T02:03:00.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.625+0000 7fcff551b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcff01444f0 0x7fcff0144960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.60:59374/0 (socket says 172.21.15.60:59374) 2023-07-12T02:03:00.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.625+0000 7fcff651d700 1 -- 172.21.15.60:0/3814951333 >> v2:172.21.15.79:3300/0 conn(0x7fcff01444f0 msgr2=0x7fcff0144960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:00.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.625+0000 7fcff651d700 1 --2- 172.21.15.60:0/3814951333 >> v2:172.21.15.79:3300/0 conn(0x7fcff01444f0 0x7fcff0144960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:00.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.625+0000 7fcff651d700 1 -- 172.21.15.60:0/3814951333 >> v1:172.21.15.79:6789/0 conn(0x7fcff00bd490 legacy=0x7fcff00b86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:00.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.625+0000 7fcff651d700 1 -- 172.21.15.60:0/3814951333 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff00bcca0 con 0x7fcff00ba3d0 2023-07-12T02:03:00.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.625+0000 7fcff651d700 1 --2- 172.21.15.60:0/3814951333 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcff00ba3d0 0x7fcff00ba810 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8009e50 tx=0x7fcfe800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=601aafad6f9df9d4 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:00.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.625+0000 7fcff4d1a700 1 -- 172.21.15.60:0/3814951333 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe800e070 con 0x7fcff00ba3d0 2023-07-12T02:03:00.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.625+0000 7fcff4d1a700 1 -- 172.21.15.60:0/3814951333 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe800b910 con 0x7fcff00ba3d0 2023-07-12T02:03:00.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.625+0000 7fcff4d1a700 1 -- 172.21.15.60:0/3814951333 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe800bcc0 con 0x7fcff00ba3d0 2023-07-12T02:03:00.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.626+0000 7fcff7f80700 1 -- 172.21.15.60:0/3814951333 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcff00ba3d0 msgr2=0x7fcff00ba810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:00.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.626+0000 7fcff7f80700 1 --2- 172.21.15.60:0/3814951333 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcff00ba3d0 0x7fcff00ba810 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8009e50 tx=0x7fcfe800b330 comp rx=0 tx=0).stop 2023-07-12T02:03:00.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.626+0000 7fcff7f80700 1 -- 172.21.15.60:0/3814951333 shutdown_connections 2023-07-12T02:03:00.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.626+0000 7fcff7f80700 1 --2- 172.21.15.60:0/3814951333 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcff00ba3d0 0x7fcff00ba810 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:00.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.626+0000 7fcff7f80700 1 --2- 172.21.15.60:0/3814951333 >> v2:172.21.15.79:3300/0 conn(0x7fcff01444f0 0x7fcff0144960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:00.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.626+0000 7fcff7f80700 1 -- 172.21.15.60:0/3814951333 >> 172.21.15.60:0/3814951333 conn(0x7fcff006aef0 msgr2=0x7fcff006b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:00.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.626+0000 7fcff7f80700 1 -- 172.21.15.60:0/3814951333 shutdown_connections 2023-07-12T02:03:00.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.626+0000 7fcff7f80700 1 -- 172.21.15.60:0/3814951333 wait complete. 2023-07-12T02:03:00.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.627+0000 7fcff7f80700 1 Processor -- start 2023-07-12T02:03:00.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.627+0000 7fcff7f80700 1 -- start start 2023-07-12T02:03:00.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.628+0000 7fcff7f80700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcff00ba3d0 0x7fcff01476a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:00.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.628+0000 7fcff7f80700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcff00bd490 0x7fcff01e35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:00.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.628+0000 7fcff7f80700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcff01444f0 0x7fcff01d3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:00.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.628+0000 7fcff7f80700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff0146d70 con 0x7fcff01444f0 2023-07-12T02:03:00.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.628+0000 7fcff7f80700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff01d6490 con 0x7fcff00ba3d0 2023-07-12T02:03:00.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.628+0000 7fcff7f80700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcff01d66e0 con 0x7fcff00bd490 2023-07-12T02:03:00.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.628+0000 7fcff651d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcff01444f0 0x7fcff01d3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:00.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.628+0000 7fcff651d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcff01444f0 0x7fcff01d3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59642/0 (socket says 172.21.15.60:59642) 2023-07-12T02:03:00.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.628+0000 7fcff651d700 1 -- 172.21.15.60:0/887369212 learned_addr learned my addr 172.21.15.60:0/887369212 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:03:00.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.628+0000 7fcff551b700 1 --2- 172.21.15.60:0/887369212 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcff00bd490 0x7fcff01e35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:00.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.628+0000 7fcff5d1c700 1 --2- 172.21.15.60:0/887369212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcff00ba3d0 0x7fcff01476a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:00.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.628+0000 7fcff651d700 1 -- 172.21.15.60:0/887369212 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcff00bd490 msgr2=0x7fcff01e35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:00.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.628+0000 7fcff651d700 1 --2- 172.21.15.60:0/887369212 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcff00bd490 0x7fcff01e35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:00.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.628+0000 7fcff651d700 1 -- 172.21.15.60:0/887369212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcff00ba3d0 msgr2=0x7fcff01476a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:00.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.628+0000 7fcff651d700 1 --2- 172.21.15.60:0/887369212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcff00ba3d0 0x7fcff01476a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:00.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.628+0000 7fcff651d700 1 -- 172.21.15.60:0/887369212 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe8009b30 con 0x7fcff01444f0 2023-07-12T02:03:00.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.628+0000 7fcff651d700 1 --2- 172.21.15.60:0/887369212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcff01444f0 0x7fcff01d3ca0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fcff00bc400 tx=0x7fcfe8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:00.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.628+0000 7fcfe67fc700 1 -- 172.21.15.60:0/887369212 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe8004800 con 0x7fcff01444f0 2023-07-12T02:03:00.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.628+0000 7fcfe67fc700 1 -- 172.21.15.60:0/887369212 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe8004960 con 0x7fcff01444f0 2023-07-12T02:03:00.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.628+0000 7fcff7f80700 1 -- 172.21.15.60:0/887369212 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcff0147d20 con 0x7fcff01444f0 2023-07-12T02:03:00.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.628+0000 7fcfe67fc700 1 -- 172.21.15.60:0/887369212 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe801c680 con 0x7fcff01444f0 2023-07-12T02:03:00.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.629+0000 7fcff7f80700 1 -- 172.21.15.60:0/887369212 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcff0146a90 con 0x7fcff01444f0 2023-07-12T02:03:00.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.629+0000 7fcff7f80700 1 -- 172.21.15.60:0/887369212 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcff0074360 con 0x7fcff01444f0 2023-07-12T02:03:00.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.630+0000 7fcfe67fc700 1 -- 172.21.15.60:0/887369212 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcfe801c7e0 con 0x7fcff01444f0 2023-07-12T02:03:00.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.630+0000 7fcfe67fc700 1 --2- 172.21.15.60:0/887369212 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fcfd406ace0 0x7fcfd406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:00.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.630+0000 7fcfe67fc700 1 -- 172.21.15.60:0/887369212 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcfe808afc0 con 0x7fcff01444f0 2023-07-12T02:03:00.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.630+0000 7fcff5d1c700 1 --2- 172.21.15.60:0/887369212 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fcfd406ace0 0x7fcfd406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:00.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.631+0000 7fcff5d1c700 1 --2- 172.21.15.60:0/887369212 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fcfd406ace0 0x7fcfd406d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0000f60 tx=0x7fcfe0007ed0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:00.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.635+0000 7fcfe67fc700 1 -- 172.21.15.60:0/887369212 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fcfe80bd380 con 0x7fcff01444f0 2023-07-12T02:03:00.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:00.882+0000 7fcff7f80700 1 -- 172.21.15.60:0/887369212 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fcff00b9610 con 0x7fcff01444f0 2023-07-12T02:03:01.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.773+0000 7fcfe67fc700 1 -- 172.21.15.60:0/887369212 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7fcfe8056100 con 0x7fcff01444f0 2023-07-12T02:03:01.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.776+0000 7fcff7f80700 1 -- 172.21.15.60:0/887369212 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fcfd406ace0 msgr2=0x7fcfd406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:01.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.776+0000 7fcff7f80700 1 --2- 172.21.15.60:0/887369212 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fcfd406ace0 0x7fcfd406d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0000f60 tx=0x7fcfe0007ed0 comp rx=0 tx=0).stop 2023-07-12T02:03:01.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.776+0000 7fcff7f80700 1 -- 172.21.15.60:0/887369212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcff01444f0 msgr2=0x7fcff01d3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:01.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.776+0000 7fcff7f80700 1 --2- 172.21.15.60:0/887369212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcff01444f0 0x7fcff01d3ca0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fcff00bc400 tx=0x7fcfe8004ad0 comp rx=0 tx=0).stop 2023-07-12T02:03:01.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.776+0000 7fcff7f80700 1 -- 172.21.15.60:0/887369212 shutdown_connections 2023-07-12T02:03:01.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.776+0000 7fcff7f80700 1 --2- 172.21.15.60:0/887369212 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fcfd406ace0 0x7fcfd406d190 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:01.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.776+0000 7fcff7f80700 1 --2- 172.21.15.60:0/887369212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcff01444f0 0x7fcff01d3ca0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:01.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.776+0000 7fcff7f80700 1 --2- 172.21.15.60:0/887369212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcff00ba3d0 0x7fcff01476a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:01.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.776+0000 7fcff7f80700 1 --2- 172.21.15.60:0/887369212 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcff00bd490 0x7fcff01e35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:01.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.776+0000 7fcff7f80700 1 -- 172.21.15.60:0/887369212 >> 172.21.15.60:0/887369212 conn(0x7fcff006aef0 msgr2=0x7fcff0139430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:01.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.776+0000 7fcff7f80700 1 -- 172.21.15.60:0/887369212 shutdown_connections 2023-07-12T02:03:01.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.776+0000 7fcff7f80700 1 -- 172.21.15.60:0/887369212 wait complete. 2023-07-12T02:03:01.795 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-12T02:03:01.795 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-12T02:03:01.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.927+0000 7f434f2aa700 1 Processor -- start 2023-07-12T02:03:01.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.927+0000 7f434f2aa700 1 -- start start 2023-07-12T02:03:01.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.927+0000 7f434f2aa700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f43481449d0 0x7f434814db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:01.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.927+0000 7f434f2aa700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f43480bc810 0x7f43480ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:01.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.928+0000 7f434f2aa700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43480b8620 con 0x7f43480b8d90 2023-07-12T02:03:01.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.928+0000 7f434f2aa700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43480b97a0 con 0x7f43480bc810 2023-07-12T02:03:01.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.928+0000 7f434f2aa700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4348144da0 con 0x7f43481449d0 2023-07-12T02:03:01.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.928+0000 7f434c845700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f43480bc810 0x7f43480ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:01.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.928+0000 7f434d847700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f43480b8d90 0x7f434806ade0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:38538/0 (socket says 172.21.15.60:38538) 2023-07-12T02:03:01.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.928+0000 7f434d847700 1 -- 172.21.15.60:0/1712461139 learned_addr learned my addr 172.21.15.60:0/1712461139 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:03:01.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.928+0000 7f434d046700 1 --2- 172.21.15.60:0/1712461139 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f43481449d0 0x7f434814db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:01.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.928+0000 7f434c845700 1 -- 172.21.15.60:0/1712461139 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f43481449d0 msgr2=0x7f434814db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:01.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.928+0000 7f434c845700 1 --2- 172.21.15.60:0/1712461139 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f43481449d0 0x7f434814db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:01.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.928+0000 7f434c845700 1 -- 172.21.15.60:0/1712461139 >> v1:172.21.15.60:6789/0 conn(0x7f43480b8d90 legacy=0x7f434806ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:01.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.928+0000 7f434c845700 1 -- 172.21.15.60:0/1712461139 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43480b8900 con 0x7f43480bc810 2023-07-12T02:03:01.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.928+0000 7f433ffff700 1 -- 172.21.15.60:0/1712461139 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2876350128 0 0) 0x7f43480b8620 con 0x7f43480b8d90 2023-07-12T02:03:01.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.928+0000 7f434c845700 1 --2- 172.21.15.60:0/1712461139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43480bc810 0x7f43480ba530 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4338009840 tx=0x7f4338009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3162bca94d15fb74 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:01.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.928+0000 7f433ffff700 1 -- 172.21.15.60:0/1712461139 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4338011830 con 0x7f43480bc810 2023-07-12T02:03:01.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.928+0000 7f433ffff700 1 -- 172.21.15.60:0/1712461139 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4338011990 con 0x7f43480bc810 2023-07-12T02:03:01.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.928+0000 7f433ffff700 1 -- 172.21.15.60:0/1712461139 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4338011d20 con 0x7f43480bc810 2023-07-12T02:03:01.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.929+0000 7f434f2aa700 1 -- 172.21.15.60:0/1712461139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43480bc810 msgr2=0x7f43480ba530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:01.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.929+0000 7f434f2aa700 1 --2- 172.21.15.60:0/1712461139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43480bc810 0x7f43480ba530 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4338009840 tx=0x7f4338009b50 comp rx=0 tx=0).stop 2023-07-12T02:03:01.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.929+0000 7f434f2aa700 1 -- 172.21.15.60:0/1712461139 shutdown_connections 2023-07-12T02:03:01.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.929+0000 7f434f2aa700 1 --2- 172.21.15.60:0/1712461139 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f43481449d0 0x7f434814db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:01.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.929+0000 7f434f2aa700 1 --2- 172.21.15.60:0/1712461139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43480bc810 0x7f43480ba530 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:01.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.929+0000 7f434f2aa700 1 -- 172.21.15.60:0/1712461139 >> 172.21.15.60:0/1712461139 conn(0x7f43480c0860 msgr2=0x7f43480c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:01.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.929+0000 7f434f2aa700 1 -- 172.21.15.60:0/1712461139 shutdown_connections 2023-07-12T02:03:01.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.929+0000 7f434f2aa700 1 -- 172.21.15.60:0/1712461139 wait complete. 2023-07-12T02:03:01.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.930+0000 7f434f2aa700 1 Processor -- start 2023-07-12T02:03:01.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.930+0000 7f434f2aa700 1 -- start start 2023-07-12T02:03:01.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.931+0000 7f434f2aa700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43480b8d90 0x7f43481464e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:01.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.931+0000 7f434f2aa700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f43481449d0 0x7f4348147830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:01.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.931+0000 7f434f2aa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4348145660 0x7f4348145ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:01.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.931+0000 7f434f2aa700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4348149950 con 0x7f4348145660 2023-07-12T02:03:01.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.931+0000 7f434f2aa700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4348144ef0 con 0x7f43480b8d90 2023-07-12T02:03:01.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.931+0000 7f434f2aa700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4348146a20 con 0x7f43481449d0 2023-07-12T02:03:01.938 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.931+0000 7f434d847700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4348145660 0x7f4348145ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:01.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.931+0000 7f434d847700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4348145660 0x7f4348145ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59670/0 (socket says 172.21.15.60:59670) 2023-07-12T02:03:01.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.931+0000 7f434d847700 1 -- 172.21.15.60:0/1841895419 learned_addr learned my addr 172.21.15.60:0/1841895419 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:03:01.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.931+0000 7f434c845700 1 --2- 172.21.15.60:0/1841895419 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f43481449d0 0x7f4348147830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:01.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.931+0000 7f434d046700 1 --2- 172.21.15.60:0/1841895419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43480b8d90 0x7f43481464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:01.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.931+0000 7f434d847700 1 -- 172.21.15.60:0/1841895419 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f43481449d0 msgr2=0x7f4348147830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:01.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.931+0000 7f434d847700 1 --2- 172.21.15.60:0/1841895419 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f43481449d0 0x7f4348147830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:01.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.931+0000 7f434d847700 1 -- 172.21.15.60:0/1841895419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43480b8d90 msgr2=0x7f43481464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:01.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.931+0000 7f434d847700 1 --2- 172.21.15.60:0/1841895419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43480b8d90 0x7f43481464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:01.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.931+0000 7f434d847700 1 -- 172.21.15.60:0/1841895419 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43380094a0 con 0x7f4348145660 2023-07-12T02:03:01.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.931+0000 7f434d046700 1 --2- 172.21.15.60:0/1841895419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43480b8d90 0x7f43481464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:03:01.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.931+0000 7f434d847700 1 --2- 172.21.15.60:0/1841895419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4348145660 0x7f4348145ae0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f434000ccd0 tx=0x7f434000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:01.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.931+0000 7f433dffb700 1 -- 172.21.15.60:0/1841895419 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434000ada0 con 0x7f4348145660 2023-07-12T02:03:01.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.931+0000 7f434f2aa700 1 -- 172.21.15.60:0/1841895419 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4348146c90 con 0x7f4348145660 2023-07-12T02:03:01.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.932+0000 7f433dffb700 1 -- 172.21.15.60:0/1841895419 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43400070d0 con 0x7f4348145660 2023-07-12T02:03:01.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.932+0000 7f433dffb700 1 -- 172.21.15.60:0/1841895419 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4340007480 con 0x7f4348145660 2023-07-12T02:03:01.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.932+0000 7f434f2aa700 1 -- 172.21.15.60:0/1841895419 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4348145140 con 0x7f4348145660 2023-07-12T02:03:01.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.933+0000 7f433dffb700 1 -- 172.21.15.60:0/1841895419 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f43400075e0 con 0x7f4348145660 2023-07-12T02:03:01.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.933+0000 7f434f2aa700 1 -- 172.21.15.60:0/1841895419 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4348145330 con 0x7f4348145660 2023-07-12T02:03:01.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.934+0000 7f433dffb700 1 --2- 172.21.15.60:0/1841895419 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f432c06ace0 0x7f432c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:01.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.934+0000 7f433dffb700 1 -- 172.21.15.60:0/1841895419 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f43400894a0 con 0x7f4348145660 2023-07-12T02:03:01.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.934+0000 7f434d046700 1 --2- 172.21.15.60:0/1841895419 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f432c06ace0 0x7f432c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:01.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.934+0000 7f434d046700 1 --2- 172.21.15.60:0/1841895419 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f432c06ace0 0x7f432c06d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4344009ac0 tx=0x7f4344008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:01.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:01.938+0000 7f433dffb700 1 -- 172.21.15.60:0/1841895419 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f4340054580 con 0x7f4348145660 2023-07-12T02:03:02.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.179+0000 7f434f2aa700 1 -- 172.21.15.60:0/1841895419 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4348074360 con 0x7f4348145660 2023-07-12T02:03:02.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.777+0000 7f433dffb700 1 -- 172.21.15.60:0/1841895419 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4340001c70 con 0x7f4348145660 2023-07-12T02:03:02.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.780+0000 7f434f2aa700 1 -- 172.21.15.60:0/1841895419 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f432c06ace0 msgr2=0x7f432c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:02.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.780+0000 7f434f2aa700 1 --2- 172.21.15.60:0/1841895419 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f432c06ace0 0x7f432c06d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4344009ac0 tx=0x7f4344008040 comp rx=0 tx=0).stop 2023-07-12T02:03:02.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.780+0000 7f434f2aa700 1 -- 172.21.15.60:0/1841895419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4348145660 msgr2=0x7f4348145ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:02.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.780+0000 7f434f2aa700 1 --2- 172.21.15.60:0/1841895419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4348145660 0x7f4348145ae0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f434000ccd0 tx=0x7f434000a340 comp rx=0 tx=0).stop 2023-07-12T02:03:02.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.780+0000 7f434f2aa700 1 -- 172.21.15.60:0/1841895419 shutdown_connections 2023-07-12T02:03:02.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.780+0000 7f434f2aa700 1 --2- 172.21.15.60:0/1841895419 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f432c06ace0 0x7f432c06d190 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:02.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.780+0000 7f434f2aa700 1 --2- 172.21.15.60:0/1841895419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4348145660 0x7f4348145ae0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:02.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.780+0000 7f434f2aa700 1 --2- 172.21.15.60:0/1841895419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43480b8d90 0x7f43481464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:02.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.780+0000 7f434f2aa700 1 --2- 172.21.15.60:0/1841895419 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f43481449d0 0x7f4348147830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:02.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.780+0000 7f434f2aa700 1 -- 172.21.15.60:0/1841895419 >> 172.21.15.60:0/1841895419 conn(0x7f43480c0860 msgr2=0x7f43480bf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:02.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.780+0000 7f434f2aa700 1 -- 172.21.15.60:0/1841895419 shutdown_connections 2023-07-12T02:03:02.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.780+0000 7f434f2aa700 1 -- 172.21.15.60:0/1841895419 wait complete. 2023-07-12T02:03:02.799 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-12T02:03:02.800 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-12T02:03:02.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.928+0000 7f410f731700 1 Processor -- start 2023-07-12T02:03:02.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.928+0000 7f410f731700 1 -- start start 2023-07-12T02:03:02.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.928+0000 7f410f731700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4108071590 0x7f4108142310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:02.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.929+0000 7f410f731700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f410814c3a0 0x7f4108142850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:02.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.929+0000 7f410f731700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4108071c60 con 0x7f410806b120 2023-07-12T02:03:02.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.929+0000 7f410f731700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4108142d90 con 0x7f4108071590 2023-07-12T02:03:02.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.929+0000 7f410f731700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4108070fd0 con 0x7f410814c3a0 2023-07-12T02:03:02.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.929+0000 7f410dcce700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f410814c3a0 0x7f4108142850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:02.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.929+0000 7f410cccc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4108071590 0x7f4108142310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:02.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.929+0000 7f410d4cd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f410806b120 0x7f410814bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.60:37876/0 (socket says 172.21.15.60:37876) 2023-07-12T02:03:02.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.929+0000 7f410d4cd700 1 -- 172.21.15.60:0/3608150049 learned_addr learned my addr 172.21.15.60:0/3608150049 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:03:02.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.929+0000 7f410cccc700 1 -- 172.21.15.60:0/3608150049 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f410814c3a0 msgr2=0x7f4108142850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:02.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.929+0000 7f410cccc700 1 --2- 172.21.15.60:0/3608150049 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f410814c3a0 0x7f4108142850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:02.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.929+0000 7f410cccc700 1 -- 172.21.15.60:0/3608150049 >> v1:172.21.15.79:6789/0 conn(0x7f410806b120 legacy=0x7f410814bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:02.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.929+0000 7f410cccc700 1 -- 172.21.15.60:0/3608150049 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41080712b0 con 0x7f4108071590 2023-07-12T02:03:02.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.929+0000 7f410dcce700 1 --2- 172.21.15.60:0/3608150049 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f410814c3a0 0x7f4108142850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:03:02.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.930+0000 7f410cccc700 1 --2- 172.21.15.60:0/3608150049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4108071590 0x7f4108142310 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f40fc009840 tx=0x7f40fc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=533b7afdff22e365 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:02.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.930+0000 7f4107fff700 1 -- 172.21.15.60:0/3608150049 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40fc011830 con 0x7f4108071590 2023-07-12T02:03:02.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.930+0000 7f4107fff700 1 -- 172.21.15.60:0/3608150049 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40fc011990 con 0x7f4108071590 2023-07-12T02:03:02.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.930+0000 7f4107fff700 1 -- 172.21.15.60:0/3608150049 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40fc011d20 con 0x7f4108071590 2023-07-12T02:03:02.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.930+0000 7f410f731700 1 -- 172.21.15.60:0/3608150049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4108071590 msgr2=0x7f4108142310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:02.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.930+0000 7f410f731700 1 --2- 172.21.15.60:0/3608150049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4108071590 0x7f4108142310 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f40fc009840 tx=0x7f40fc009b50 comp rx=0 tx=0).stop 2023-07-12T02:03:02.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.930+0000 7f410f731700 1 -- 172.21.15.60:0/3608150049 shutdown_connections 2023-07-12T02:03:02.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.930+0000 7f410f731700 1 --2- 172.21.15.60:0/3608150049 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f410814c3a0 0x7f4108142850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:02.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.930+0000 7f410f731700 1 --2- 172.21.15.60:0/3608150049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4108071590 0x7f4108142310 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:02.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.930+0000 7f410f731700 1 -- 172.21.15.60:0/3608150049 >> 172.21.15.60:0/3608150049 conn(0x7f41080bd980 msgr2=0x7f41080b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:02.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.930+0000 7f410f731700 1 -- 172.21.15.60:0/3608150049 shutdown_connections 2023-07-12T02:03:02.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.930+0000 7f410f731700 1 -- 172.21.15.60:0/3608150049 wait complete. 2023-07-12T02:03:02.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.932+0000 7f410f731700 1 Processor -- start 2023-07-12T02:03:02.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.932+0000 7f410f731700 1 -- start start 2023-07-12T02:03:02.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.933+0000 7f410f731700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f410806b120 0x7f410806edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:02.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.933+0000 7f410f731700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4108071590 0x7f4108070910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:02.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.933+0000 7f410f731700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f410814c3a0 0x7f41081dfd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:02.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.933+0000 7f410f731700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4108070e50 con 0x7f4108071590 2023-07-12T02:03:02.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.933+0000 7f410f731700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41080b8180 con 0x7f410814c3a0 2023-07-12T02:03:02.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.933+0000 7f410f731700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41080b3900 con 0x7f410806b120 2023-07-12T02:03:02.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.933+0000 7f410cccc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4108071590 0x7f4108070910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:02.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.933+0000 7f410cccc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4108071590 0x7f4108070910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59676/0 (socket says 172.21.15.60:59676) 2023-07-12T02:03:02.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.933+0000 7f410cccc700 1 -- 172.21.15.60:0/2604864966 learned_addr learned my addr 172.21.15.60:0/2604864966 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:03:02.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.933+0000 7f410d4cd700 1 --2- 172.21.15.60:0/2604864966 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f410806b120 0x7f410806edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:02.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.933+0000 7f410dcce700 1 --2- 172.21.15.60:0/2604864966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f410814c3a0 0x7f41081dfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:02.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.933+0000 7f410cccc700 1 -- 172.21.15.60:0/2604864966 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f410806b120 msgr2=0x7f410806edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:02.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.933+0000 7f410cccc700 1 --2- 172.21.15.60:0/2604864966 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f410806b120 0x7f410806edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:02.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.933+0000 7f410cccc700 1 -- 172.21.15.60:0/2604864966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f410814c3a0 msgr2=0x7f41081dfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:02.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.933+0000 7f410cccc700 1 --2- 172.21.15.60:0/2604864966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f410814c3a0 0x7f41081dfd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:02.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.933+0000 7f410cccc700 1 -- 172.21.15.60:0/2604864966 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41000094a0 con 0x7f4108071590 2023-07-12T02:03:02.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.933+0000 7f410d4cd700 1 --2- 172.21.15.60:0/2604864966 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f410806b120 0x7f410806edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:03:02.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.933+0000 7f410cccc700 1 --2- 172.21.15.60:0/2604864966 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4108071590 0x7f4108070910 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f40fc0090b0 tx=0x7f40fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:02.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.934+0000 7f4105ffb700 1 -- 172.21.15.60:0/2604864966 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40fc0036a0 con 0x7f4108071590 2023-07-12T02:03:02.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.934+0000 7f4105ffb700 1 -- 172.21.15.60:0/2604864966 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40fc01f070 con 0x7f4108071590 2023-07-12T02:03:02.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.934+0000 7f410f731700 1 -- 172.21.15.60:0/2604864966 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40fc0094a0 con 0x7f4108071590 2023-07-12T02:03:02.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.934+0000 7f4105ffb700 1 -- 172.21.15.60:0/2604864966 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40fc003a60 con 0x7f4108071590 2023-07-12T02:03:02.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.934+0000 7f410f731700 1 -- 172.21.15.60:0/2604864966 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f410814b240 con 0x7f4108071590 2023-07-12T02:03:02.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.935+0000 7f410f731700 1 -- 172.21.15.60:0/2604864966 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4108074360 con 0x7f4108071590 2023-07-12T02:03:02.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.935+0000 7f4105ffb700 1 -- 172.21.15.60:0/2604864966 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f40fc003bc0 con 0x7f4108071590 2023-07-12T02:03:02.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.936+0000 7f4105ffb700 1 --2- 172.21.15.60:0/2604864966 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f40f406ad10 0x7f40f406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:02.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.936+0000 7f4105ffb700 1 -- 172.21.15.60:0/2604864966 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f40fc021070 con 0x7f4108071590 2023-07-12T02:03:02.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.936+0000 7f410d4cd700 1 --2- 172.21.15.60:0/2604864966 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f40f406ad10 0x7f40f406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:02.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.937+0000 7f410d4cd700 1 --2- 172.21.15.60:0/2604864966 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f40f406ad10 0x7f40f406d1c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f40f8005c90 tx=0x7f40f8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:02.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:02.940+0000 7f4105ffb700 1 -- 172.21.15.60:0/2604864966 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f40fc055e20 con 0x7f4108071590 2023-07-12T02:03:03.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.179+0000 7f410f731700 1 -- 172.21.15.60:0/2604864966 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4108140580 con 0x7f4108071590 2023-07-12T02:03:03.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.180+0000 7f4105ffb700 1 -- 172.21.15.60:0/2604864966 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+3911 (secure 0 0 0) 0x7f40fc059440 con 0x7f4108071590 2023-07-12T02:03:03.184 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:03:03.184 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4897,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2527934877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2527934877},{"type":"v1","addr":"172.21.15.79:6835","nonce":2527934877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4903,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2971951458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6833","nonce":2971951458},{"type":"v1","addr":"172.21.15.60:6835","nonce":2971951458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-12T02:02:58.961054+0000","modified":"2023-07-12T02:03:02.181602+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4971":{"gid":4971,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6834/646133464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":646133464},{"type":"v1","addr":"172.21.15.60:6834","nonce":646133464}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-12T02:03:03.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.182+0000 7f410f731700 1 -- 172.21.15.60:0/2604864966 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f40f406ad10 msgr2=0x7f40f406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:03.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.182+0000 7f410f731700 1 --2- 172.21.15.60:0/2604864966 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f40f406ad10 0x7f40f406d1c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f40f8005c90 tx=0x7f40f8009040 comp rx=0 tx=0).stop 2023-07-12T02:03:03.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.182+0000 7f410f731700 1 -- 172.21.15.60:0/2604864966 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4108071590 msgr2=0x7f4108070910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:03.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.182+0000 7f410f731700 1 --2- 172.21.15.60:0/2604864966 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4108071590 0x7f4108070910 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f40fc0090b0 tx=0x7f40fc004750 comp rx=0 tx=0).stop 2023-07-12T02:03:03.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.182+0000 7f410f731700 1 -- 172.21.15.60:0/2604864966 shutdown_connections 2023-07-12T02:03:03.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.182+0000 7f410f731700 1 --2- 172.21.15.60:0/2604864966 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f40f406ad10 0x7f40f406d1c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:03.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.182+0000 7f410f731700 1 --2- 172.21.15.60:0/2604864966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f410814c3a0 0x7f41081dfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:03.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.182+0000 7f410f731700 1 --2- 172.21.15.60:0/2604864966 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f410806b120 0x7f410806edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:03.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.182+0000 7f410f731700 1 --2- 172.21.15.60:0/2604864966 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4108071590 0x7f4108070910 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:03.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.182+0000 7f410f731700 1 -- 172.21.15.60:0/2604864966 >> 172.21.15.60:0/2604864966 conn(0x7f41080bd980 msgr2=0x7f410813f530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:03.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.182+0000 7f410f731700 1 -- 172.21.15.60:0/2604864966 shutdown_connections 2023-07-12T02:03:03.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.182+0000 7f410f731700 1 -- 172.21.15.60:0/2604864966 wait complete. 2023-07-12T02:03:03.188 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 16 2023-07-12T02:03:03.198 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:03:03.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.320+0000 7fea01bc5700 1 Processor -- start 2023-07-12T02:03:03.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.320+0000 7fea01bc5700 1 -- start start 2023-07-12T02:03:03.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.321+0000 7fea01bc5700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe9fc14aa40 0x7fe9fc14aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:03.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.321+0000 7fea01bc5700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe9fc1444c0 0x7fe9fc144920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:03.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.321+0000 7fea01bc5700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9fc070410 con 0x7fe9fc06b120 2023-07-12T02:03:03.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.321+0000 7fea01bc5700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9fc0b9590 con 0x7fe9fc14aa40 2023-07-12T02:03:03.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.321+0000 7fea01bc5700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc14b400 con 0x7fe9fc1444c0 2023-07-12T02:03:03.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.321+0000 7fe9fb7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe9fc06b120 0x7fe9fc0b8cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:38542/0 (socket says 172.21.15.60:38542) 2023-07-12T02:03:03.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.321+0000 7fe9fb7fe700 1 -- 172.21.15.60:0/2092523250 learned_addr learned my addr 172.21.15.60:0/2092523250 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:03:03.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.321+0000 7fe9f2ffd700 1 --2- 172.21.15.60:0/2092523250 >> v2:172.21.15.60:3300/0 conn(0x7fe9fc14aa40 0x7fe9fc14aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:03.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.321+0000 7fe9fbfff700 1 --2- 172.21.15.60:0/2092523250 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe9fc1444c0 0x7fe9fc144920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:03.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.321+0000 7fe9faffd700 1 -- 172.21.15.60:0/2092523250 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2491933229 0 0) 0x7fe9fc070410 con 0x7fe9fc06b120 2023-07-12T02:03:03.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.321+0000 7fe9faffd700 1 -- 172.21.15.60:0/2092523250 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9e80035b0 con 0x7fe9fc06b120 2023-07-12T02:03:03.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.321+0000 7fe9f2ffd700 1 -- 172.21.15.60:0/2092523250 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe9fc1444c0 msgr2=0x7fe9fc144920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:03.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.321+0000 7fe9f2ffd700 1 --2- 172.21.15.60:0/2092523250 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe9fc1444c0 0x7fe9fc144920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:03.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.321+0000 7fe9f2ffd700 1 -- 172.21.15.60:0/2092523250 >> v1:172.21.15.60:6789/0 conn(0x7fe9fc06b120 legacy=0x7fe9fc0b8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:03.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.321+0000 7fe9f2ffd700 1 -- 172.21.15.60:0/2092523250 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9fc06ef60 con 0x7fe9fc14aa40 2023-07-12T02:03:03.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.321+0000 7fe9f2ffd700 1 --2- 172.21.15.60:0/2092523250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9fc14aa40 0x7fe9fc14aec0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4009840 tx=0x7fe9e4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8219bcccc736843 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:03.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.321+0000 7fe9faffd700 1 -- 172.21.15.60:0/2092523250 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4011830 con 0x7fe9fc14aa40 2023-07-12T02:03:03.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.322+0000 7fe9faffd700 1 -- 172.21.15.60:0/2092523250 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e4011990 con 0x7fe9fc14aa40 2023-07-12T02:03:03.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.322+0000 7fe9faffd700 1 -- 172.21.15.60:0/2092523250 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4011d20 con 0x7fe9fc14aa40 2023-07-12T02:03:03.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.322+0000 7fea01bc5700 1 -- 172.21.15.60:0/2092523250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9fc14aa40 msgr2=0x7fe9fc14aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:03.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.322+0000 7fea01bc5700 1 --2- 172.21.15.60:0/2092523250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9fc14aa40 0x7fe9fc14aec0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4009840 tx=0x7fe9e4009b50 comp rx=0 tx=0).stop 2023-07-12T02:03:03.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.322+0000 7fea01bc5700 1 -- 172.21.15.60:0/2092523250 shutdown_connections 2023-07-12T02:03:03.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.322+0000 7fea01bc5700 1 --2- 172.21.15.60:0/2092523250 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe9fc1444c0 0x7fe9fc144920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:03.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.322+0000 7fea01bc5700 1 --2- 172.21.15.60:0/2092523250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9fc14aa40 0x7fe9fc14aec0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:03.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.322+0000 7fea01bc5700 1 -- 172.21.15.60:0/2092523250 >> 172.21.15.60:0/2092523250 conn(0x7fe9fc0bd980 msgr2=0x7fe9fc0b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:03.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.322+0000 7fea01bc5700 1 -- 172.21.15.60:0/2092523250 shutdown_connections 2023-07-12T02:03:03.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.322+0000 7fea01bc5700 1 -- 172.21.15.60:0/2092523250 wait complete. 2023-07-12T02:03:03.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.323+0000 7fea01bc5700 1 Processor -- start 2023-07-12T02:03:03.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.323+0000 7fea01bc5700 1 -- start start 2023-07-12T02:03:03.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.324+0000 7fea01bc5700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe9fc06b120 0x7fe9fc1df680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:03.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.324+0000 7fea01bc5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9fc1444c0 0x7fe9fc1e3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:03.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.324+0000 7fea01bc5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9fc14aa40 0x7fe9fc149ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:03.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.324+0000 7fea01bc5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc14a3e0 con 0x7fe9fc1444c0 2023-07-12T02:03:03.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.324+0000 7fea01bc5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc1e2cf0 con 0x7fe9fc14aa40 2023-07-12T02:03:03.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.324+0000 7fea01bc5700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc143f30 con 0x7fe9fc06b120 2023-07-12T02:03:03.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.324+0000 7fe9f2ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9fc1444c0 0x7fe9fc1e3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:03.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.324+0000 7fe9f2ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9fc1444c0 0x7fe9fc1e3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59700/0 (socket says 172.21.15.60:59700) 2023-07-12T02:03:03.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.324+0000 7fe9f2ffd700 1 -- 172.21.15.60:0/2636274148 learned_addr learned my addr 172.21.15.60:0/2636274148 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:03:03.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.324+0000 7fe9fbfff700 1 --2- 172.21.15.60:0/2636274148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9fc14aa40 0x7fe9fc149ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:03.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.324+0000 7fe9fb7fe700 1 --2- 172.21.15.60:0/2636274148 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe9fc06b120 0x7fe9fc1df680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:03.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.324+0000 7fe9f2ffd700 1 -- 172.21.15.60:0/2636274148 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe9fc06b120 msgr2=0x7fe9fc1df680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:03.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.324+0000 7fe9f2ffd700 1 --2- 172.21.15.60:0/2636274148 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe9fc06b120 0x7fe9fc1df680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:03.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.324+0000 7fe9f2ffd700 1 -- 172.21.15.60:0/2636274148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9fc14aa40 msgr2=0x7fe9fc149ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:03.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.324+0000 7fe9f2ffd700 1 --2- 172.21.15.60:0/2636274148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9fc14aa40 0x7fe9fc149ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:03.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.324+0000 7fe9f2ffd700 1 -- 172.21.15.60:0/2636274148 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e40094a0 con 0x7fe9fc1444c0 2023-07-12T02:03:03.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.325+0000 7fe9f2ffd700 1 --2- 172.21.15.60:0/2636274148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9fc1444c0 0x7fe9fc1e3760 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe9e40090b0 tx=0x7fe9e4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:03.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.325+0000 7fe9f8ff9700 1 -- 172.21.15.60:0/2636274148 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4004590 con 0x7fe9fc1444c0 2023-07-12T02:03:03.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.325+0000 7fe9f8ff9700 1 -- 172.21.15.60:0/2636274148 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e401e070 con 0x7fe9fc1444c0 2023-07-12T02:03:03.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.325+0000 7fea01bc5700 1 -- 172.21.15.60:0/2636274148 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9fc1e2f60 con 0x7fe9fc1444c0 2023-07-12T02:03:03.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.325+0000 7fe9f8ff9700 1 -- 172.21.15.60:0/2636274148 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e40038e0 con 0x7fe9fc1444c0 2023-07-12T02:03:03.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.325+0000 7fea01bc5700 1 -- 172.21.15.60:0/2636274148 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9fc145fa0 con 0x7fe9fc1444c0 2023-07-12T02:03:03.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.326+0000 7fea01bc5700 1 -- 172.21.15.60:0/2636274148 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9fc074360 con 0x7fe9fc1444c0 2023-07-12T02:03:03.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.326+0000 7fe9f8ff9700 1 -- 172.21.15.60:0/2636274148 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe9e4003a40 con 0x7fe9fc1444c0 2023-07-12T02:03:03.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.326+0000 7fe9f8ff9700 1 --2- 172.21.15.60:0/2636274148 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fe9dc06ace0 0x7fe9dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:03.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.327+0000 7fe9f8ff9700 1 -- 172.21.15.60:0/2636274148 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe9e408a1f0 con 0x7fe9fc1444c0 2023-07-12T02:03:03.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.327+0000 7fe9fb7fe700 1 --2- 172.21.15.60:0/2636274148 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fe9dc06ace0 0x7fe9dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:03.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.327+0000 7fe9fb7fe700 1 --2- 172.21.15.60:0/2636274148 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fe9dc06ace0 0x7fe9dc06d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec007fd0 tx=0x7fe9ec007dc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:03.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.331+0000 7fe9f8ff9700 1 -- 172.21.15.60:0/2636274148 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fe9e4055330 con 0x7fe9fc1444c0 2023-07-12T02:03:03.467 INFO:tasks.ceph.mds.a.smithi060.stderr:2023-07-12T02:03:03.463+0000 7fb6746d9700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-12T02:03:03.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.528+0000 7fea01bc5700 1 -- 172.21.15.60:0/2636274148 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9fc0700c0 con 0x7fe9fc1444c0 2023-07-12T02:03:03.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.529+0000 7fe9f8ff9700 1 -- 172.21.15.60:0/2636274148 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+18245 (secure 0 0 0) 0x7fe9e4020090 con 0x7fe9fc1444c0 2023-07-12T02:03:03.533 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:03:03.534 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":31,"fsid":"97e7c909-e567-472e-a5aa-72fde15171f2","created":"2023-07-12T02:01:53.987086+0000","modified":"2023-07-12T02:03:00.543986+0000","last_up_change":"2023-07-12T02:02:04.031780+0000","last_in_change":"2023-07-12T02:01:56.538621+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-12T02:02:05.375042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-12T02:02:05.857441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:02:57.318080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-12T02:02:57.932207+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ed8b71c2-3895-4952-a118-16ede0b4a98c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6801","nonce":2818935979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6803","nonce":2818935979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6807","nonce":2818935979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6805","nonce":2818935979}]},"public_addr":"172.21.15.60:6801/2818935979","cluster_addr":"172.21.15.60:6803/2818935979","heartbeat_back_addr":"172.21.15.60:6807/2818935979","heartbeat_front_addr":"172.21.15.60:6805/2818935979","state":["exists","up"]},{"osd":1,"uuid":"7cf4d354-78e0-43ce-8c09-4a7d2a0b57a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6817","nonce":1678864191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6819","nonce":1678864191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6823","nonce":1678864191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6821","nonce":1678864191}]},"public_addr":"172.21.15.60:6817/1678864191","cluster_addr":"172.21.15.60:6819/1678864191","heartbeat_back_addr":"172.21.15.60:6823/1678864191","heartbeat_front_addr":"172.21.15.60:6821/1678864191","state":["exists","up"]},{"osd":2,"uuid":"02c958b8-9599-4470-92cb-8f7018ec0189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6809","nonce":1459480680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6811","nonce":1459480680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6815","nonce":1459480680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6813","nonce":1459480680}]},"public_addr":"172.21.15.60:6809/1459480680","cluster_addr":"172.21.15.60:6811/1459480680","heartbeat_back_addr":"172.21.15.60:6815/1459480680","heartbeat_front_addr":"172.21.15.60:6813/1459480680","state":["exists","up"]},{"osd":3,"uuid":"bc300432-a228-4257-be5c-e42dd5f2015f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6825","nonce":3295100060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6827","nonce":3295100060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6831","nonce":3295100060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6829","nonce":3295100060}]},"public_addr":"172.21.15.60:6825/3295100060","cluster_addr":"172.21.15.60:6827/3295100060","heartbeat_back_addr":"172.21.15.60:6831/3295100060","heartbeat_front_addr":"172.21.15.60:6829/3295100060","state":["exists","up"]},{"osd":4,"uuid":"ad9f7dc4-7126-466d-a656-2844880c6060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6809","nonce":4127109138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6811","nonce":4127109138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6815","nonce":4127109138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6813","nonce":4127109138}]},"public_addr":"172.21.15.79:6809/4127109138","cluster_addr":"172.21.15.79:6811/4127109138","heartbeat_back_addr":"172.21.15.79:6815/4127109138","heartbeat_front_addr":"172.21.15.79:6813/4127109138","state":["exists","up"]},{"osd":5,"uuid":"e88d16ca-0b01-4ab9-8aa8-c4aff7f210f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6801","nonce":421449406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6803","nonce":421449406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6807","nonce":421449406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6805","nonce":421449406}]},"public_addr":"172.21.15.79:6801/421449406","cluster_addr":"172.21.15.79:6803/421449406","heartbeat_back_addr":"172.21.15.79:6807/421449406","heartbeat_front_addr":"172.21.15.79:6805/421449406","state":["exists","up"]},{"osd":6,"uuid":"6898cb84-56d1-48a9-bd45-97e4668e2fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6825","nonce":4144355139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6827","nonce":4144355139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6831","nonce":4144355139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6829","nonce":4144355139}]},"public_addr":"172.21.15.79:6825/4144355139","cluster_addr":"172.21.15.79:6827/4144355139","heartbeat_back_addr":"172.21.15.79:6831/4144355139","heartbeat_front_addr":"172.21.15.79:6829/4144355139","state":["exists","up"]},{"osd":7,"uuid":"65c10882-371e-4762-b384-9c3a48f332ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6817","nonce":2845223299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6819","nonce":2845223299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6823","nonce":2845223299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6821","nonce":2845223299}]},"public_addr":"172.21.15.79:6817/2845223299","cluster_addr":"172.21.15.79:6819/2845223299","heartbeat_back_addr":"172.21.15.79:6823/2845223299","heartbeat_front_addr":"172.21.15.79:6821/2845223299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.634716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.758349+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.728366+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.777395+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707262+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.649705+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.693021+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:03:03.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.531+0000 7fea01bc5700 1 -- 172.21.15.60:0/2636274148 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fe9dc06ace0 msgr2=0x7fe9dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:03.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.531+0000 7fea01bc5700 1 --2- 172.21.15.60:0/2636274148 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fe9dc06ace0 0x7fe9dc06d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec007fd0 tx=0x7fe9ec007dc0 comp rx=0 tx=0).stop 2023-07-12T02:03:03.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.531+0000 7fea01bc5700 1 -- 172.21.15.60:0/2636274148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9fc1444c0 msgr2=0x7fe9fc1e3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:03.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.531+0000 7fea01bc5700 1 --2- 172.21.15.60:0/2636274148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9fc1444c0 0x7fe9fc1e3760 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe9e40090b0 tx=0x7fe9e4004750 comp rx=0 tx=0).stop 2023-07-12T02:03:03.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.531+0000 7fea01bc5700 1 -- 172.21.15.60:0/2636274148 shutdown_connections 2023-07-12T02:03:03.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.531+0000 7fea01bc5700 1 --2- 172.21.15.60:0/2636274148 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fe9dc06ace0 0x7fe9dc06d190 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:03.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.531+0000 7fea01bc5700 1 --2- 172.21.15.60:0/2636274148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9fc14aa40 0x7fe9fc149ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:03.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.531+0000 7fea01bc5700 1 --2- 172.21.15.60:0/2636274148 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe9fc06b120 0x7fe9fc1df680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:03.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.531+0000 7fea01bc5700 1 --2- 172.21.15.60:0/2636274148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9fc1444c0 0x7fe9fc1e3760 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:03.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.531+0000 7fea01bc5700 1 -- 172.21.15.60:0/2636274148 >> 172.21.15.60:0/2636274148 conn(0x7fe9fc0bd980 msgr2=0x7fe9fc141230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:03.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.531+0000 7fea01bc5700 1 -- 172.21.15.60:0/2636274148 shutdown_connections 2023-07-12T02:03:03.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.531+0000 7fea01bc5700 1 -- 172.21.15.60:0/2636274148 wait complete. 2023-07-12T02:03:03.547 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-12T02:03:03.548 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-12T02:03:03.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.669+0000 7ff816145700 1 Processor -- start 2023-07-12T02:03:03.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.669+0000 7ff816145700 1 -- start start 2023-07-12T02:03:03.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.670+0000 7ff816145700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff8101449d0 0x7ff81014db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:03.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.670+0000 7ff816145700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8100b8620 con 0x7ff8100bc810 2023-07-12T02:03:03.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.670+0000 7ff816145700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8100b8900 con 0x7ff8100b8d90 2023-07-12T02:03:03.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.670+0000 7ff816145700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8100b97a0 con 0x7ff8101449d0 2023-07-12T02:03:03.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.670+0000 7ff80effd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff8100bc810 0x7ff8100ba530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:38550/0 (socket says 172.21.15.60:38550) 2023-07-12T02:03:03.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.670+0000 7ff80effd700 1 -- 172.21.15.60:0/771570271 learned_addr learned my addr 172.21.15.60:0/771570271 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:03:03.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.670+0000 7ff80f7fe700 1 --2- 172.21.15.60:0/771570271 >> v2:172.21.15.79:3300/0 conn(0x7ff8101449d0 0x7ff81014db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:03.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.670+0000 7ff80e7fc700 1 -- 172.21.15.60:0/771570271 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1731728650 0 0) 0x7ff8100b8620 con 0x7ff8100bc810 2023-07-12T02:03:03.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.671+0000 7ff80e7fc700 1 -- 172.21.15.60:0/771570271 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7fc0035b0 con 0x7ff8100bc810 2023-07-12T02:03:03.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.671+0000 7ff80f7fe700 1 -- 172.21.15.60:0/771570271 >> v1:172.21.15.79:6789/0 conn(0x7ff8100b8d90 legacy=0x7ff81006ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:03.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.671+0000 7ff80f7fe700 1 -- 172.21.15.60:0/771570271 >> v1:172.21.15.60:6789/0 conn(0x7ff8100bc810 legacy=0x7ff8100ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:03.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.671+0000 7ff80e7fc700 1 -- 172.21.15.60:0/771570271 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2741045293 0 0) 0x7ff7fc0035b0 con 0x7ff8100bc810 2023-07-12T02:03:03.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.671+0000 7ff80f7fe700 1 -- 172.21.15.60:0/771570271 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8100bac40 con 0x7ff8101449d0 2023-07-12T02:03:03.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.671+0000 7ff80f7fe700 1 --2- 172.21.15.60:0/771570271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8101449d0 0x7ff81014db50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff800009840 tx=0x7ff800009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70ad7a62d7c7c571 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:03.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.671+0000 7ff80e7fc700 1 -- 172.21.15.60:0/771570271 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f8001670 con 0x7ff8101449d0 2023-07-12T02:03:03.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.671+0000 7ff80e7fc700 1 -- 172.21.15.60:0/771570271 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff800004030 con 0x7ff8101449d0 2023-07-12T02:03:03.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.671+0000 7ff80e7fc700 1 -- 172.21.15.60:0/771570271 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8000043c0 con 0x7ff8101449d0 2023-07-12T02:03:03.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.672+0000 7ff816145700 1 -- 172.21.15.60:0/771570271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8101449d0 msgr2=0x7ff81014db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:03.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.672+0000 7ff816145700 1 --2- 172.21.15.60:0/771570271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8101449d0 0x7ff81014db50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff800009840 tx=0x7ff800009b50 comp rx=0 tx=0).stop 2023-07-12T02:03:03.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.672+0000 7ff816145700 1 -- 172.21.15.60:0/771570271 shutdown_connections 2023-07-12T02:03:03.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.672+0000 7ff816145700 1 --2- 172.21.15.60:0/771570271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8101449d0 0x7ff81014db50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:03.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.672+0000 7ff816145700 1 -- 172.21.15.60:0/771570271 >> 172.21.15.60:0/771570271 conn(0x7ff8100c0860 msgr2=0x7ff8100c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:03.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.672+0000 7ff816145700 1 -- 172.21.15.60:0/771570271 shutdown_connections 2023-07-12T02:03:03.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.672+0000 7ff816145700 1 -- 172.21.15.60:0/771570271 wait complete. 2023-07-12T02:03:03.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.673+0000 7ff816145700 1 Processor -- start 2023-07-12T02:03:03.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.673+0000 7ff816145700 1 -- start start 2023-07-12T02:03:03.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.674+0000 7ff816145700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8100b8d90 0x7ff81014ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:03.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.674+0000 7ff816145700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8100bc810 0x7ff8101d5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:03.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.674+0000 7ff816145700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff8101449d0 0x7ff8101d63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:03.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.674+0000 7ff816145700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff810149590 con 0x7ff8100bc810 2023-07-12T02:03:03.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.674+0000 7ff816145700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8101d6930 con 0x7ff8100b8d90 2023-07-12T02:03:03.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.674+0000 7ff816145700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8101d5780 con 0x7ff8101449d0 2023-07-12T02:03:03.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.674+0000 7ff80effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8100bc810 0x7ff8101d5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:03.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.674+0000 7ff80effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8100bc810 0x7ff8101d5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59704/0 (socket says 172.21.15.60:59704) 2023-07-12T02:03:03.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.674+0000 7ff80effd700 1 -- 172.21.15.60:0/1367065743 learned_addr learned my addr 172.21.15.60:0/1367065743 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:03:03.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.674+0000 7ff80f7fe700 1 --2- 172.21.15.60:0/1367065743 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8100b8d90 0x7ff81014ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:03.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.674+0000 7ff80ffff700 1 --2- 172.21.15.60:0/1367065743 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff8101449d0 0x7ff8101d63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:03.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.674+0000 7ff80effd700 1 -- 172.21.15.60:0/1367065743 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff8101449d0 msgr2=0x7ff8101d63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:03.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.674+0000 7ff80effd700 1 --2- 172.21.15.60:0/1367065743 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff8101449d0 0x7ff8101d63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:03.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.674+0000 7ff80effd700 1 -- 172.21.15.60:0/1367065743 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8100b8d90 msgr2=0x7ff81014ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:03.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.674+0000 7ff80effd700 1 --2- 172.21.15.60:0/1367065743 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8100b8d90 0x7ff81014ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:03.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.674+0000 7ff80effd700 1 -- 172.21.15.60:0/1367065743 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8000094a0 con 0x7ff8100bc810 2023-07-12T02:03:03.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.674+0000 7ff80f7fe700 1 --2- 172.21.15.60:0/1367065743 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8100b8d90 0x7ff81014ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:03:03.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.674+0000 7ff80effd700 1 --2- 172.21.15.60:0/1367065743 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8100bc810 0x7ff8101d5eb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff7f80011e0 tx=0x7ff7f800cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:03.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.674+0000 7ff807fff700 1 -- 172.21.15.60:0/1367065743 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f8007560 con 0x7ff8100bc810 2023-07-12T02:03:03.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.674+0000 7ff807fff700 1 -- 172.21.15.60:0/1367065743 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f80076c0 con 0x7ff8100bc810 2023-07-12T02:03:03.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.674+0000 7ff816145700 1 -- 172.21.15.60:0/1367065743 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff810149030 con 0x7ff8100bc810 2023-07-12T02:03:03.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.674+0000 7ff807fff700 1 -- 172.21.15.60:0/1367065743 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f8004a90 con 0x7ff8100bc810 2023-07-12T02:03:03.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.674+0000 7ff816145700 1 -- 172.21.15.60:0/1367065743 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff810148c50 con 0x7ff8100bc810 2023-07-12T02:03:03.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.675+0000 7ff816145700 1 -- 172.21.15.60:0/1367065743 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8101d5bd0 con 0x7ff8100bc810 2023-07-12T02:03:03.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.676+0000 7ff807fff700 1 -- 172.21.15.60:0/1367065743 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff7f8004bf0 con 0x7ff8100bc810 2023-07-12T02:03:03.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.677+0000 7ff807fff700 1 --2- 172.21.15.60:0/1367065743 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ff7f006ad10 0x7ff7f006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:03.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.677+0000 7ff807fff700 1 -- 172.21.15.60:0/1367065743 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff7f80895f0 con 0x7ff8100bc810 2023-07-12T02:03:03.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.677+0000 7ff80f7fe700 1 --2- 172.21.15.60:0/1367065743 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ff7f006ad10 0x7ff7f006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:03.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.677+0000 7ff80f7fe700 1 --2- 172.21.15.60:0/1367065743 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ff7f006ad10 0x7ff7f006d1c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff8000090b0 tx=0x7ff800013040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:03.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.680+0000 7ff807fff700 1 -- 172.21.15.60:0/1367065743 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7ff7f8054810 con 0x7ff8100bc810 2023-07-12T02:03:03.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.873+0000 7ff816145700 1 -- 172.21.15.60:0/1367065743 --> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff8100bcca0 con 0x7ff7f006ad10 2023-07-12T02:03:03.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.881+0000 7ff807fff700 1 -- 172.21.15.60:0/1367065743 <== mgr.4105 v2:172.21.15.79:6832/1173177519 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286916 (secure 0 0 0) 0x7ff800003750 con 0x7ff7f006ad10 2023-07-12T02:03:03.888 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:03:03.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.884+0000 7ff816145700 1 -- 172.21.15.60:0/1367065743 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ff7f006ad10 msgr2=0x7ff7f006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:03.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.884+0000 7ff816145700 1 --2- 172.21.15.60:0/1367065743 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ff7f006ad10 0x7ff7f006d1c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff8000090b0 tx=0x7ff800013040 comp rx=0 tx=0).stop 2023-07-12T02:03:03.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.884+0000 7ff816145700 1 -- 172.21.15.60:0/1367065743 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8100bc810 msgr2=0x7ff8101d5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:03.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.884+0000 7ff816145700 1 --2- 172.21.15.60:0/1367065743 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8100bc810 0x7ff8101d5eb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff7f80011e0 tx=0x7ff7f800cb00 comp rx=0 tx=0).stop 2023-07-12T02:03:03.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.884+0000 7ff816145700 1 -- 172.21.15.60:0/1367065743 shutdown_connections 2023-07-12T02:03:03.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.884+0000 7ff816145700 1 --2- 172.21.15.60:0/1367065743 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ff7f006ad10 0x7ff7f006d1c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:03.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.884+0000 7ff816145700 1 --2- 172.21.15.60:0/1367065743 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff8101449d0 0x7ff8101d63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:03.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.884+0000 7ff816145700 1 --2- 172.21.15.60:0/1367065743 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8100b8d90 0x7ff81014ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:03.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.884+0000 7ff816145700 1 --2- 172.21.15.60:0/1367065743 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8100bc810 0x7ff8101d5eb0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:03.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.884+0000 7ff816145700 1 -- 172.21.15.60:0/1367065743 >> 172.21.15.60:0/1367065743 conn(0x7ff8100c0860 msgr2=0x7ff8100baeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:03.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.884+0000 7ff816145700 1 -- 172.21.15.60:0/1367065743 shutdown_connections 2023-07-12T02:03:03.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:03.884+0000 7ff816145700 1 -- 172.21.15.60:0/1367065743 wait complete. 2023-07-12T02:03:03.891 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-07-12T02:03:03.900 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2023-07-12T02:03:03.813086+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":78,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219932,"kb_used_data":3724,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754788,"statfs":{"total":773094113280,"available":772868902912,"internally_reserved":0,"allocated":3813376,"data_stored":2220975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001179"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.559439+0000","last_change":"2023-07-12T02:02:59.558047+0000","last_active":"2023-07-12T02:02:59.559439+0000","last_peered":"2023-07-12T02:02:59.559439+0000","last_clean":"2023-07-12T02:02:59.559439+0000","last_became_active":"2023-07-12T02:02:59.557732+0000","last_became_peered":"2023-07-12T02:02:59.557732+0000","last_unstale":"2023-07-12T02:02:59.559439+0000","last_undegraded":"2023-07-12T02:02:59.559439+0000","last_fullsized":"2023-07-12T02:02:59.559439+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:51:33.829119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.561703+0000","last_change":"2023-07-12T02:02:59.560472+0000","last_active":"2023-07-12T02:02:59.561703+0000","last_peered":"2023-07-12T02:02:59.561703+0000","last_clean":"2023-07-12T02:02:59.561703+0000","last_became_active":"2023-07-12T02:02:59.560054+0000","last_became_peered":"2023-07-12T02:02:59.560054+0000","last_unstale":"2023-07-12T02:02:59.561703+0000","last_undegraded":"2023-07-12T02:02:59.561703+0000","last_fullsized":"2023-07-12T02:02:59.561703+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:08:11.785175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.573076+0000","last_change":"2023-07-12T02:02:59.572463+0000","last_active":"2023-07-12T02:02:59.573076+0000","last_peered":"2023-07-12T02:02:59.573076+0000","last_clean":"2023-07-12T02:02:59.573076+0000","last_became_active":"2023-07-12T02:02:59.572124+0000","last_became_peered":"2023-07-12T02:02:59.572124+0000","last_unstale":"2023-07-12T02:02:59.573076+0000","last_undegraded":"2023-07-12T02:02:59.573076+0000","last_fullsized":"2023-07-12T02:02:59.573076+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:43:49.406023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.568016+0000","last_change":"2023-07-12T02:02:59.564720+0000","last_active":"2023-07-12T02:02:59.568016+0000","last_peered":"2023-07-12T02:02:59.568016+0000","last_clean":"2023-07-12T02:02:59.568016+0000","last_became_active":"2023-07-12T02:02:59.564391+0000","last_became_peered":"2023-07-12T02:02:59.564391+0000","last_unstale":"2023-07-12T02:02:59.568016+0000","last_undegraded":"2023-07-12T02:02:59.568016+0000","last_fullsized":"2023-07-12T02:02:59.568016+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:08:52.046294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.568985+0000","last_change":"2023-07-12T02:02:59.568514+0000","last_active":"2023-07-12T02:02:59.568985+0000","last_peered":"2023-07-12T02:02:59.568985+0000","last_clean":"2023-07-12T02:02:59.568985+0000","last_became_active":"2023-07-12T02:02:59.568290+0000","last_became_peered":"2023-07-12T02:02:59.568290+0000","last_unstale":"2023-07-12T02:02:59.568985+0000","last_undegraded":"2023-07-12T02:02:59.568985+0000","last_fullsized":"2023-07-12T02:02:59.568985+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:45:27.805300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.556902+0000","last_change":"2023-07-12T02:02:59.555138+0000","last_active":"2023-07-12T02:02:59.556902+0000","last_peered":"2023-07-12T02:02:59.556902+0000","last_clean":"2023-07-12T02:02:59.556902+0000","last_became_active":"2023-07-12T02:02:59.554814+0000","last_became_peered":"2023-07-12T02:02:59.554814+0000","last_unstale":"2023-07-12T02:02:59.556902+0000","last_undegraded":"2023-07-12T02:02:59.556902+0000","last_fullsized":"2023-07-12T02:02:59.556902+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:34:56.951150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.571839+0000","last_change":"2023-07-12T02:02:59.568009+0000","last_active":"2023-07-12T02:02:59.571839+0000","last_peered":"2023-07-12T02:02:59.571839+0000","last_clean":"2023-07-12T02:02:59.571839+0000","last_became_active":"2023-07-12T02:02:59.567713+0000","last_became_peered":"2023-07-12T02:02:59.567713+0000","last_unstale":"2023-07-12T02:02:59.571839+0000","last_undegraded":"2023-07-12T02:02:59.571839+0000","last_fullsized":"2023-07-12T02:02:59.571839+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:52:42.090173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.567556+0000","last_change":"2023-07-12T02:02:59.565881+0000","last_active":"2023-07-12T02:02:59.567556+0000","last_peered":"2023-07-12T02:02:59.567556+0000","last_clean":"2023-07-12T02:02:59.567556+0000","last_became_active":"2023-07-12T02:02:59.565431+0000","last_became_peered":"2023-07-12T02:02:59.565431+0000","last_unstale":"2023-07-12T02:02:59.567556+0000","last_undegraded":"2023-07-12T02:02:59.567556+0000","last_fullsized":"2023-07-12T02:02:59.567556+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:15:36.117000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.568453+0000","last_change":"2023-07-12T02:02:59.567621+0000","last_active":"2023-07-12T02:02:59.568453+0000","last_peered":"2023-07-12T02:02:59.568453+0000","last_clean":"2023-07-12T02:02:59.568453+0000","last_became_active":"2023-07-12T02:02:59.566138+0000","last_became_peered":"2023-07-12T02:02:59.566138+0000","last_unstale":"2023-07-12T02:02:59.568453+0000","last_undegraded":"2023-07-12T02:02:59.568453+0000","last_fullsized":"2023-07-12T02:02:59.568453+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:02:42.075914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.575609+0000","last_change":"2023-07-12T02:02:59.572479+0000","last_active":"2023-07-12T02:02:59.575609+0000","last_peered":"2023-07-12T02:02:59.575609+0000","last_clean":"2023-07-12T02:02:59.575609+0000","last_became_active":"2023-07-12T02:02:59.572011+0000","last_became_peered":"2023-07-12T02:02:59.572011+0000","last_unstale":"2023-07-12T02:02:59.575609+0000","last_undegraded":"2023-07-12T02:02:59.575609+0000","last_fullsized":"2023-07-12T02:02:59.575609+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:15:48.234565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.573710+0000","last_change":"2023-07-12T02:02:59.571341+0000","last_active":"2023-07-12T02:02:59.573710+0000","last_peered":"2023-07-12T02:02:59.573710+0000","last_clean":"2023-07-12T02:02:59.573710+0000","last_became_active":"2023-07-12T02:02:59.570608+0000","last_became_peered":"2023-07-12T02:02:59.570608+0000","last_unstale":"2023-07-12T02:02:59.573710+0000","last_undegraded":"2023-07-12T02:02:59.573710+0000","last_fullsized":"2023-07-12T02:02:59.573710+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:08:12.645684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.558597+0000","last_change":"2023-07-12T02:02:59.557488+0000","last_active":"2023-07-12T02:02:59.558597+0000","last_peered":"2023-07-12T02:02:59.558597+0000","last_clean":"2023-07-12T02:02:59.558597+0000","last_became_active":"2023-07-12T02:02:59.556981+0000","last_became_peered":"2023-07-12T02:02:59.556981+0000","last_unstale":"2023-07-12T02:02:59.558597+0000","last_undegraded":"2023-07-12T02:02:59.558597+0000","last_fullsized":"2023-07-12T02:02:59.558597+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:22:41.444974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.578377+0000","last_change":"2023-07-12T02:02:59.574458+0000","last_active":"2023-07-12T02:02:59.578377+0000","last_peered":"2023-07-12T02:02:59.578377+0000","last_clean":"2023-07-12T02:02:59.578377+0000","last_became_active":"2023-07-12T02:02:59.574230+0000","last_became_peered":"2023-07-12T02:02:59.574230+0000","last_unstale":"2023-07-12T02:02:59.578377+0000","last_undegraded":"2023-07-12T02:02:59.578377+0000","last_fullsized":"2023-07-12T02:02:59.578377+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:51:33.829119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.583777+0000","last_change":"2023-07-12T02:02:59.580718+0000","last_active":"2023-07-12T02:02:59.583777+0000","last_peered":"2023-07-12T02:02:59.583777+0000","last_clean":"2023-07-12T02:02:59.583777+0000","last_became_active":"2023-07-12T02:02:59.580429+0000","last_became_peered":"2023-07-12T02:02:59.580429+0000","last_unstale":"2023-07-12T02:02:59.583777+0000","last_undegraded":"2023-07-12T02:02:59.583777+0000","last_fullsized":"2023-07-12T02:02:59.583777+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:15:46.913037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.575636+0000","last_change":"2023-07-12T02:02:59.572667+0000","last_active":"2023-07-12T02:02:59.575636+0000","last_peered":"2023-07-12T02:02:59.575636+0000","last_clean":"2023-07-12T02:02:59.575636+0000","last_became_active":"2023-07-12T02:02:59.572273+0000","last_became_peered":"2023-07-12T02:02:59.572273+0000","last_unstale":"2023-07-12T02:02:59.575636+0000","last_undegraded":"2023-07-12T02:02:59.575636+0000","last_fullsized":"2023-07-12T02:02:59.575636+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:06:35.297037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.576116+0000","last_change":"2023-07-12T02:02:59.572614+0000","last_active":"2023-07-12T02:02:59.576116+0000","last_peered":"2023-07-12T02:02:59.576116+0000","last_clean":"2023-07-12T02:02:59.576116+0000","last_became_active":"2023-07-12T02:02:59.572332+0000","last_became_peered":"2023-07-12T02:02:59.572332+0000","last_unstale":"2023-07-12T02:02:59.576116+0000","last_undegraded":"2023-07-12T02:02:59.576116+0000","last_fullsized":"2023-07-12T02:02:59.576116+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:15:36.117000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.573769+0000","last_change":"2023-07-12T02:02:59.565386+0000","last_active":"2023-07-12T02:02:59.573769+0000","last_peered":"2023-07-12T02:02:59.573769+0000","last_clean":"2023-07-12T02:02:59.573769+0000","last_became_active":"2023-07-12T02:02:59.565020+0000","last_became_peered":"2023-07-12T02:02:59.565020+0000","last_unstale":"2023-07-12T02:02:59.573769+0000","last_undegraded":"2023-07-12T02:02:59.573769+0000","last_fullsized":"2023-07-12T02:02:59.573769+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:16:22.664572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.581990+0000","last_change":"2023-07-12T02:02:59.579718+0000","last_active":"2023-07-12T02:02:59.581990+0000","last_peered":"2023-07-12T02:02:59.581990+0000","last_clean":"2023-07-12T02:02:59.581990+0000","last_became_active":"2023-07-12T02:02:59.578619+0000","last_became_peered":"2023-07-12T02:02:59.578619+0000","last_unstale":"2023-07-12T02:02:59.581990+0000","last_undegraded":"2023-07-12T02:02:59.581990+0000","last_fullsized":"2023-07-12T02:02:59.581990+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:43:49.406023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.556761+0000","last_change":"2023-07-12T02:02:59.555390+0000","last_active":"2023-07-12T02:02:59.556761+0000","last_peered":"2023-07-12T02:02:59.556761+0000","last_clean":"2023-07-12T02:02:59.556761+0000","last_became_active":"2023-07-12T02:02:59.555099+0000","last_became_peered":"2023-07-12T02:02:59.555099+0000","last_unstale":"2023-07-12T02:02:59.556761+0000","last_undegraded":"2023-07-12T02:02:59.556761+0000","last_fullsized":"2023-07-12T02:02:59.556761+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:34:50.019256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.581794+0000","last_change":"2023-07-12T02:02:59.578790+0000","last_active":"2023-07-12T02:02:59.581794+0000","last_peered":"2023-07-12T02:02:59.581794+0000","last_clean":"2023-07-12T02:02:59.581794+0000","last_became_active":"2023-07-12T02:02:59.578469+0000","last_became_peered":"2023-07-12T02:02:59.578469+0000","last_unstale":"2023-07-12T02:02:59.581794+0000","last_undegraded":"2023-07-12T02:02:59.581794+0000","last_fullsized":"2023-07-12T02:02:59.581794+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:45:11.343394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.573436+0000","last_change":"2023-07-12T02:02:59.571326+0000","last_active":"2023-07-12T02:02:59.573436+0000","last_peered":"2023-07-12T02:02:59.573436+0000","last_clean":"2023-07-12T02:02:59.573436+0000","last_became_active":"2023-07-12T02:02:59.570998+0000","last_became_peered":"2023-07-12T02:02:59.570998+0000","last_unstale":"2023-07-12T02:02:59.573436+0000","last_undegraded":"2023-07-12T02:02:59.573436+0000","last_fullsized":"2023-07-12T02:02:59.573436+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:33:38.199777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.572572+0000","last_change":"2023-07-12T02:02:59.570301+0000","last_active":"2023-07-12T02:02:59.572572+0000","last_peered":"2023-07-12T02:02:59.572572+0000","last_clean":"2023-07-12T02:02:59.572572+0000","last_became_active":"2023-07-12T02:02:59.569983+0000","last_became_peered":"2023-07-12T02:02:59.569983+0000","last_unstale":"2023-07-12T02:02:59.572572+0000","last_undegraded":"2023-07-12T02:02:59.572572+0000","last_fullsized":"2023-07-12T02:02:59.572572+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:49:08.422815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.573239+0000","last_change":"2023-07-12T02:02:59.562297+0000","last_active":"2023-07-12T02:02:59.573239+0000","last_peered":"2023-07-12T02:02:59.573239+0000","last_clean":"2023-07-12T02:02:59.573239+0000","last_became_active":"2023-07-12T02:02:59.561815+0000","last_became_peered":"2023-07-12T02:02:59.561815+0000","last_unstale":"2023-07-12T02:02:59.573239+0000","last_undegraded":"2023-07-12T02:02:59.573239+0000","last_fullsized":"2023-07-12T02:02:59.573239+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:15:46.913037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.568361+0000","last_change":"2023-07-12T02:02:59.567242+0000","last_active":"2023-07-12T02:02:59.568361+0000","last_peered":"2023-07-12T02:02:59.568361+0000","last_clean":"2023-07-12T02:02:59.568361+0000","last_became_active":"2023-07-12T02:02:59.567010+0000","last_became_peered":"2023-07-12T02:02:59.567010+0000","last_unstale":"2023-07-12T02:02:59.568361+0000","last_undegraded":"2023-07-12T02:02:59.568361+0000","last_fullsized":"2023-07-12T02:02:59.568361+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:30:10.003599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.580534+0000","last_change":"2023-07-12T02:02:59.575779+0000","last_active":"2023-07-12T02:02:59.580534+0000","last_peered":"2023-07-12T02:02:59.580534+0000","last_clean":"2023-07-12T02:02:59.580534+0000","last_became_active":"2023-07-12T02:02:59.575512+0000","last_became_peered":"2023-07-12T02:02:59.575512+0000","last_unstale":"2023-07-12T02:02:59.580534+0000","last_undegraded":"2023-07-12T02:02:59.580534+0000","last_fullsized":"2023-07-12T02:02:59.580534+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:22:41.444974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.571826+0000","last_change":"2023-07-12T02:02:59.570259+0000","last_active":"2023-07-12T02:02:59.571826+0000","last_peered":"2023-07-12T02:02:59.571826+0000","last_clean":"2023-07-12T02:02:59.571826+0000","last_became_active":"2023-07-12T02:02:59.569976+0000","last_became_peered":"2023-07-12T02:02:59.569976+0000","last_unstale":"2023-07-12T02:02:59.571826+0000","last_undegraded":"2023-07-12T02:02:59.571826+0000","last_fullsized":"2023-07-12T02:02:59.571826+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:14:16.615559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.580601+0000","last_change":"2023-07-12T02:02:59.578653+0000","last_active":"2023-07-12T02:02:59.580601+0000","last_peered":"2023-07-12T02:02:59.580601+0000","last_clean":"2023-07-12T02:02:59.580601+0000","last_became_active":"2023-07-12T02:02:59.578327+0000","last_became_peered":"2023-07-12T02:02:59.578327+0000","last_unstale":"2023-07-12T02:02:59.580601+0000","last_undegraded":"2023-07-12T02:02:59.580601+0000","last_fullsized":"2023-07-12T02:02:59.580601+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:02:42.075914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.571032+0000","last_change":"2023-07-12T02:02:59.568291+0000","last_active":"2023-07-12T02:02:59.571032+0000","last_peered":"2023-07-12T02:02:59.571032+0000","last_clean":"2023-07-12T02:02:59.571032+0000","last_became_active":"2023-07-12T02:02:59.568008+0000","last_became_peered":"2023-07-12T02:02:59.568008+0000","last_unstale":"2023-07-12T02:02:59.571032+0000","last_undegraded":"2023-07-12T02:02:59.571032+0000","last_fullsized":"2023-07-12T02:02:59.571032+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:33:44.055703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.581055+0000","last_change":"2023-07-12T02:02:59.578645+0000","last_active":"2023-07-12T02:02:59.581055+0000","last_peered":"2023-07-12T02:02:59.581055+0000","last_clean":"2023-07-12T02:02:59.581055+0000","last_became_active":"2023-07-12T02:02:59.578336+0000","last_became_peered":"2023-07-12T02:02:59.578336+0000","last_unstale":"2023-07-12T02:02:59.581055+0000","last_undegraded":"2023-07-12T02:02:59.581055+0000","last_fullsized":"2023-07-12T02:02:59.581055+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:40:45.050634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.583490+0000","last_change":"2023-07-12T02:02:59.580348+0000","last_active":"2023-07-12T02:02:59.583490+0000","last_peered":"2023-07-12T02:02:59.583490+0000","last_clean":"2023-07-12T02:02:59.583490+0000","last_became_active":"2023-07-12T02:02:59.580083+0000","last_became_peered":"2023-07-12T02:02:59.580083+0000","last_unstale":"2023-07-12T02:02:59.583490+0000","last_undegraded":"2023-07-12T02:02:59.583490+0000","last_fullsized":"2023-07-12T02:02:59.583490+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:59:14.382477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.573216+0000","last_change":"2023-07-12T02:02:59.562112+0000","last_active":"2023-07-12T02:02:59.573216+0000","last_peered":"2023-07-12T02:02:59.573216+0000","last_clean":"2023-07-12T02:02:59.573216+0000","last_became_active":"2023-07-12T02:02:59.561438+0000","last_became_peered":"2023-07-12T02:02:59.561438+0000","last_unstale":"2023-07-12T02:02:59.573216+0000","last_undegraded":"2023-07-12T02:02:59.573216+0000","last_fullsized":"2023-07-12T02:02:59.573216+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:51:33.829119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.560758+0000","last_change":"2023-07-12T02:02:59.559046+0000","last_active":"2023-07-12T02:02:59.560758+0000","last_peered":"2023-07-12T02:02:59.560758+0000","last_clean":"2023-07-12T02:02:59.560758+0000","last_became_active":"2023-07-12T02:02:59.558767+0000","last_became_peered":"2023-07-12T02:02:59.558767+0000","last_unstale":"2023-07-12T02:02:59.560758+0000","last_undegraded":"2023-07-12T02:02:59.560758+0000","last_fullsized":"2023-07-12T02:02:59.560758+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:39:13.128525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.573900+0000","last_change":"2023-07-12T02:02:59.565390+0000","last_active":"2023-07-12T02:02:59.573900+0000","last_peered":"2023-07-12T02:02:59.573900+0000","last_clean":"2023-07-12T02:02:59.573900+0000","last_became_active":"2023-07-12T02:02:59.565056+0000","last_became_peered":"2023-07-12T02:02:59.565056+0000","last_unstale":"2023-07-12T02:02:59.573900+0000","last_undegraded":"2023-07-12T02:02:59.573900+0000","last_fullsized":"2023-07-12T02:02:59.573900+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:39:07.369352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"30'4","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.776959+0000","last_change":"2023-07-12T02:02:58.562862+0000","last_active":"2023-07-12T02:02:59.776959+0000","last_peered":"2023-07-12T02:02:59.776959+0000","last_clean":"2023-07-12T02:02:59.776959+0000","last_became_active":"2023-07-12T02:02:58.562511+0000","last_became_peered":"2023-07-12T02:02:58.562511+0000","last_unstale":"2023-07-12T02:02:59.776959+0000","last_undegraded":"2023-07-12T02:02:59.776959+0000","last_fullsized":"2023-07-12T02:02:59.776959+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:27:11.423405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.573565+0000","last_change":"2023-07-12T02:02:59.572424+0000","last_active":"2023-07-12T02:02:59.573565+0000","last_peered":"2023-07-12T02:02:59.573565+0000","last_clean":"2023-07-12T02:02:59.573565+0000","last_became_active":"2023-07-12T02:02:59.572142+0000","last_became_peered":"2023-07-12T02:02:59.572142+0000","last_unstale":"2023-07-12T02:02:59.573565+0000","last_undegraded":"2023-07-12T02:02:59.573565+0000","last_fullsized":"2023-07-12T02:02:59.573565+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:44:56.455022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"30'1","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.773294+0000","last_change":"2023-07-12T02:02:58.557172+0000","last_active":"2023-07-12T02:02:59.773294+0000","last_peered":"2023-07-12T02:02:59.773294+0000","last_clean":"2023-07-12T02:02:59.773294+0000","last_became_active":"2023-07-12T02:02:58.556880+0000","last_became_peered":"2023-07-12T02:02:58.556880+0000","last_unstale":"2023-07-12T02:02:59.773294+0000","last_undegraded":"2023-07-12T02:02:59.773294+0000","last_fullsized":"2023-07-12T02:02:59.773294+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:53:22.002257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.583758+0000","last_change":"2023-07-12T02:02:59.580721+0000","last_active":"2023-07-12T02:02:59.583758+0000","last_peered":"2023-07-12T02:02:59.583758+0000","last_clean":"2023-07-12T02:02:59.583758+0000","last_became_active":"2023-07-12T02:02:59.580232+0000","last_became_peered":"2023-07-12T02:02:59.580232+0000","last_unstale":"2023-07-12T02:02:59.583758+0000","last_undegraded":"2023-07-12T02:02:59.583758+0000","last_fullsized":"2023-07-12T02:02:59.583758+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:21:03.713062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.776690+0000","last_change":"2023-07-12T02:02:58.558486+0000","last_active":"2023-07-12T02:02:59.776690+0000","last_peered":"2023-07-12T02:02:59.776690+0000","last_clean":"2023-07-12T02:02:59.776690+0000","last_became_active":"2023-07-12T02:02:58.558168+0000","last_became_peered":"2023-07-12T02:02:58.558168+0000","last_unstale":"2023-07-12T02:02:59.776690+0000","last_undegraded":"2023-07-12T02:02:59.776690+0000","last_fullsized":"2023-07-12T02:02:59.776690+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:35:29.605485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.580027+0000","last_change":"2023-07-12T02:02:59.579212+0000","last_active":"2023-07-12T02:02:59.580027+0000","last_peered":"2023-07-12T02:02:59.580027+0000","last_clean":"2023-07-12T02:02:59.580027+0000","last_became_active":"2023-07-12T02:02:59.578911+0000","last_became_peered":"2023-07-12T02:02:59.578911+0000","last_unstale":"2023-07-12T02:02:59.580027+0000","last_undegraded":"2023-07-12T02:02:59.580027+0000","last_fullsized":"2023-07-12T02:02:59.580027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:06:35.297037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.774325+0000","last_change":"2023-07-12T02:02:58.561207+0000","last_active":"2023-07-12T02:02:59.774325+0000","last_peered":"2023-07-12T02:02:59.774325+0000","last_clean":"2023-07-12T02:02:59.774325+0000","last_became_active":"2023-07-12T02:02:58.560943+0000","last_became_peered":"2023-07-12T02:02:58.560943+0000","last_unstale":"2023-07-12T02:02:59.774325+0000","last_undegraded":"2023-07-12T02:02:59.774325+0000","last_fullsized":"2023-07-12T02:02:59.774325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:38:49.902838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.558075+0000","last_change":"2023-07-12T02:02:59.556391+0000","last_active":"2023-07-12T02:02:59.558075+0000","last_peered":"2023-07-12T02:02:59.558075+0000","last_clean":"2023-07-12T02:02:59.558075+0000","last_became_active":"2023-07-12T02:02:59.556072+0000","last_became_peered":"2023-07-12T02:02:59.556072+0000","last_unstale":"2023-07-12T02:02:59.558075+0000","last_undegraded":"2023-07-12T02:02:59.558075+0000","last_fullsized":"2023-07-12T02:02:59.558075+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:58:17.489328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"30'1","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.771505+0000","last_change":"2023-07-12T02:02:58.566848+0000","last_active":"2023-07-12T02:02:59.771505+0000","last_peered":"2023-07-12T02:02:59.771505+0000","last_clean":"2023-07-12T02:02:59.771505+0000","last_became_active":"2023-07-12T02:02:58.566555+0000","last_became_peered":"2023-07-12T02:02:58.566555+0000","last_unstale":"2023-07-12T02:02:59.771505+0000","last_undegraded":"2023-07-12T02:02:59.771505+0000","last_fullsized":"2023-07-12T02:02:59.771505+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:15:35.112371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.575615+0000","last_change":"2023-07-12T02:02:59.572509+0000","last_active":"2023-07-12T02:02:59.575615+0000","last_peered":"2023-07-12T02:02:59.575615+0000","last_clean":"2023-07-12T02:02:59.575615+0000","last_became_active":"2023-07-12T02:02:59.571975+0000","last_became_peered":"2023-07-12T02:02:59.571975+0000","last_unstale":"2023-07-12T02:02:59.575615+0000","last_undegraded":"2023-07-12T02:02:59.575615+0000","last_fullsized":"2023-07-12T02:02:59.575615+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:28:51.264553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"30'1","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.776631+0000","last_change":"2023-07-12T02:02:58.567036+0000","last_active":"2023-07-12T02:02:59.776631+0000","last_peered":"2023-07-12T02:02:59.776631+0000","last_clean":"2023-07-12T02:02:59.776631+0000","last_became_active":"2023-07-12T02:02:58.566735+0000","last_became_peered":"2023-07-12T02:02:58.566735+0000","last_unstale":"2023-07-12T02:02:59.776631+0000","last_undegraded":"2023-07-12T02:02:59.776631+0000","last_fullsized":"2023-07-12T02:02:59.776631+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:26:14.131067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.575342+0000","last_change":"2023-07-12T02:02:59.571834+0000","last_active":"2023-07-12T02:02:59.575342+0000","last_peered":"2023-07-12T02:02:59.575342+0000","last_clean":"2023-07-12T02:02:59.575342+0000","last_became_active":"2023-07-12T02:02:59.571528+0000","last_became_peered":"2023-07-12T02:02:59.571528+0000","last_unstale":"2023-07-12T02:02:59.575342+0000","last_undegraded":"2023-07-12T02:02:59.575342+0000","last_fullsized":"2023-07-12T02:02:59.575342+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:29:25.515660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.551470+0000","last_change":"2023-07-12T02:02:58.564466+0000","last_active":"2023-07-12T02:02:59.551470+0000","last_peered":"2023-07-12T02:02:59.551470+0000","last_clean":"2023-07-12T02:02:59.551470+0000","last_became_active":"2023-07-12T02:02:58.564212+0000","last_became_peered":"2023-07-12T02:02:58.564212+0000","last_unstale":"2023-07-12T02:02:59.551470+0000","last_undegraded":"2023-07-12T02:02:59.551470+0000","last_fullsized":"2023-07-12T02:02:59.551470+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:53:22.002257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.567584+0000","last_change":"2023-07-12T02:02:59.566022+0000","last_active":"2023-07-12T02:02:59.567584+0000","last_peered":"2023-07-12T02:02:59.567584+0000","last_clean":"2023-07-12T02:02:59.567584+0000","last_became_active":"2023-07-12T02:02:59.565219+0000","last_became_peered":"2023-07-12T02:02:59.565219+0000","last_unstale":"2023-07-12T02:02:59.567584+0000","last_undegraded":"2023-07-12T02:02:59.567584+0000","last_fullsized":"2023-07-12T02:02:59.567584+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:29:59.291038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.563304+0000","last_change":"2023-07-12T02:02:58.563422+0000","last_active":"2023-07-12T02:02:59.563304+0000","last_peered":"2023-07-12T02:02:59.563304+0000","last_clean":"2023-07-12T02:02:59.563304+0000","last_became_active":"2023-07-12T02:02:58.563188+0000","last_became_peered":"2023-07-12T02:02:58.563188+0000","last_unstale":"2023-07-12T02:02:59.563304+0000","last_undegraded":"2023-07-12T02:02:59.563304+0000","last_fullsized":"2023-07-12T02:02:59.563304+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:39:06.364723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.567980+0000","last_change":"2023-07-12T02:02:59.564695+0000","last_active":"2023-07-12T02:02:59.567980+0000","last_peered":"2023-07-12T02:02:59.567980+0000","last_clean":"2023-07-12T02:02:59.567980+0000","last_became_active":"2023-07-12T02:02:59.564363+0000","last_became_peered":"2023-07-12T02:02:59.564363+0000","last_unstale":"2023-07-12T02:02:59.567980+0000","last_undegraded":"2023-07-12T02:02:59.567980+0000","last_fullsized":"2023-07-12T02:02:59.567980+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:29:44.990982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.550143+0000","last_change":"2023-07-12T02:02:58.563378+0000","last_active":"2023-07-12T02:02:59.550143+0000","last_peered":"2023-07-12T02:02:59.550143+0000","last_clean":"2023-07-12T02:02:59.550143+0000","last_became_active":"2023-07-12T02:02:58.563063+0000","last_became_peered":"2023-07-12T02:02:58.563063+0000","last_unstale":"2023-07-12T02:02:59.550143+0000","last_undegraded":"2023-07-12T02:02:59.550143+0000","last_fullsized":"2023-07-12T02:02:59.550143+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:39:06.364723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.582105+0000","last_change":"2023-07-12T02:02:59.579277+0000","last_active":"2023-07-12T02:02:59.582105+0000","last_peered":"2023-07-12T02:02:59.582105+0000","last_clean":"2023-07-12T02:02:59.582105+0000","last_became_active":"2023-07-12T02:02:59.578986+0000","last_became_peered":"2023-07-12T02:02:59.578986+0000","last_unstale":"2023-07-12T02:02:59.582105+0000","last_undegraded":"2023-07-12T02:02:59.582105+0000","last_fullsized":"2023-07-12T02:02:59.582105+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:08:11.785175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.563710+0000","last_change":"2023-07-12T02:02:58.558533+0000","last_active":"2023-07-12T02:02:59.563710+0000","last_peered":"2023-07-12T02:02:59.563710+0000","last_clean":"2023-07-12T02:02:59.563710+0000","last_became_active":"2023-07-12T02:02:58.558236+0000","last_became_peered":"2023-07-12T02:02:58.558236+0000","last_unstale":"2023-07-12T02:02:59.563710+0000","last_undegraded":"2023-07-12T02:02:59.563710+0000","last_fullsized":"2023-07-12T02:02:59.563710+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:52:35.669198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.566837+0000","last_change":"2023-07-12T02:02:59.565661+0000","last_active":"2023-07-12T02:02:59.566837+0000","last_peered":"2023-07-12T02:02:59.566837+0000","last_clean":"2023-07-12T02:02:59.566837+0000","last_became_active":"2023-07-12T02:02:59.565344+0000","last_became_peered":"2023-07-12T02:02:59.565344+0000","last_unstale":"2023-07-12T02:02:59.566837+0000","last_undegraded":"2023-07-12T02:02:59.566837+0000","last_fullsized":"2023-07-12T02:02:59.566837+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:16:47.936459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"30'3","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.773624+0000","last_change":"2023-07-12T02:02:58.561006+0000","last_active":"2023-07-12T02:02:59.773624+0000","last_peered":"2023-07-12T02:02:59.773624+0000","last_clean":"2023-07-12T02:02:59.773624+0000","last_became_active":"2023-07-12T02:02:58.560710+0000","last_became_peered":"2023-07-12T02:02:58.560710+0000","last_unstale":"2023-07-12T02:02:59.773624+0000","last_undegraded":"2023-07-12T02:02:59.773624+0000","last_fullsized":"2023-07-12T02:02:59.773624+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:29:24.511031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.571263+0000","last_change":"2023-07-12T02:02:59.568522+0000","last_active":"2023-07-12T02:02:59.571263+0000","last_peered":"2023-07-12T02:02:59.571263+0000","last_clean":"2023-07-12T02:02:59.571263+0000","last_became_active":"2023-07-12T02:02:59.568248+0000","last_became_peered":"2023-07-12T02:02:59.568248+0000","last_unstale":"2023-07-12T02:02:59.571263+0000","last_undegraded":"2023-07-12T02:02:59.571263+0000","last_fullsized":"2023-07-12T02:02:59.571263+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:06:35.297037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"30'6","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.779461+0000","last_change":"2023-07-12T02:02:58.569082+0000","last_active":"2023-07-12T02:02:59.779461+0000","last_peered":"2023-07-12T02:02:59.779461+0000","last_clean":"2023-07-12T02:02:59.779461+0000","last_became_active":"2023-07-12T02:02:58.568787+0000","last_became_peered":"2023-07-12T02:02:58.568787+0000","last_unstale":"2023-07-12T02:02:59.779461+0000","last_undegraded":"2023-07-12T02:02:59.779461+0000","last_fullsized":"2023-07-12T02:02:59.779461+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:06:10.377475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.567808+0000","last_change":"2023-07-12T02:02:59.565940+0000","last_active":"2023-07-12T02:02:59.567808+0000","last_peered":"2023-07-12T02:02:59.567808+0000","last_clean":"2023-07-12T02:02:59.567808+0000","last_became_active":"2023-07-12T02:02:59.565357+0000","last_became_peered":"2023-07-12T02:02:59.565357+0000","last_unstale":"2023-07-12T02:02:59.567808+0000","last_undegraded":"2023-07-12T02:02:59.567808+0000","last_fullsized":"2023-07-12T02:02:59.567808+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:27:12.428034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.773144+0000","last_change":"2023-07-12T02:02:58.555830+0000","last_active":"2023-07-12T02:02:59.773144+0000","last_peered":"2023-07-12T02:02:59.773144+0000","last_clean":"2023-07-12T02:02:59.773144+0000","last_became_active":"2023-07-12T02:02:58.555545+0000","last_became_peered":"2023-07-12T02:02:58.555545+0000","last_unstale":"2023-07-12T02:02:59.773144+0000","last_undegraded":"2023-07-12T02:02:59.773144+0000","last_fullsized":"2023-07-12T02:02:59.773144+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:16:21.659942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.559341+0000","last_change":"2023-07-12T02:02:59.557738+0000","last_active":"2023-07-12T02:02:59.559341+0000","last_peered":"2023-07-12T02:02:59.559341+0000","last_clean":"2023-07-12T02:02:59.559341+0000","last_became_active":"2023-07-12T02:02:59.557407+0000","last_became_peered":"2023-07-12T02:02:59.557407+0000","last_unstale":"2023-07-12T02:02:59.559341+0000","last_undegraded":"2023-07-12T02:02:59.559341+0000","last_fullsized":"2023-07-12T02:02:59.559341+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:38:50.907467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.549790+0000","last_change":"2023-07-12T02:02:58.564573+0000","last_active":"2023-07-12T02:02:59.549790+0000","last_peered":"2023-07-12T02:02:59.549790+0000","last_clean":"2023-07-12T02:02:59.549790+0000","last_became_active":"2023-07-12T02:02:58.564274+0000","last_became_peered":"2023-07-12T02:02:58.564274+0000","last_unstale":"2023-07-12T02:02:59.549790+0000","last_undegraded":"2023-07-12T02:02:59.549790+0000","last_fullsized":"2023-07-12T02:02:59.549790+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:46:18.716604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.567390+0000","last_change":"2023-07-12T02:02:59.560613+0000","last_active":"2023-07-12T02:02:59.567390+0000","last_peered":"2023-07-12T02:02:59.567390+0000","last_clean":"2023-07-12T02:02:59.567390+0000","last_became_active":"2023-07-12T02:02:59.560305+0000","last_became_peered":"2023-07-12T02:02:59.560305+0000","last_unstale":"2023-07-12T02:02:59.567390+0000","last_undegraded":"2023-07-12T02:02:59.567390+0000","last_fullsized":"2023-07-12T02:02:59.567390+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:49:08.422815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.573074+0000","last_change":"2023-07-12T02:02:58.562876+0000","last_active":"2023-07-12T02:02:59.573074+0000","last_peered":"2023-07-12T02:02:59.573074+0000","last_clean":"2023-07-12T02:02:59.573074+0000","last_became_active":"2023-07-12T02:02:58.562550+0000","last_became_peered":"2023-07-12T02:02:58.562550+0000","last_unstale":"2023-07-12T02:02:59.573074+0000","last_undegraded":"2023-07-12T02:02:59.573074+0000","last_fullsized":"2023-07-12T02:02:59.573074+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:32:02.936782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.559273+0000","last_change":"2023-07-12T02:02:59.557705+0000","last_active":"2023-07-12T02:02:59.559273+0000","last_peered":"2023-07-12T02:02:59.559273+0000","last_clean":"2023-07-12T02:02:59.559273+0000","last_became_active":"2023-07-12T02:02:59.557386+0000","last_became_peered":"2023-07-12T02:02:59.557386+0000","last_unstale":"2023-07-12T02:02:59.559273+0000","last_undegraded":"2023-07-12T02:02:59.559273+0000","last_fullsized":"2023-07-12T02:02:59.559273+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:26:15.135696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"30'8","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.777547+0000","last_change":"2023-07-12T02:02:58.566814+0000","last_active":"2023-07-12T02:02:59.777547+0000","last_peered":"2023-07-12T02:02:59.777547+0000","last_clean":"2023-07-12T02:02:59.777547+0000","last_became_active":"2023-07-12T02:02:58.566478+0000","last_became_peered":"2023-07-12T02:02:58.566478+0000","last_unstale":"2023-07-12T02:02:59.777547+0000","last_undegraded":"2023-07-12T02:02:59.777547+0000","last_fullsized":"2023-07-12T02:02:59.777547+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:43:56.890330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.579755+0000","last_change":"2023-07-12T02:02:59.578931+0000","last_active":"2023-07-12T02:02:59.579755+0000","last_peered":"2023-07-12T02:02:59.579755+0000","last_clean":"2023-07-12T02:02:59.579755+0000","last_became_active":"2023-07-12T02:02:59.578640+0000","last_became_peered":"2023-07-12T02:02:59.578640+0000","last_unstale":"2023-07-12T02:02:59.579755+0000","last_undegraded":"2023-07-12T02:02:59.579755+0000","last_fullsized":"2023-07-12T02:02:59.579755+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:15:46.913037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"30'1","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.776863+0000","last_change":"2023-07-12T02:02:58.563588+0000","last_active":"2023-07-12T02:02:59.776863+0000","last_peered":"2023-07-12T02:02:59.776863+0000","last_clean":"2023-07-12T02:02:59.776863+0000","last_became_active":"2023-07-12T02:02:58.563393+0000","last_became_peered":"2023-07-12T02:02:58.563393+0000","last_unstale":"2023-07-12T02:02:59.776863+0000","last_undegraded":"2023-07-12T02:02:59.776863+0000","last_fullsized":"2023-07-12T02:02:59.776863+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:08:46.902107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.573692+0000","last_change":"2023-07-12T02:02:59.571326+0000","last_active":"2023-07-12T02:02:59.573692+0000","last_peered":"2023-07-12T02:02:59.573692+0000","last_clean":"2023-07-12T02:02:59.573692+0000","last_became_active":"2023-07-12T02:02:59.570647+0000","last_became_peered":"2023-07-12T02:02:59.570647+0000","last_unstale":"2023-07-12T02:02:59.573692+0000","last_undegraded":"2023-07-12T02:02:59.573692+0000","last_fullsized":"2023-07-12T02:02:59.573692+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:00:49.677905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.773359+0000","last_change":"2023-07-12T02:02:58.564238+0000","last_active":"2023-07-12T02:02:59.773359+0000","last_peered":"2023-07-12T02:02:59.773359+0000","last_clean":"2023-07-12T02:02:59.773359+0000","last_became_active":"2023-07-12T02:02:58.563943+0000","last_became_peered":"2023-07-12T02:02:58.563943+0000","last_unstale":"2023-07-12T02:02:59.773359+0000","last_undegraded":"2023-07-12T02:02:59.773359+0000","last_fullsized":"2023-07-12T02:02:59.773359+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:08:10.780545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.572499+0000","last_change":"2023-07-12T02:02:59.569645+0000","last_active":"2023-07-12T02:02:59.572499+0000","last_peered":"2023-07-12T02:02:59.572499+0000","last_clean":"2023-07-12T02:02:59.572499+0000","last_became_active":"2023-07-12T02:02:59.568893+0000","last_became_peered":"2023-07-12T02:02:59.568893+0000","last_unstale":"2023-07-12T02:02:59.572499+0000","last_undegraded":"2023-07-12T02:02:59.572499+0000","last_fullsized":"2023-07-12T02:02:59.572499+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:15:36.117000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"30'1","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.776771+0000","last_change":"2023-07-12T02:02:58.557603+0000","last_active":"2023-07-12T02:02:59.776771+0000","last_peered":"2023-07-12T02:02:59.776771+0000","last_clean":"2023-07-12T02:02:59.776771+0000","last_became_active":"2023-07-12T02:02:58.557264+0000","last_became_peered":"2023-07-12T02:02:58.557264+0000","last_unstale":"2023-07-12T02:02:59.776771+0000","last_undegraded":"2023-07-12T02:02:59.776771+0000","last_fullsized":"2023-07-12T02:02:59.776771+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:29:08.918299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.561401+0000","last_change":"2023-07-12T02:02:59.559169+0000","last_active":"2023-07-12T02:02:59.561401+0000","last_peered":"2023-07-12T02:02:59.561401+0000","last_clean":"2023-07-12T02:02:59.561401+0000","last_became_active":"2023-07-12T02:02:59.558860+0000","last_became_peered":"2023-07-12T02:02:59.558860+0000","last_unstale":"2023-07-12T02:02:59.561401+0000","last_undegraded":"2023-07-12T02:02:59.561401+0000","last_fullsized":"2023-07-12T02:02:59.561401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:50:20.581566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.551110+0000","last_change":"2023-07-12T02:02:58.558243+0000","last_active":"2023-07-12T02:02:59.551110+0000","last_peered":"2023-07-12T02:02:59.551110+0000","last_clean":"2023-07-12T02:02:59.551110+0000","last_became_active":"2023-07-12T02:02:58.557959+0000","last_became_peered":"2023-07-12T02:02:58.557959+0000","last_unstale":"2023-07-12T02:02:59.551110+0000","last_undegraded":"2023-07-12T02:02:59.551110+0000","last_fullsized":"2023-07-12T02:02:59.551110+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:27:10.617108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.573756+0000","last_change":"2023-07-12T02:02:59.562520+0000","last_active":"2023-07-12T02:02:59.573756+0000","last_peered":"2023-07-12T02:02:59.573756+0000","last_clean":"2023-07-12T02:02:59.573756+0000","last_became_active":"2023-07-12T02:02:59.562205+0000","last_became_peered":"2023-07-12T02:02:59.562205+0000","last_unstale":"2023-07-12T02:02:59.573756+0000","last_undegraded":"2023-07-12T02:02:59.573756+0000","last_fullsized":"2023-07-12T02:02:59.573756+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:00:49.677905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.772289+0000","last_change":"2023-07-12T02:02:58.553955+0000","last_active":"2023-07-12T02:02:59.772289+0000","last_peered":"2023-07-12T02:02:59.772289+0000","last_clean":"2023-07-12T02:02:59.772289+0000","last_became_active":"2023-07-12T02:02:58.553638+0000","last_became_peered":"2023-07-12T02:02:58.553638+0000","last_unstale":"2023-07-12T02:02:59.772289+0000","last_undegraded":"2023-07-12T02:02:59.772289+0000","last_fullsized":"2023-07-12T02:02:59.772289+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:49:24.910550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.567964+0000","last_change":"2023-07-12T02:02:59.567398+0000","last_active":"2023-07-12T02:02:59.567964+0000","last_peered":"2023-07-12T02:02:59.567964+0000","last_clean":"2023-07-12T02:02:59.567964+0000","last_became_active":"2023-07-12T02:02:59.566080+0000","last_became_peered":"2023-07-12T02:02:59.566080+0000","last_unstale":"2023-07-12T02:02:59.567964+0000","last_undegraded":"2023-07-12T02:02:59.567964+0000","last_fullsized":"2023-07-12T02:02:59.567964+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:40:45.050634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.549173+0000","last_change":"2023-07-12T02:02:58.558296+0000","last_active":"2023-07-12T02:02:59.549173+0000","last_peered":"2023-07-12T02:02:59.549173+0000","last_clean":"2023-07-12T02:02:59.549173+0000","last_became_active":"2023-07-12T02:02:58.558054+0000","last_became_peered":"2023-07-12T02:02:58.558054+0000","last_unstale":"2023-07-12T02:02:59.549173+0000","last_undegraded":"2023-07-12T02:02:59.549173+0000","last_fullsized":"2023-07-12T02:02:59.549173+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:36:44.738971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.583819+0000","last_change":"2023-07-12T02:02:59.581474+0000","last_active":"2023-07-12T02:02:59.583819+0000","last_peered":"2023-07-12T02:02:59.583819+0000","last_clean":"2023-07-12T02:02:59.583819+0000","last_became_active":"2023-07-12T02:02:59.581173+0000","last_became_peered":"2023-07-12T02:02:59.581173+0000","last_unstale":"2023-07-12T02:02:59.583819+0000","last_undegraded":"2023-07-12T02:02:59.583819+0000","last_fullsized":"2023-07-12T02:02:59.583819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:22:20.122017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.548500+0000","last_change":"2023-07-12T02:02:58.566812+0000","last_active":"2023-07-12T02:02:59.548500+0000","last_peered":"2023-07-12T02:02:59.548500+0000","last_clean":"2023-07-12T02:02:59.548500+0000","last_became_active":"2023-07-12T02:02:58.566520+0000","last_became_peered":"2023-07-12T02:02:58.566520+0000","last_unstale":"2023-07-12T02:02:59.548500+0000","last_undegraded":"2023-07-12T02:02:59.548500+0000","last_fullsized":"2023-07-12T02:02:59.548500+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:38:49.902838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.568009+0000","last_change":"2023-07-12T02:02:59.566614+0000","last_active":"2023-07-12T02:02:59.568009+0000","last_peered":"2023-07-12T02:02:59.568009+0000","last_clean":"2023-07-12T02:02:59.568009+0000","last_became_active":"2023-07-12T02:02:59.565626+0000","last_became_peered":"2023-07-12T02:02:59.565626+0000","last_unstale":"2023-07-12T02:02:59.568009+0000","last_undegraded":"2023-07-12T02:02:59.568009+0000","last_fullsized":"2023-07-12T02:02:59.568009+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:21:03.713062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.551257+0000","last_change":"2023-07-12T02:02:58.558396+0000","last_active":"2023-07-12T02:02:59.551257+0000","last_peered":"2023-07-12T02:02:59.551257+0000","last_clean":"2023-07-12T02:02:59.551257+0000","last_became_active":"2023-07-12T02:02:58.558078+0000","last_became_peered":"2023-07-12T02:02:58.558078+0000","last_unstale":"2023-07-12T02:02:59.551257+0000","last_undegraded":"2023-07-12T02:02:59.551257+0000","last_fullsized":"2023-07-12T02:02:59.551257+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:24:05.494239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.572554+0000","last_change":"2023-07-12T02:02:59.569480+0000","last_active":"2023-07-12T02:02:59.572554+0000","last_peered":"2023-07-12T02:02:59.572554+0000","last_clean":"2023-07-12T02:02:59.572554+0000","last_became_active":"2023-07-12T02:02:59.569222+0000","last_became_peered":"2023-07-12T02:02:59.569222+0000","last_unstale":"2023-07-12T02:02:59.572554+0000","last_undegraded":"2023-07-12T02:02:59.572554+0000","last_fullsized":"2023-07-12T02:02:59.572554+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:43:57.894959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.563349+0000","last_change":"2023-07-12T02:02:58.561287+0000","last_active":"2023-07-12T02:02:59.563349+0000","last_peered":"2023-07-12T02:02:59.563349+0000","last_clean":"2023-07-12T02:02:59.563349+0000","last_became_active":"2023-07-12T02:02:58.560993+0000","last_became_peered":"2023-07-12T02:02:58.560993+0000","last_unstale":"2023-07-12T02:02:59.563349+0000","last_undegraded":"2023-07-12T02:02:59.563349+0000","last_fullsized":"2023-07-12T02:02:59.563349+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:06:10.377475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.564335+0000","last_change":"2023-07-12T02:02:07.598601+0000","last_active":"2023-07-12T02:02:59.564335+0000","last_peered":"2023-07-12T02:02:59.564335+0000","last_clean":"2023-07-12T02:02:59.564335+0000","last_became_active":"2023-07-12T02:02:07.598343+0000","last_became_peered":"2023-07-12T02:02:07.598343+0000","last_unstale":"2023-07-12T02:02:59.564335+0000","last_undegraded":"2023-07-12T02:02:59.564335+0000","last_fullsized":"2023-07-12T02:02:59.564335+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:29:07.010645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.582123+0000","last_change":"2023-07-12T02:02:59.579519+0000","last_active":"2023-07-12T02:02:59.582123+0000","last_peered":"2023-07-12T02:02:59.582123+0000","last_clean":"2023-07-12T02:02:59.582123+0000","last_became_active":"2023-07-12T02:02:59.579198+0000","last_became_peered":"2023-07-12T02:02:59.579198+0000","last_unstale":"2023-07-12T02:02:59.582123+0000","last_undegraded":"2023-07-12T02:02:59.582123+0000","last_fullsized":"2023-07-12T02:02:59.582123+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:06:35.297037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.549909+0000","last_change":"2023-07-12T02:02:58.563389+0000","last_active":"2023-07-12T02:02:59.549909+0000","last_peered":"2023-07-12T02:02:59.549909+0000","last_clean":"2023-07-12T02:02:59.549909+0000","last_became_active":"2023-07-12T02:02:58.563092+0000","last_became_peered":"2023-07-12T02:02:58.563092+0000","last_unstale":"2023-07-12T02:02:59.549909+0000","last_undegraded":"2023-07-12T02:02:59.549909+0000","last_fullsized":"2023-07-12T02:02:59.549909+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:29:24.511031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.550408+0000","last_change":"2023-07-12T02:02:07.268647+0000","last_active":"2023-07-12T02:02:59.550408+0000","last_peered":"2023-07-12T02:02:59.550408+0000","last_clean":"2023-07-12T02:02:59.550408+0000","last_became_active":"2023-07-12T02:02:07.268304+0000","last_became_peered":"2023-07-12T02:02:07.268304+0000","last_unstale":"2023-07-12T02:02:59.550408+0000","last_undegraded":"2023-07-12T02:02:59.550408+0000","last_fullsized":"2023-07-12T02:02:59.550408+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:48:16.142421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.566528+0000","last_change":"2023-07-12T02:02:59.565240+0000","last_active":"2023-07-12T02:02:59.566528+0000","last_peered":"2023-07-12T02:02:59.566528+0000","last_clean":"2023-07-12T02:02:59.566528+0000","last_became_active":"2023-07-12T02:02:59.564928+0000","last_became_peered":"2023-07-12T02:02:59.564928+0000","last_unstale":"2023-07-12T02:02:59.566528+0000","last_undegraded":"2023-07-12T02:02:59.566528+0000","last_fullsized":"2023-07-12T02:02:59.566528+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:08:44.156931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.773352+0000","last_change":"2023-07-12T02:02:58.562579+0000","last_active":"2023-07-12T02:02:59.773352+0000","last_peered":"2023-07-12T02:02:59.773352+0000","last_clean":"2023-07-12T02:02:59.773352+0000","last_became_active":"2023-07-12T02:02:58.562303+0000","last_became_peered":"2023-07-12T02:02:58.562303+0000","last_unstale":"2023-07-12T02:02:59.773352+0000","last_undegraded":"2023-07-12T02:02:59.773352+0000","last_fullsized":"2023-07-12T02:02:59.773352+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:25:45.833837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.548914+0000","last_change":"2023-07-12T02:02:07.270653+0000","last_active":"2023-07-12T02:02:59.548914+0000","last_peered":"2023-07-12T02:02:59.548914+0000","last_clean":"2023-07-12T02:02:59.548914+0000","last_became_active":"2023-07-12T02:02:07.270293+0000","last_became_peered":"2023-07-12T02:02:07.270293+0000","last_unstale":"2023-07-12T02:02:59.548914+0000","last_undegraded":"2023-07-12T02:02:59.548914+0000","last_fullsized":"2023-07-12T02:02:59.548914+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:36:34.847406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":183,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.548723+0000","last_change":"2023-07-12T02:02:07.268364+0000","last_active":"2023-07-12T02:02:59.548723+0000","last_peered":"2023-07-12T02:02:59.548723+0000","last_clean":"2023-07-12T02:02:59.548723+0000","last_became_active":"2023-07-12T02:02:07.268074+0000","last_became_peered":"2023-07-12T02:02:07.268074+0000","last_unstale":"2023-07-12T02:02:59.548723+0000","last_undegraded":"2023-07-12T02:02:59.548723+0000","last_fullsized":"2023-07-12T02:02:59.548723+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:20:11.432669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.579022+0000","last_change":"2023-07-12T02:02:59.576199+0000","last_active":"2023-07-12T02:02:59.579022+0000","last_peered":"2023-07-12T02:02:59.579022+0000","last_clean":"2023-07-12T02:02:59.579022+0000","last_became_active":"2023-07-12T02:02:59.575923+0000","last_became_peered":"2023-07-12T02:02:59.575923+0000","last_unstale":"2023-07-12T02:02:59.579022+0000","last_undegraded":"2023-07-12T02:02:59.579022+0000","last_fullsized":"2023-07-12T02:02:59.579022+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:29:59.291038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.549420+0000","last_change":"2023-07-12T02:02:58.563926+0000","last_active":"2023-07-12T02:02:59.549420+0000","last_peered":"2023-07-12T02:02:59.549420+0000","last_clean":"2023-07-12T02:02:59.549420+0000","last_became_active":"2023-07-12T02:02:58.563617+0000","last_became_peered":"2023-07-12T02:02:58.563617+0000","last_unstale":"2023-07-12T02:02:59.549420+0000","last_undegraded":"2023-07-12T02:02:59.549420+0000","last_fullsized":"2023-07-12T02:02:59.549420+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:43:49.433673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.547896+0000","last_change":"2023-07-12T02:02:07.599189+0000","last_active":"2023-07-12T02:02:59.547896+0000","last_peered":"2023-07-12T02:02:59.547896+0000","last_clean":"2023-07-12T02:02:59.547896+0000","last_became_active":"2023-07-12T02:02:07.598898+0000","last_became_peered":"2023-07-12T02:02:07.598898+0000","last_unstale":"2023-07-12T02:02:59.547896+0000","last_undegraded":"2023-07-12T02:02:59.547896+0000","last_fullsized":"2023-07-12T02:02:59.547896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:32:45.919383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.571542+0000","last_change":"2023-07-12T02:02:59.569636+0000","last_active":"2023-07-12T02:02:59.571542+0000","last_peered":"2023-07-12T02:02:59.571542+0000","last_clean":"2023-07-12T02:02:59.571542+0000","last_became_active":"2023-07-12T02:02:59.569357+0000","last_became_peered":"2023-07-12T02:02:59.569357+0000","last_unstale":"2023-07-12T02:02:59.571542+0000","last_undegraded":"2023-07-12T02:02:59.571542+0000","last_fullsized":"2023-07-12T02:02:59.571542+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:34:49.428324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.548404+0000","last_change":"2023-07-12T02:02:58.567214+0000","last_active":"2023-07-12T02:02:59.548404+0000","last_peered":"2023-07-12T02:02:59.548404+0000","last_clean":"2023-07-12T02:02:59.548404+0000","last_became_active":"2023-07-12T02:02:58.566374+0000","last_became_peered":"2023-07-12T02:02:58.566374+0000","last_unstale":"2023-07-12T02:02:59.548404+0000","last_undegraded":"2023-07-12T02:02:59.548404+0000","last_fullsized":"2023-07-12T02:02:59.548404+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:29:24.511031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.548382+0000","last_change":"2023-07-12T02:02:07.599193+0000","last_active":"2023-07-12T02:02:59.548382+0000","last_peered":"2023-07-12T02:02:59.548382+0000","last_clean":"2023-07-12T02:02:59.548382+0000","last_became_active":"2023-07-12T02:02:07.598910+0000","last_became_peered":"2023-07-12T02:02:07.598910+0000","last_unstale":"2023-07-12T02:02:59.548382+0000","last_undegraded":"2023-07-12T02:02:59.548382+0000","last_fullsized":"2023-07-12T02:02:59.548382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:05:19.101711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.571306+0000","last_change":"2023-07-12T02:02:59.569755+0000","last_active":"2023-07-12T02:02:59.571306+0000","last_peered":"2023-07-12T02:02:59.571306+0000","last_clean":"2023-07-12T02:02:59.571306+0000","last_became_active":"2023-07-12T02:02:59.569421+0000","last_became_peered":"2023-07-12T02:02:59.569421+0000","last_unstale":"2023-07-12T02:02:59.571306+0000","last_undegraded":"2023-07-12T02:02:59.571306+0000","last_fullsized":"2023-07-12T02:02:59.571306+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:43:57.894959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.550852+0000","last_change":"2023-07-12T02:02:58.560662+0000","last_active":"2023-07-12T02:02:59.550852+0000","last_peered":"2023-07-12T02:02:59.550852+0000","last_clean":"2023-07-12T02:02:59.550852+0000","last_became_active":"2023-07-12T02:02:58.560370+0000","last_became_peered":"2023-07-12T02:02:58.560370+0000","last_unstale":"2023-07-12T02:02:59.550852+0000","last_undegraded":"2023-07-12T02:02:59.550852+0000","last_fullsized":"2023-07-12T02:02:59.550852+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:45:10.338765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.565790+0000","last_change":"2023-07-12T02:02:07.599477+0000","last_active":"2023-07-12T02:02:59.565790+0000","last_peered":"2023-07-12T02:02:59.565790+0000","last_clean":"2023-07-12T02:02:59.565790+0000","last_became_active":"2023-07-12T02:02:07.599111+0000","last_became_peered":"2023-07-12T02:02:07.599111+0000","last_unstale":"2023-07-12T02:02:59.565790+0000","last_undegraded":"2023-07-12T02:02:59.565790+0000","last_fullsized":"2023-07-12T02:02:59.565790+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:14:54.632643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.579934+0000","last_change":"2023-07-12T02:02:59.579133+0000","last_active":"2023-07-12T02:02:59.579934+0000","last_peered":"2023-07-12T02:02:59.579934+0000","last_clean":"2023-07-12T02:02:59.579934+0000","last_became_active":"2023-07-12T02:02:59.578804+0000","last_became_peered":"2023-07-12T02:02:59.578804+0000","last_unstale":"2023-07-12T02:02:59.579934+0000","last_undegraded":"2023-07-12T02:02:59.579934+0000","last_fullsized":"2023-07-12T02:02:59.579934+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:16:47.936459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.574968+0000","last_change":"2023-07-12T02:02:58.562742+0000","last_active":"2023-07-12T02:02:59.574968+0000","last_peered":"2023-07-12T02:02:59.574968+0000","last_clean":"2023-07-12T02:02:59.574968+0000","last_became_active":"2023-07-12T02:02:58.562413+0000","last_became_peered":"2023-07-12T02:02:58.562413+0000","last_unstale":"2023-07-12T02:02:59.574968+0000","last_undegraded":"2023-07-12T02:02:59.574968+0000","last_fullsized":"2023-07-12T02:02:59.574968+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:27:38.511867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.570939+0000","last_change":"2023-07-12T02:02:07.599427+0000","last_active":"2023-07-12T02:02:59.570939+0000","last_peered":"2023-07-12T02:02:59.570939+0000","last_clean":"2023-07-12T02:02:59.570939+0000","last_became_active":"2023-07-12T02:02:07.599063+0000","last_became_peered":"2023-07-12T02:02:07.599063+0000","last_unstale":"2023-07-12T02:02:59.570939+0000","last_undegraded":"2023-07-12T02:02:59.570939+0000","last_fullsized":"2023-07-12T02:02:59.570939+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:26:26.888037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.561435+0000","last_change":"2023-07-12T02:02:59.560541+0000","last_active":"2023-07-12T02:02:59.561435+0000","last_peered":"2023-07-12T02:02:59.561435+0000","last_clean":"2023-07-12T02:02:59.561435+0000","last_became_active":"2023-07-12T02:02:59.560242+0000","last_became_peered":"2023-07-12T02:02:59.560242+0000","last_unstale":"2023-07-12T02:02:59.561435+0000","last_undegraded":"2023-07-12T02:02:59.561435+0000","last_fullsized":"2023-07-12T02:02:59.561435+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:59:14.382477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.549236+0000","last_change":"2023-07-12T02:02:58.559053+0000","last_active":"2023-07-12T02:02:59.549236+0000","last_peered":"2023-07-12T02:02:59.549236+0000","last_clean":"2023-07-12T02:02:59.549236+0000","last_became_active":"2023-07-12T02:02:58.558775+0000","last_became_peered":"2023-07-12T02:02:58.558775+0000","last_unstale":"2023-07-12T02:02:59.549236+0000","last_undegraded":"2023-07-12T02:02:59.549236+0000","last_fullsized":"2023-07-12T02:02:59.549236+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:35:29.605485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.570549+0000","last_change":"2023-07-12T02:02:07.272059+0000","last_active":"2023-07-12T02:02:59.570549+0000","last_peered":"2023-07-12T02:02:59.570549+0000","last_clean":"2023-07-12T02:02:59.570549+0000","last_became_active":"2023-07-12T02:02:07.271770+0000","last_became_peered":"2023-07-12T02:02:07.271770+0000","last_unstale":"2023-07-12T02:02:59.570549+0000","last_undegraded":"2023-07-12T02:02:59.570549+0000","last_fullsized":"2023-07-12T02:02:59.570549+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:57:25.208935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":925696,"data_stored":723526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":126991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":913408,"data_stored":716398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.245}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":319488,"data_stored":126030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":331776,"data_stored":133158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":335872,"data_stored":134119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":339968,"data_stored":133762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":126991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-12T02:03:03.907 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-12T02:03:04.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.062+0000 7ff85b215700 1 Processor -- start 2023-07-12T02:03:04.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.062+0000 7ff85b215700 1 -- start start 2023-07-12T02:03:04.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.063+0000 7ff85b215700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff85406b120 0x7ff8541474f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:04.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.063+0000 7ff85b215700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff854071b60 0x7ff854147a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:04.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.063+0000 7ff85b215700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff8540b6430 0x7ff8540b68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:04.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.063+0000 7ff85b215700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff854070800 con 0x7ff854071b60 2023-07-12T02:03:04.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.063+0000 7ff85b215700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff854141c90 con 0x7ff8540b6430 2023-07-12T02:03:04.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.063+0000 7ff85b215700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8540b3bd0 con 0x7ff85406b120 2023-07-12T02:03:04.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.063+0000 7ff853fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff854071b60 0x7ff854147a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:04.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.063+0000 7ff853fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff854071b60 0x7ff854147a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59720/0 (socket says 172.21.15.60:59720) 2023-07-12T02:03:04.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.063+0000 7ff853fff700 1 -- 172.21.15.60:0/1981135272 learned_addr learned my addr 172.21.15.60:0/1981135272 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:03:04.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.063+0000 7ff858fb1700 1 --2- 172.21.15.60:0/1981135272 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff85406b120 0x7ff8541474f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:04.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.063+0000 7ff8597b2700 1 --2- 172.21.15.60:0/1981135272 >> v2:172.21.15.79:3300/0 conn(0x7ff8540b6430 0x7ff8540b68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:04.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.063+0000 7ff853fff700 1 -- 172.21.15.60:0/1981135272 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff85406b120 msgr2=0x7ff8541474f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:04.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.063+0000 7ff853fff700 1 --2- 172.21.15.60:0/1981135272 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff85406b120 0x7ff8541474f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:04.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.063+0000 7ff853fff700 1 -- 172.21.15.60:0/1981135272 >> v2:172.21.15.79:3300/0 conn(0x7ff8540b6430 msgr2=0x7ff8540b68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:04.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.063+0000 7ff853fff700 1 --2- 172.21.15.60:0/1981135272 >> v2:172.21.15.79:3300/0 conn(0x7ff8540b6430 0x7ff8540b68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:04.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.063+0000 7ff853fff700 1 -- 172.21.15.60:0/1981135272 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8540714d0 con 0x7ff854071b60 2023-07-12T02:03:04.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.063+0000 7ff8597b2700 1 --2- 172.21.15.60:0/1981135272 >> v2:172.21.15.79:3300/0 conn(0x7ff8540b6430 0x7ff8540b68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:03:04.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.063+0000 7ff853fff700 1 --2- 172.21.15.60:0/1981135272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff854071b60 0x7ff854147a30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff85414bab0 tx=0x7ff840009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b72513dfe9e627cd server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:04.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.063+0000 7ff8537fe700 1 -- 172.21.15.60:0/1981135272 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84000f8a0 con 0x7ff854071b60 2023-07-12T02:03:04.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.063+0000 7ff8537fe700 1 -- 172.21.15.60:0/1981135272 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff84000fa00 con 0x7ff854071b60 2023-07-12T02:03:04.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.063+0000 7ff8537fe700 1 -- 172.21.15.60:0/1981135272 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84000fd90 con 0x7ff854071b60 2023-07-12T02:03:04.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.064+0000 7ff85b215700 1 -- 172.21.15.60:0/1981135272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff854071b60 msgr2=0x7ff854147a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:04.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.064+0000 7ff85b215700 1 --2- 172.21.15.60:0/1981135272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff854071b60 0x7ff854147a30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff85414bab0 tx=0x7ff840009bd0 comp rx=0 tx=0).stop 2023-07-12T02:03:04.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.064+0000 7ff85b215700 1 -- 172.21.15.60:0/1981135272 shutdown_connections 2023-07-12T02:03:04.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.064+0000 7ff85b215700 1 --2- 172.21.15.60:0/1981135272 >> v2:172.21.15.79:3300/0 conn(0x7ff8540b6430 0x7ff8540b68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:04.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.064+0000 7ff85b215700 1 --2- 172.21.15.60:0/1981135272 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff85406b120 0x7ff8541474f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:04.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.064+0000 7ff85b215700 1 --2- 172.21.15.60:0/1981135272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff854071b60 0x7ff854147a30 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:04.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.064+0000 7ff85b215700 1 -- 172.21.15.60:0/1981135272 >> 172.21.15.60:0/1981135272 conn(0x7ff8540bd980 msgr2=0x7ff8540b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:04.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.064+0000 7ff85b215700 1 -- 172.21.15.60:0/1981135272 shutdown_connections 2023-07-12T02:03:04.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.064+0000 7ff85b215700 1 -- 172.21.15.60:0/1981135272 wait complete. 2023-07-12T02:03:04.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.065+0000 7ff85b215700 1 Processor -- start 2023-07-12T02:03:04.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.065+0000 7ff85b215700 1 -- start start 2023-07-12T02:03:04.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.066+0000 7ff85b215700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff85406b120 0x7ff8541467b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:04.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.066+0000 7ff85b215700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff854071b60 0x7ff85414ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:04.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.066+0000 7ff85b215700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8540b6430 0x7ff8541dfa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:04.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.066+0000 7ff85b215700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff854146cf0 con 0x7ff85406b120 2023-07-12T02:03:04.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.066+0000 7ff85b215700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8540b5d70 con 0x7ff8540b6430 2023-07-12T02:03:04.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.066+0000 7ff85b215700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff85414b2e0 con 0x7ff854071b60 2023-07-12T02:03:04.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.066+0000 7ff858fb1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff85406b120 0x7ff8541467b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:04.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.066+0000 7ff858fb1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff85406b120 0x7ff8541467b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59724/0 (socket says 172.21.15.60:59724) 2023-07-12T02:03:04.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.066+0000 7ff858fb1700 1 -- 172.21.15.60:0/739819124 learned_addr learned my addr 172.21.15.60:0/739819124 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:03:04.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.066+0000 7ff8597b2700 1 --2- 172.21.15.60:0/739819124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8540b6430 0x7ff8541dfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:04.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.066+0000 7ff853fff700 1 --2- 172.21.15.60:0/739819124 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff854071b60 0x7ff85414ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:04.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.066+0000 7ff858fb1700 1 -- 172.21.15.60:0/739819124 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff854071b60 msgr2=0x7ff85414ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:04.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.066+0000 7ff858fb1700 1 --2- 172.21.15.60:0/739819124 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff854071b60 0x7ff85414ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:04.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.066+0000 7ff858fb1700 1 -- 172.21.15.60:0/739819124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8540b6430 msgr2=0x7ff8541dfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:04.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.066+0000 7ff858fb1700 1 --2- 172.21.15.60:0/739819124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8540b6430 0x7ff8541dfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:04.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.066+0000 7ff858fb1700 1 -- 172.21.15.60:0/739819124 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff840009550 con 0x7ff85406b120 2023-07-12T02:03:04.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.067+0000 7ff858fb1700 1 --2- 172.21.15.60:0/739819124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff85406b120 0x7ff8541467b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff84800c7f0 tx=0x7ff84800cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:04.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.067+0000 7ff8517fa700 1 -- 172.21.15.60:0/739819124 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff848004220 con 0x7ff85406b120 2023-07-12T02:03:04.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.067+0000 7ff8517fa700 1 -- 172.21.15.60:0/739819124 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff848004380 con 0x7ff85406b120 2023-07-12T02:03:04.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.067+0000 7ff85b215700 1 -- 172.21.15.60:0/739819124 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8541e3570 con 0x7ff85406b120 2023-07-12T02:03:04.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.067+0000 7ff8517fa700 1 -- 172.21.15.60:0/739819124 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8480036a0 con 0x7ff85406b120 2023-07-12T02:03:04.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.067+0000 7ff85b215700 1 -- 172.21.15.60:0/739819124 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8541e3ac0 con 0x7ff85406b120 2023-07-12T02:03:04.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.068+0000 7ff85b215700 1 -- 172.21.15.60:0/739819124 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff854074360 con 0x7ff85406b120 2023-07-12T02:03:04.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.068+0000 7ff8517fa700 1 -- 172.21.15.60:0/739819124 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff848003820 con 0x7ff85406b120 2023-07-12T02:03:04.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.069+0000 7ff8517fa700 1 --2- 172.21.15.60:0/739819124 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ff83806ace0 0x7ff83806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:04.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.069+0000 7ff8517fa700 1 -- 172.21.15.60:0/739819124 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff848088fb0 con 0x7ff85406b120 2023-07-12T02:03:04.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.069+0000 7ff853fff700 1 --2- 172.21.15.60:0/739819124 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ff83806ace0 0x7ff83806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:04.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.069+0000 7ff853fff700 1 --2- 172.21.15.60:0/739819124 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ff83806ace0 0x7ff83806d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff854071f30 tx=0x7ff84001b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:04.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.073+0000 7ff8517fa700 1 -- 172.21.15.60:0/739819124 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7ff8480bb380 con 0x7ff85406b120 2023-07-12T02:03:04.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.266+0000 7ff85b215700 1 -- 172.21.15.60:0/739819124 --> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff85414b600 con 0x7ff83806ace0 2023-07-12T02:03:04.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.274+0000 7ff8517fa700 1 -- 172.21.15.60:0/739819124 <== mgr.4105 v2:172.21.15.79:6832/1173177519 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286916 (secure 0 0 0) 0x7ff84000fbf0 con 0x7ff83806ace0 2023-07-12T02:03:04.281 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:03:04.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.277+0000 7ff85b215700 1 -- 172.21.15.60:0/739819124 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ff83806ace0 msgr2=0x7ff83806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:04.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.277+0000 7ff85b215700 1 --2- 172.21.15.60:0/739819124 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ff83806ace0 0x7ff83806d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff854071f30 tx=0x7ff84001b040 comp rx=0 tx=0).stop 2023-07-12T02:03:04.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.277+0000 7ff85b215700 1 -- 172.21.15.60:0/739819124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff85406b120 msgr2=0x7ff8541467b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:04.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.277+0000 7ff85b215700 1 --2- 172.21.15.60:0/739819124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff85406b120 0x7ff8541467b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff84800c7f0 tx=0x7ff84800cb00 comp rx=0 tx=0).stop 2023-07-12T02:03:04.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.278+0000 7ff85b215700 1 -- 172.21.15.60:0/739819124 shutdown_connections 2023-07-12T02:03:04.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.278+0000 7ff85b215700 1 --2- 172.21.15.60:0/739819124 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ff83806ace0 0x7ff83806d190 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:04.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.278+0000 7ff85b215700 1 --2- 172.21.15.60:0/739819124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff85406b120 0x7ff8541467b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:04.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.278+0000 7ff85b215700 1 --2- 172.21.15.60:0/739819124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8540b6430 0x7ff8541dfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:04.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.278+0000 7ff85b215700 1 --2- 172.21.15.60:0/739819124 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff854071b60 0x7ff85414ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:04.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.278+0000 7ff85b215700 1 -- 172.21.15.60:0/739819124 >> 172.21.15.60:0/739819124 conn(0x7ff8540bd980 msgr2=0x7ff8540b91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:04.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.278+0000 7ff85b215700 1 -- 172.21.15.60:0/739819124 shutdown_connections 2023-07-12T02:03:04.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.278+0000 7ff85b215700 1 -- 172.21.15.60:0/739819124 wait complete. 2023-07-12T02:03:04.284 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-07-12T02:03:04.294 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2023-07-12T02:03:03.813086+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":78,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219932,"kb_used_data":3724,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754788,"statfs":{"total":773094113280,"available":772868902912,"internally_reserved":0,"allocated":3813376,"data_stored":2220975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001179"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.559439+0000","last_change":"2023-07-12T02:02:59.558047+0000","last_active":"2023-07-12T02:02:59.559439+0000","last_peered":"2023-07-12T02:02:59.559439+0000","last_clean":"2023-07-12T02:02:59.559439+0000","last_became_active":"2023-07-12T02:02:59.557732+0000","last_became_peered":"2023-07-12T02:02:59.557732+0000","last_unstale":"2023-07-12T02:02:59.559439+0000","last_undegraded":"2023-07-12T02:02:59.559439+0000","last_fullsized":"2023-07-12T02:02:59.559439+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:51:33.829119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.561703+0000","last_change":"2023-07-12T02:02:59.560472+0000","last_active":"2023-07-12T02:02:59.561703+0000","last_peered":"2023-07-12T02:02:59.561703+0000","last_clean":"2023-07-12T02:02:59.561703+0000","last_became_active":"2023-07-12T02:02:59.560054+0000","last_became_peered":"2023-07-12T02:02:59.560054+0000","last_unstale":"2023-07-12T02:02:59.561703+0000","last_undegraded":"2023-07-12T02:02:59.561703+0000","last_fullsized":"2023-07-12T02:02:59.561703+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:08:11.785175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.573076+0000","last_change":"2023-07-12T02:02:59.572463+0000","last_active":"2023-07-12T02:02:59.573076+0000","last_peered":"2023-07-12T02:02:59.573076+0000","last_clean":"2023-07-12T02:02:59.573076+0000","last_became_active":"2023-07-12T02:02:59.572124+0000","last_became_peered":"2023-07-12T02:02:59.572124+0000","last_unstale":"2023-07-12T02:02:59.573076+0000","last_undegraded":"2023-07-12T02:02:59.573076+0000","last_fullsized":"2023-07-12T02:02:59.573076+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:43:49.406023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.568016+0000","last_change":"2023-07-12T02:02:59.564720+0000","last_active":"2023-07-12T02:02:59.568016+0000","last_peered":"2023-07-12T02:02:59.568016+0000","last_clean":"2023-07-12T02:02:59.568016+0000","last_became_active":"2023-07-12T02:02:59.564391+0000","last_became_peered":"2023-07-12T02:02:59.564391+0000","last_unstale":"2023-07-12T02:02:59.568016+0000","last_undegraded":"2023-07-12T02:02:59.568016+0000","last_fullsized":"2023-07-12T02:02:59.568016+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:08:52.046294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.568985+0000","last_change":"2023-07-12T02:02:59.568514+0000","last_active":"2023-07-12T02:02:59.568985+0000","last_peered":"2023-07-12T02:02:59.568985+0000","last_clean":"2023-07-12T02:02:59.568985+0000","last_became_active":"2023-07-12T02:02:59.568290+0000","last_became_peered":"2023-07-12T02:02:59.568290+0000","last_unstale":"2023-07-12T02:02:59.568985+0000","last_undegraded":"2023-07-12T02:02:59.568985+0000","last_fullsized":"2023-07-12T02:02:59.568985+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:45:27.805300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.556902+0000","last_change":"2023-07-12T02:02:59.555138+0000","last_active":"2023-07-12T02:02:59.556902+0000","last_peered":"2023-07-12T02:02:59.556902+0000","last_clean":"2023-07-12T02:02:59.556902+0000","last_became_active":"2023-07-12T02:02:59.554814+0000","last_became_peered":"2023-07-12T02:02:59.554814+0000","last_unstale":"2023-07-12T02:02:59.556902+0000","last_undegraded":"2023-07-12T02:02:59.556902+0000","last_fullsized":"2023-07-12T02:02:59.556902+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:34:56.951150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.571839+0000","last_change":"2023-07-12T02:02:59.568009+0000","last_active":"2023-07-12T02:02:59.571839+0000","last_peered":"2023-07-12T02:02:59.571839+0000","last_clean":"2023-07-12T02:02:59.571839+0000","last_became_active":"2023-07-12T02:02:59.567713+0000","last_became_peered":"2023-07-12T02:02:59.567713+0000","last_unstale":"2023-07-12T02:02:59.571839+0000","last_undegraded":"2023-07-12T02:02:59.571839+0000","last_fullsized":"2023-07-12T02:02:59.571839+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:52:42.090173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.567556+0000","last_change":"2023-07-12T02:02:59.565881+0000","last_active":"2023-07-12T02:02:59.567556+0000","last_peered":"2023-07-12T02:02:59.567556+0000","last_clean":"2023-07-12T02:02:59.567556+0000","last_became_active":"2023-07-12T02:02:59.565431+0000","last_became_peered":"2023-07-12T02:02:59.565431+0000","last_unstale":"2023-07-12T02:02:59.567556+0000","last_undegraded":"2023-07-12T02:02:59.567556+0000","last_fullsized":"2023-07-12T02:02:59.567556+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:15:36.117000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.568453+0000","last_change":"2023-07-12T02:02:59.567621+0000","last_active":"2023-07-12T02:02:59.568453+0000","last_peered":"2023-07-12T02:02:59.568453+0000","last_clean":"2023-07-12T02:02:59.568453+0000","last_became_active":"2023-07-12T02:02:59.566138+0000","last_became_peered":"2023-07-12T02:02:59.566138+0000","last_unstale":"2023-07-12T02:02:59.568453+0000","last_undegraded":"2023-07-12T02:02:59.568453+0000","last_fullsized":"2023-07-12T02:02:59.568453+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:02:42.075914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.575609+0000","last_change":"2023-07-12T02:02:59.572479+0000","last_active":"2023-07-12T02:02:59.575609+0000","last_peered":"2023-07-12T02:02:59.575609+0000","last_clean":"2023-07-12T02:02:59.575609+0000","last_became_active":"2023-07-12T02:02:59.572011+0000","last_became_peered":"2023-07-12T02:02:59.572011+0000","last_unstale":"2023-07-12T02:02:59.575609+0000","last_undegraded":"2023-07-12T02:02:59.575609+0000","last_fullsized":"2023-07-12T02:02:59.575609+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:15:48.234565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.573710+0000","last_change":"2023-07-12T02:02:59.571341+0000","last_active":"2023-07-12T02:02:59.573710+0000","last_peered":"2023-07-12T02:02:59.573710+0000","last_clean":"2023-07-12T02:02:59.573710+0000","last_became_active":"2023-07-12T02:02:59.570608+0000","last_became_peered":"2023-07-12T02:02:59.570608+0000","last_unstale":"2023-07-12T02:02:59.573710+0000","last_undegraded":"2023-07-12T02:02:59.573710+0000","last_fullsized":"2023-07-12T02:02:59.573710+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:08:12.645684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.558597+0000","last_change":"2023-07-12T02:02:59.557488+0000","last_active":"2023-07-12T02:02:59.558597+0000","last_peered":"2023-07-12T02:02:59.558597+0000","last_clean":"2023-07-12T02:02:59.558597+0000","last_became_active":"2023-07-12T02:02:59.556981+0000","last_became_peered":"2023-07-12T02:02:59.556981+0000","last_unstale":"2023-07-12T02:02:59.558597+0000","last_undegraded":"2023-07-12T02:02:59.558597+0000","last_fullsized":"2023-07-12T02:02:59.558597+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:22:41.444974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.578377+0000","last_change":"2023-07-12T02:02:59.574458+0000","last_active":"2023-07-12T02:02:59.578377+0000","last_peered":"2023-07-12T02:02:59.578377+0000","last_clean":"2023-07-12T02:02:59.578377+0000","last_became_active":"2023-07-12T02:02:59.574230+0000","last_became_peered":"2023-07-12T02:02:59.574230+0000","last_unstale":"2023-07-12T02:02:59.578377+0000","last_undegraded":"2023-07-12T02:02:59.578377+0000","last_fullsized":"2023-07-12T02:02:59.578377+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:51:33.829119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.583777+0000","last_change":"2023-07-12T02:02:59.580718+0000","last_active":"2023-07-12T02:02:59.583777+0000","last_peered":"2023-07-12T02:02:59.583777+0000","last_clean":"2023-07-12T02:02:59.583777+0000","last_became_active":"2023-07-12T02:02:59.580429+0000","last_became_peered":"2023-07-12T02:02:59.580429+0000","last_unstale":"2023-07-12T02:02:59.583777+0000","last_undegraded":"2023-07-12T02:02:59.583777+0000","last_fullsized":"2023-07-12T02:02:59.583777+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:15:46.913037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.575636+0000","last_change":"2023-07-12T02:02:59.572667+0000","last_active":"2023-07-12T02:02:59.575636+0000","last_peered":"2023-07-12T02:02:59.575636+0000","last_clean":"2023-07-12T02:02:59.575636+0000","last_became_active":"2023-07-12T02:02:59.572273+0000","last_became_peered":"2023-07-12T02:02:59.572273+0000","last_unstale":"2023-07-12T02:02:59.575636+0000","last_undegraded":"2023-07-12T02:02:59.575636+0000","last_fullsized":"2023-07-12T02:02:59.575636+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:06:35.297037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.576116+0000","last_change":"2023-07-12T02:02:59.572614+0000","last_active":"2023-07-12T02:02:59.576116+0000","last_peered":"2023-07-12T02:02:59.576116+0000","last_clean":"2023-07-12T02:02:59.576116+0000","last_became_active":"2023-07-12T02:02:59.572332+0000","last_became_peered":"2023-07-12T02:02:59.572332+0000","last_unstale":"2023-07-12T02:02:59.576116+0000","last_undegraded":"2023-07-12T02:02:59.576116+0000","last_fullsized":"2023-07-12T02:02:59.576116+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:15:36.117000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.573769+0000","last_change":"2023-07-12T02:02:59.565386+0000","last_active":"2023-07-12T02:02:59.573769+0000","last_peered":"2023-07-12T02:02:59.573769+0000","last_clean":"2023-07-12T02:02:59.573769+0000","last_became_active":"2023-07-12T02:02:59.565020+0000","last_became_peered":"2023-07-12T02:02:59.565020+0000","last_unstale":"2023-07-12T02:02:59.573769+0000","last_undegraded":"2023-07-12T02:02:59.573769+0000","last_fullsized":"2023-07-12T02:02:59.573769+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:16:22.664572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.581990+0000","last_change":"2023-07-12T02:02:59.579718+0000","last_active":"2023-07-12T02:02:59.581990+0000","last_peered":"2023-07-12T02:02:59.581990+0000","last_clean":"2023-07-12T02:02:59.581990+0000","last_became_active":"2023-07-12T02:02:59.578619+0000","last_became_peered":"2023-07-12T02:02:59.578619+0000","last_unstale":"2023-07-12T02:02:59.581990+0000","last_undegraded":"2023-07-12T02:02:59.581990+0000","last_fullsized":"2023-07-12T02:02:59.581990+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:43:49.406023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.556761+0000","last_change":"2023-07-12T02:02:59.555390+0000","last_active":"2023-07-12T02:02:59.556761+0000","last_peered":"2023-07-12T02:02:59.556761+0000","last_clean":"2023-07-12T02:02:59.556761+0000","last_became_active":"2023-07-12T02:02:59.555099+0000","last_became_peered":"2023-07-12T02:02:59.555099+0000","last_unstale":"2023-07-12T02:02:59.556761+0000","last_undegraded":"2023-07-12T02:02:59.556761+0000","last_fullsized":"2023-07-12T02:02:59.556761+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:34:50.019256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.581794+0000","last_change":"2023-07-12T02:02:59.578790+0000","last_active":"2023-07-12T02:02:59.581794+0000","last_peered":"2023-07-12T02:02:59.581794+0000","last_clean":"2023-07-12T02:02:59.581794+0000","last_became_active":"2023-07-12T02:02:59.578469+0000","last_became_peered":"2023-07-12T02:02:59.578469+0000","last_unstale":"2023-07-12T02:02:59.581794+0000","last_undegraded":"2023-07-12T02:02:59.581794+0000","last_fullsized":"2023-07-12T02:02:59.581794+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:45:11.343394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.573436+0000","last_change":"2023-07-12T02:02:59.571326+0000","last_active":"2023-07-12T02:02:59.573436+0000","last_peered":"2023-07-12T02:02:59.573436+0000","last_clean":"2023-07-12T02:02:59.573436+0000","last_became_active":"2023-07-12T02:02:59.570998+0000","last_became_peered":"2023-07-12T02:02:59.570998+0000","last_unstale":"2023-07-12T02:02:59.573436+0000","last_undegraded":"2023-07-12T02:02:59.573436+0000","last_fullsized":"2023-07-12T02:02:59.573436+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:33:38.199777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.572572+0000","last_change":"2023-07-12T02:02:59.570301+0000","last_active":"2023-07-12T02:02:59.572572+0000","last_peered":"2023-07-12T02:02:59.572572+0000","last_clean":"2023-07-12T02:02:59.572572+0000","last_became_active":"2023-07-12T02:02:59.569983+0000","last_became_peered":"2023-07-12T02:02:59.569983+0000","last_unstale":"2023-07-12T02:02:59.572572+0000","last_undegraded":"2023-07-12T02:02:59.572572+0000","last_fullsized":"2023-07-12T02:02:59.572572+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:49:08.422815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.573239+0000","last_change":"2023-07-12T02:02:59.562297+0000","last_active":"2023-07-12T02:02:59.573239+0000","last_peered":"2023-07-12T02:02:59.573239+0000","last_clean":"2023-07-12T02:02:59.573239+0000","last_became_active":"2023-07-12T02:02:59.561815+0000","last_became_peered":"2023-07-12T02:02:59.561815+0000","last_unstale":"2023-07-12T02:02:59.573239+0000","last_undegraded":"2023-07-12T02:02:59.573239+0000","last_fullsized":"2023-07-12T02:02:59.573239+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:15:46.913037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.568361+0000","last_change":"2023-07-12T02:02:59.567242+0000","last_active":"2023-07-12T02:02:59.568361+0000","last_peered":"2023-07-12T02:02:59.568361+0000","last_clean":"2023-07-12T02:02:59.568361+0000","last_became_active":"2023-07-12T02:02:59.567010+0000","last_became_peered":"2023-07-12T02:02:59.567010+0000","last_unstale":"2023-07-12T02:02:59.568361+0000","last_undegraded":"2023-07-12T02:02:59.568361+0000","last_fullsized":"2023-07-12T02:02:59.568361+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:30:10.003599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.580534+0000","last_change":"2023-07-12T02:02:59.575779+0000","last_active":"2023-07-12T02:02:59.580534+0000","last_peered":"2023-07-12T02:02:59.580534+0000","last_clean":"2023-07-12T02:02:59.580534+0000","last_became_active":"2023-07-12T02:02:59.575512+0000","last_became_peered":"2023-07-12T02:02:59.575512+0000","last_unstale":"2023-07-12T02:02:59.580534+0000","last_undegraded":"2023-07-12T02:02:59.580534+0000","last_fullsized":"2023-07-12T02:02:59.580534+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:22:41.444974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.571826+0000","last_change":"2023-07-12T02:02:59.570259+0000","last_active":"2023-07-12T02:02:59.571826+0000","last_peered":"2023-07-12T02:02:59.571826+0000","last_clean":"2023-07-12T02:02:59.571826+0000","last_became_active":"2023-07-12T02:02:59.569976+0000","last_became_peered":"2023-07-12T02:02:59.569976+0000","last_unstale":"2023-07-12T02:02:59.571826+0000","last_undegraded":"2023-07-12T02:02:59.571826+0000","last_fullsized":"2023-07-12T02:02:59.571826+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:14:16.615559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.580601+0000","last_change":"2023-07-12T02:02:59.578653+0000","last_active":"2023-07-12T02:02:59.580601+0000","last_peered":"2023-07-12T02:02:59.580601+0000","last_clean":"2023-07-12T02:02:59.580601+0000","last_became_active":"2023-07-12T02:02:59.578327+0000","last_became_peered":"2023-07-12T02:02:59.578327+0000","last_unstale":"2023-07-12T02:02:59.580601+0000","last_undegraded":"2023-07-12T02:02:59.580601+0000","last_fullsized":"2023-07-12T02:02:59.580601+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:02:42.075914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.571032+0000","last_change":"2023-07-12T02:02:59.568291+0000","last_active":"2023-07-12T02:02:59.571032+0000","last_peered":"2023-07-12T02:02:59.571032+0000","last_clean":"2023-07-12T02:02:59.571032+0000","last_became_active":"2023-07-12T02:02:59.568008+0000","last_became_peered":"2023-07-12T02:02:59.568008+0000","last_unstale":"2023-07-12T02:02:59.571032+0000","last_undegraded":"2023-07-12T02:02:59.571032+0000","last_fullsized":"2023-07-12T02:02:59.571032+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:33:44.055703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.581055+0000","last_change":"2023-07-12T02:02:59.578645+0000","last_active":"2023-07-12T02:02:59.581055+0000","last_peered":"2023-07-12T02:02:59.581055+0000","last_clean":"2023-07-12T02:02:59.581055+0000","last_became_active":"2023-07-12T02:02:59.578336+0000","last_became_peered":"2023-07-12T02:02:59.578336+0000","last_unstale":"2023-07-12T02:02:59.581055+0000","last_undegraded":"2023-07-12T02:02:59.581055+0000","last_fullsized":"2023-07-12T02:02:59.581055+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:40:45.050634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.583490+0000","last_change":"2023-07-12T02:02:59.580348+0000","last_active":"2023-07-12T02:02:59.583490+0000","last_peered":"2023-07-12T02:02:59.583490+0000","last_clean":"2023-07-12T02:02:59.583490+0000","last_became_active":"2023-07-12T02:02:59.580083+0000","last_became_peered":"2023-07-12T02:02:59.580083+0000","last_unstale":"2023-07-12T02:02:59.583490+0000","last_undegraded":"2023-07-12T02:02:59.583490+0000","last_fullsized":"2023-07-12T02:02:59.583490+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:59:14.382477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.573216+0000","last_change":"2023-07-12T02:02:59.562112+0000","last_active":"2023-07-12T02:02:59.573216+0000","last_peered":"2023-07-12T02:02:59.573216+0000","last_clean":"2023-07-12T02:02:59.573216+0000","last_became_active":"2023-07-12T02:02:59.561438+0000","last_became_peered":"2023-07-12T02:02:59.561438+0000","last_unstale":"2023-07-12T02:02:59.573216+0000","last_undegraded":"2023-07-12T02:02:59.573216+0000","last_fullsized":"2023-07-12T02:02:59.573216+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:51:33.829119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.560758+0000","last_change":"2023-07-12T02:02:59.559046+0000","last_active":"2023-07-12T02:02:59.560758+0000","last_peered":"2023-07-12T02:02:59.560758+0000","last_clean":"2023-07-12T02:02:59.560758+0000","last_became_active":"2023-07-12T02:02:59.558767+0000","last_became_peered":"2023-07-12T02:02:59.558767+0000","last_unstale":"2023-07-12T02:02:59.560758+0000","last_undegraded":"2023-07-12T02:02:59.560758+0000","last_fullsized":"2023-07-12T02:02:59.560758+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:39:13.128525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.573900+0000","last_change":"2023-07-12T02:02:59.565390+0000","last_active":"2023-07-12T02:02:59.573900+0000","last_peered":"2023-07-12T02:02:59.573900+0000","last_clean":"2023-07-12T02:02:59.573900+0000","last_became_active":"2023-07-12T02:02:59.565056+0000","last_became_peered":"2023-07-12T02:02:59.565056+0000","last_unstale":"2023-07-12T02:02:59.573900+0000","last_undegraded":"2023-07-12T02:02:59.573900+0000","last_fullsized":"2023-07-12T02:02:59.573900+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:39:07.369352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"30'4","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.776959+0000","last_change":"2023-07-12T02:02:58.562862+0000","last_active":"2023-07-12T02:02:59.776959+0000","last_peered":"2023-07-12T02:02:59.776959+0000","last_clean":"2023-07-12T02:02:59.776959+0000","last_became_active":"2023-07-12T02:02:58.562511+0000","last_became_peered":"2023-07-12T02:02:58.562511+0000","last_unstale":"2023-07-12T02:02:59.776959+0000","last_undegraded":"2023-07-12T02:02:59.776959+0000","last_fullsized":"2023-07-12T02:02:59.776959+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:27:11.423405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.573565+0000","last_change":"2023-07-12T02:02:59.572424+0000","last_active":"2023-07-12T02:02:59.573565+0000","last_peered":"2023-07-12T02:02:59.573565+0000","last_clean":"2023-07-12T02:02:59.573565+0000","last_became_active":"2023-07-12T02:02:59.572142+0000","last_became_peered":"2023-07-12T02:02:59.572142+0000","last_unstale":"2023-07-12T02:02:59.573565+0000","last_undegraded":"2023-07-12T02:02:59.573565+0000","last_fullsized":"2023-07-12T02:02:59.573565+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:44:56.455022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"30'1","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.773294+0000","last_change":"2023-07-12T02:02:58.557172+0000","last_active":"2023-07-12T02:02:59.773294+0000","last_peered":"2023-07-12T02:02:59.773294+0000","last_clean":"2023-07-12T02:02:59.773294+0000","last_became_active":"2023-07-12T02:02:58.556880+0000","last_became_peered":"2023-07-12T02:02:58.556880+0000","last_unstale":"2023-07-12T02:02:59.773294+0000","last_undegraded":"2023-07-12T02:02:59.773294+0000","last_fullsized":"2023-07-12T02:02:59.773294+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:53:22.002257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.583758+0000","last_change":"2023-07-12T02:02:59.580721+0000","last_active":"2023-07-12T02:02:59.583758+0000","last_peered":"2023-07-12T02:02:59.583758+0000","last_clean":"2023-07-12T02:02:59.583758+0000","last_became_active":"2023-07-12T02:02:59.580232+0000","last_became_peered":"2023-07-12T02:02:59.580232+0000","last_unstale":"2023-07-12T02:02:59.583758+0000","last_undegraded":"2023-07-12T02:02:59.583758+0000","last_fullsized":"2023-07-12T02:02:59.583758+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:21:03.713062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.776690+0000","last_change":"2023-07-12T02:02:58.558486+0000","last_active":"2023-07-12T02:02:59.776690+0000","last_peered":"2023-07-12T02:02:59.776690+0000","last_clean":"2023-07-12T02:02:59.776690+0000","last_became_active":"2023-07-12T02:02:58.558168+0000","last_became_peered":"2023-07-12T02:02:58.558168+0000","last_unstale":"2023-07-12T02:02:59.776690+0000","last_undegraded":"2023-07-12T02:02:59.776690+0000","last_fullsized":"2023-07-12T02:02:59.776690+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:35:29.605485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.580027+0000","last_change":"2023-07-12T02:02:59.579212+0000","last_active":"2023-07-12T02:02:59.580027+0000","last_peered":"2023-07-12T02:02:59.580027+0000","last_clean":"2023-07-12T02:02:59.580027+0000","last_became_active":"2023-07-12T02:02:59.578911+0000","last_became_peered":"2023-07-12T02:02:59.578911+0000","last_unstale":"2023-07-12T02:02:59.580027+0000","last_undegraded":"2023-07-12T02:02:59.580027+0000","last_fullsized":"2023-07-12T02:02:59.580027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:06:35.297037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.774325+0000","last_change":"2023-07-12T02:02:58.561207+0000","last_active":"2023-07-12T02:02:59.774325+0000","last_peered":"2023-07-12T02:02:59.774325+0000","last_clean":"2023-07-12T02:02:59.774325+0000","last_became_active":"2023-07-12T02:02:58.560943+0000","last_became_peered":"2023-07-12T02:02:58.560943+0000","last_unstale":"2023-07-12T02:02:59.774325+0000","last_undegraded":"2023-07-12T02:02:59.774325+0000","last_fullsized":"2023-07-12T02:02:59.774325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:38:49.902838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.558075+0000","last_change":"2023-07-12T02:02:59.556391+0000","last_active":"2023-07-12T02:02:59.558075+0000","last_peered":"2023-07-12T02:02:59.558075+0000","last_clean":"2023-07-12T02:02:59.558075+0000","last_became_active":"2023-07-12T02:02:59.556072+0000","last_became_peered":"2023-07-12T02:02:59.556072+0000","last_unstale":"2023-07-12T02:02:59.558075+0000","last_undegraded":"2023-07-12T02:02:59.558075+0000","last_fullsized":"2023-07-12T02:02:59.558075+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:58:17.489328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"30'1","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.771505+0000","last_change":"2023-07-12T02:02:58.566848+0000","last_active":"2023-07-12T02:02:59.771505+0000","last_peered":"2023-07-12T02:02:59.771505+0000","last_clean":"2023-07-12T02:02:59.771505+0000","last_became_active":"2023-07-12T02:02:58.566555+0000","last_became_peered":"2023-07-12T02:02:58.566555+0000","last_unstale":"2023-07-12T02:02:59.771505+0000","last_undegraded":"2023-07-12T02:02:59.771505+0000","last_fullsized":"2023-07-12T02:02:59.771505+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:15:35.112371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.575615+0000","last_change":"2023-07-12T02:02:59.572509+0000","last_active":"2023-07-12T02:02:59.575615+0000","last_peered":"2023-07-12T02:02:59.575615+0000","last_clean":"2023-07-12T02:02:59.575615+0000","last_became_active":"2023-07-12T02:02:59.571975+0000","last_became_peered":"2023-07-12T02:02:59.571975+0000","last_unstale":"2023-07-12T02:02:59.575615+0000","last_undegraded":"2023-07-12T02:02:59.575615+0000","last_fullsized":"2023-07-12T02:02:59.575615+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:28:51.264553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"30'1","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.776631+0000","last_change":"2023-07-12T02:02:58.567036+0000","last_active":"2023-07-12T02:02:59.776631+0000","last_peered":"2023-07-12T02:02:59.776631+0000","last_clean":"2023-07-12T02:02:59.776631+0000","last_became_active":"2023-07-12T02:02:58.566735+0000","last_became_peered":"2023-07-12T02:02:58.566735+0000","last_unstale":"2023-07-12T02:02:59.776631+0000","last_undegraded":"2023-07-12T02:02:59.776631+0000","last_fullsized":"2023-07-12T02:02:59.776631+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:26:14.131067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.575342+0000","last_change":"2023-07-12T02:02:59.571834+0000","last_active":"2023-07-12T02:02:59.575342+0000","last_peered":"2023-07-12T02:02:59.575342+0000","last_clean":"2023-07-12T02:02:59.575342+0000","last_became_active":"2023-07-12T02:02:59.571528+0000","last_became_peered":"2023-07-12T02:02:59.571528+0000","last_unstale":"2023-07-12T02:02:59.575342+0000","last_undegraded":"2023-07-12T02:02:59.575342+0000","last_fullsized":"2023-07-12T02:02:59.575342+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:29:25.515660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.551470+0000","last_change":"2023-07-12T02:02:58.564466+0000","last_active":"2023-07-12T02:02:59.551470+0000","last_peered":"2023-07-12T02:02:59.551470+0000","last_clean":"2023-07-12T02:02:59.551470+0000","last_became_active":"2023-07-12T02:02:58.564212+0000","last_became_peered":"2023-07-12T02:02:58.564212+0000","last_unstale":"2023-07-12T02:02:59.551470+0000","last_undegraded":"2023-07-12T02:02:59.551470+0000","last_fullsized":"2023-07-12T02:02:59.551470+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T11:53:22.002257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.567584+0000","last_change":"2023-07-12T02:02:59.566022+0000","last_active":"2023-07-12T02:02:59.567584+0000","last_peered":"2023-07-12T02:02:59.567584+0000","last_clean":"2023-07-12T02:02:59.567584+0000","last_became_active":"2023-07-12T02:02:59.565219+0000","last_became_peered":"2023-07-12T02:02:59.565219+0000","last_unstale":"2023-07-12T02:02:59.567584+0000","last_undegraded":"2023-07-12T02:02:59.567584+0000","last_fullsized":"2023-07-12T02:02:59.567584+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:29:59.291038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.563304+0000","last_change":"2023-07-12T02:02:58.563422+0000","last_active":"2023-07-12T02:02:59.563304+0000","last_peered":"2023-07-12T02:02:59.563304+0000","last_clean":"2023-07-12T02:02:59.563304+0000","last_became_active":"2023-07-12T02:02:58.563188+0000","last_became_peered":"2023-07-12T02:02:58.563188+0000","last_unstale":"2023-07-12T02:02:59.563304+0000","last_undegraded":"2023-07-12T02:02:59.563304+0000","last_fullsized":"2023-07-12T02:02:59.563304+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:39:06.364723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.567980+0000","last_change":"2023-07-12T02:02:59.564695+0000","last_active":"2023-07-12T02:02:59.567980+0000","last_peered":"2023-07-12T02:02:59.567980+0000","last_clean":"2023-07-12T02:02:59.567980+0000","last_became_active":"2023-07-12T02:02:59.564363+0000","last_became_peered":"2023-07-12T02:02:59.564363+0000","last_unstale":"2023-07-12T02:02:59.567980+0000","last_undegraded":"2023-07-12T02:02:59.567980+0000","last_fullsized":"2023-07-12T02:02:59.567980+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:29:44.990982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.550143+0000","last_change":"2023-07-12T02:02:58.563378+0000","last_active":"2023-07-12T02:02:59.550143+0000","last_peered":"2023-07-12T02:02:59.550143+0000","last_clean":"2023-07-12T02:02:59.550143+0000","last_became_active":"2023-07-12T02:02:58.563063+0000","last_became_peered":"2023-07-12T02:02:58.563063+0000","last_unstale":"2023-07-12T02:02:59.550143+0000","last_undegraded":"2023-07-12T02:02:59.550143+0000","last_fullsized":"2023-07-12T02:02:59.550143+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:39:06.364723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.582105+0000","last_change":"2023-07-12T02:02:59.579277+0000","last_active":"2023-07-12T02:02:59.582105+0000","last_peered":"2023-07-12T02:02:59.582105+0000","last_clean":"2023-07-12T02:02:59.582105+0000","last_became_active":"2023-07-12T02:02:59.578986+0000","last_became_peered":"2023-07-12T02:02:59.578986+0000","last_unstale":"2023-07-12T02:02:59.582105+0000","last_undegraded":"2023-07-12T02:02:59.582105+0000","last_fullsized":"2023-07-12T02:02:59.582105+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:08:11.785175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.563710+0000","last_change":"2023-07-12T02:02:58.558533+0000","last_active":"2023-07-12T02:02:59.563710+0000","last_peered":"2023-07-12T02:02:59.563710+0000","last_clean":"2023-07-12T02:02:59.563710+0000","last_became_active":"2023-07-12T02:02:58.558236+0000","last_became_peered":"2023-07-12T02:02:58.558236+0000","last_unstale":"2023-07-12T02:02:59.563710+0000","last_undegraded":"2023-07-12T02:02:59.563710+0000","last_fullsized":"2023-07-12T02:02:59.563710+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:52:35.669198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.566837+0000","last_change":"2023-07-12T02:02:59.565661+0000","last_active":"2023-07-12T02:02:59.566837+0000","last_peered":"2023-07-12T02:02:59.566837+0000","last_clean":"2023-07-12T02:02:59.566837+0000","last_became_active":"2023-07-12T02:02:59.565344+0000","last_became_peered":"2023-07-12T02:02:59.565344+0000","last_unstale":"2023-07-12T02:02:59.566837+0000","last_undegraded":"2023-07-12T02:02:59.566837+0000","last_fullsized":"2023-07-12T02:02:59.566837+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:16:47.936459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"30'3","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.773624+0000","last_change":"2023-07-12T02:02:58.561006+0000","last_active":"2023-07-12T02:02:59.773624+0000","last_peered":"2023-07-12T02:02:59.773624+0000","last_clean":"2023-07-12T02:02:59.773624+0000","last_became_active":"2023-07-12T02:02:58.560710+0000","last_became_peered":"2023-07-12T02:02:58.560710+0000","last_unstale":"2023-07-12T02:02:59.773624+0000","last_undegraded":"2023-07-12T02:02:59.773624+0000","last_fullsized":"2023-07-12T02:02:59.773624+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:29:24.511031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.571263+0000","last_change":"2023-07-12T02:02:59.568522+0000","last_active":"2023-07-12T02:02:59.571263+0000","last_peered":"2023-07-12T02:02:59.571263+0000","last_clean":"2023-07-12T02:02:59.571263+0000","last_became_active":"2023-07-12T02:02:59.568248+0000","last_became_peered":"2023-07-12T02:02:59.568248+0000","last_unstale":"2023-07-12T02:02:59.571263+0000","last_undegraded":"2023-07-12T02:02:59.571263+0000","last_fullsized":"2023-07-12T02:02:59.571263+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:06:35.297037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"30'6","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.779461+0000","last_change":"2023-07-12T02:02:58.569082+0000","last_active":"2023-07-12T02:02:59.779461+0000","last_peered":"2023-07-12T02:02:59.779461+0000","last_clean":"2023-07-12T02:02:59.779461+0000","last_became_active":"2023-07-12T02:02:58.568787+0000","last_became_peered":"2023-07-12T02:02:58.568787+0000","last_unstale":"2023-07-12T02:02:59.779461+0000","last_undegraded":"2023-07-12T02:02:59.779461+0000","last_fullsized":"2023-07-12T02:02:59.779461+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:06:10.377475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.567808+0000","last_change":"2023-07-12T02:02:59.565940+0000","last_active":"2023-07-12T02:02:59.567808+0000","last_peered":"2023-07-12T02:02:59.567808+0000","last_clean":"2023-07-12T02:02:59.567808+0000","last_became_active":"2023-07-12T02:02:59.565357+0000","last_became_peered":"2023-07-12T02:02:59.565357+0000","last_unstale":"2023-07-12T02:02:59.567808+0000","last_undegraded":"2023-07-12T02:02:59.567808+0000","last_fullsized":"2023-07-12T02:02:59.567808+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:27:12.428034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.773144+0000","last_change":"2023-07-12T02:02:58.555830+0000","last_active":"2023-07-12T02:02:59.773144+0000","last_peered":"2023-07-12T02:02:59.773144+0000","last_clean":"2023-07-12T02:02:59.773144+0000","last_became_active":"2023-07-12T02:02:58.555545+0000","last_became_peered":"2023-07-12T02:02:58.555545+0000","last_unstale":"2023-07-12T02:02:59.773144+0000","last_undegraded":"2023-07-12T02:02:59.773144+0000","last_fullsized":"2023-07-12T02:02:59.773144+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:16:21.659942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.559341+0000","last_change":"2023-07-12T02:02:59.557738+0000","last_active":"2023-07-12T02:02:59.559341+0000","last_peered":"2023-07-12T02:02:59.559341+0000","last_clean":"2023-07-12T02:02:59.559341+0000","last_became_active":"2023-07-12T02:02:59.557407+0000","last_became_peered":"2023-07-12T02:02:59.557407+0000","last_unstale":"2023-07-12T02:02:59.559341+0000","last_undegraded":"2023-07-12T02:02:59.559341+0000","last_fullsized":"2023-07-12T02:02:59.559341+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:38:50.907467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.549790+0000","last_change":"2023-07-12T02:02:58.564573+0000","last_active":"2023-07-12T02:02:59.549790+0000","last_peered":"2023-07-12T02:02:59.549790+0000","last_clean":"2023-07-12T02:02:59.549790+0000","last_became_active":"2023-07-12T02:02:58.564274+0000","last_became_peered":"2023-07-12T02:02:58.564274+0000","last_unstale":"2023-07-12T02:02:59.549790+0000","last_undegraded":"2023-07-12T02:02:59.549790+0000","last_fullsized":"2023-07-12T02:02:59.549790+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T04:46:18.716604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.567390+0000","last_change":"2023-07-12T02:02:59.560613+0000","last_active":"2023-07-12T02:02:59.567390+0000","last_peered":"2023-07-12T02:02:59.567390+0000","last_clean":"2023-07-12T02:02:59.567390+0000","last_became_active":"2023-07-12T02:02:59.560305+0000","last_became_peered":"2023-07-12T02:02:59.560305+0000","last_unstale":"2023-07-12T02:02:59.567390+0000","last_undegraded":"2023-07-12T02:02:59.567390+0000","last_fullsized":"2023-07-12T02:02:59.567390+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:49:08.422815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.573074+0000","last_change":"2023-07-12T02:02:58.562876+0000","last_active":"2023-07-12T02:02:59.573074+0000","last_peered":"2023-07-12T02:02:59.573074+0000","last_clean":"2023-07-12T02:02:59.573074+0000","last_became_active":"2023-07-12T02:02:58.562550+0000","last_became_peered":"2023-07-12T02:02:58.562550+0000","last_unstale":"2023-07-12T02:02:59.573074+0000","last_undegraded":"2023-07-12T02:02:59.573074+0000","last_fullsized":"2023-07-12T02:02:59.573074+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:32:02.936782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.559273+0000","last_change":"2023-07-12T02:02:59.557705+0000","last_active":"2023-07-12T02:02:59.559273+0000","last_peered":"2023-07-12T02:02:59.559273+0000","last_clean":"2023-07-12T02:02:59.559273+0000","last_became_active":"2023-07-12T02:02:59.557386+0000","last_became_peered":"2023-07-12T02:02:59.557386+0000","last_unstale":"2023-07-12T02:02:59.559273+0000","last_undegraded":"2023-07-12T02:02:59.559273+0000","last_fullsized":"2023-07-12T02:02:59.559273+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:26:15.135696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"30'8","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.777547+0000","last_change":"2023-07-12T02:02:58.566814+0000","last_active":"2023-07-12T02:02:59.777547+0000","last_peered":"2023-07-12T02:02:59.777547+0000","last_clean":"2023-07-12T02:02:59.777547+0000","last_became_active":"2023-07-12T02:02:58.566478+0000","last_became_peered":"2023-07-12T02:02:58.566478+0000","last_unstale":"2023-07-12T02:02:59.777547+0000","last_undegraded":"2023-07-12T02:02:59.777547+0000","last_fullsized":"2023-07-12T02:02:59.777547+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:43:56.890330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.579755+0000","last_change":"2023-07-12T02:02:59.578931+0000","last_active":"2023-07-12T02:02:59.579755+0000","last_peered":"2023-07-12T02:02:59.579755+0000","last_clean":"2023-07-12T02:02:59.579755+0000","last_became_active":"2023-07-12T02:02:59.578640+0000","last_became_peered":"2023-07-12T02:02:59.578640+0000","last_unstale":"2023-07-12T02:02:59.579755+0000","last_undegraded":"2023-07-12T02:02:59.579755+0000","last_fullsized":"2023-07-12T02:02:59.579755+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:15:46.913037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"30'1","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.776863+0000","last_change":"2023-07-12T02:02:58.563588+0000","last_active":"2023-07-12T02:02:59.776863+0000","last_peered":"2023-07-12T02:02:59.776863+0000","last_clean":"2023-07-12T02:02:59.776863+0000","last_became_active":"2023-07-12T02:02:58.563393+0000","last_became_peered":"2023-07-12T02:02:58.563393+0000","last_unstale":"2023-07-12T02:02:59.776863+0000","last_undegraded":"2023-07-12T02:02:59.776863+0000","last_fullsized":"2023-07-12T02:02:59.776863+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:08:46.902107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.573692+0000","last_change":"2023-07-12T02:02:59.571326+0000","last_active":"2023-07-12T02:02:59.573692+0000","last_peered":"2023-07-12T02:02:59.573692+0000","last_clean":"2023-07-12T02:02:59.573692+0000","last_became_active":"2023-07-12T02:02:59.570647+0000","last_became_peered":"2023-07-12T02:02:59.570647+0000","last_unstale":"2023-07-12T02:02:59.573692+0000","last_undegraded":"2023-07-12T02:02:59.573692+0000","last_fullsized":"2023-07-12T02:02:59.573692+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:00:49.677905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.773359+0000","last_change":"2023-07-12T02:02:58.564238+0000","last_active":"2023-07-12T02:02:59.773359+0000","last_peered":"2023-07-12T02:02:59.773359+0000","last_clean":"2023-07-12T02:02:59.773359+0000","last_became_active":"2023-07-12T02:02:58.563943+0000","last_became_peered":"2023-07-12T02:02:58.563943+0000","last_unstale":"2023-07-12T02:02:59.773359+0000","last_undegraded":"2023-07-12T02:02:59.773359+0000","last_fullsized":"2023-07-12T02:02:59.773359+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:08:10.780545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.572499+0000","last_change":"2023-07-12T02:02:59.569645+0000","last_active":"2023-07-12T02:02:59.572499+0000","last_peered":"2023-07-12T02:02:59.572499+0000","last_clean":"2023-07-12T02:02:59.572499+0000","last_became_active":"2023-07-12T02:02:59.568893+0000","last_became_peered":"2023-07-12T02:02:59.568893+0000","last_unstale":"2023-07-12T02:02:59.572499+0000","last_undegraded":"2023-07-12T02:02:59.572499+0000","last_fullsized":"2023-07-12T02:02:59.572499+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:15:36.117000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"30'1","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.776771+0000","last_change":"2023-07-12T02:02:58.557603+0000","last_active":"2023-07-12T02:02:59.776771+0000","last_peered":"2023-07-12T02:02:59.776771+0000","last_clean":"2023-07-12T02:02:59.776771+0000","last_became_active":"2023-07-12T02:02:58.557264+0000","last_became_peered":"2023-07-12T02:02:58.557264+0000","last_unstale":"2023-07-12T02:02:59.776771+0000","last_undegraded":"2023-07-12T02:02:59.776771+0000","last_fullsized":"2023-07-12T02:02:59.776771+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:29:08.918299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.561401+0000","last_change":"2023-07-12T02:02:59.559169+0000","last_active":"2023-07-12T02:02:59.561401+0000","last_peered":"2023-07-12T02:02:59.561401+0000","last_clean":"2023-07-12T02:02:59.561401+0000","last_became_active":"2023-07-12T02:02:59.558860+0000","last_became_peered":"2023-07-12T02:02:59.558860+0000","last_unstale":"2023-07-12T02:02:59.561401+0000","last_undegraded":"2023-07-12T02:02:59.561401+0000","last_fullsized":"2023-07-12T02:02:59.561401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:50:20.581566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.551110+0000","last_change":"2023-07-12T02:02:58.558243+0000","last_active":"2023-07-12T02:02:59.551110+0000","last_peered":"2023-07-12T02:02:59.551110+0000","last_clean":"2023-07-12T02:02:59.551110+0000","last_became_active":"2023-07-12T02:02:58.557959+0000","last_became_peered":"2023-07-12T02:02:58.557959+0000","last_unstale":"2023-07-12T02:02:59.551110+0000","last_undegraded":"2023-07-12T02:02:59.551110+0000","last_fullsized":"2023-07-12T02:02:59.551110+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:27:10.617108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.573756+0000","last_change":"2023-07-12T02:02:59.562520+0000","last_active":"2023-07-12T02:02:59.573756+0000","last_peered":"2023-07-12T02:02:59.573756+0000","last_clean":"2023-07-12T02:02:59.573756+0000","last_became_active":"2023-07-12T02:02:59.562205+0000","last_became_peered":"2023-07-12T02:02:59.562205+0000","last_unstale":"2023-07-12T02:02:59.573756+0000","last_undegraded":"2023-07-12T02:02:59.573756+0000","last_fullsized":"2023-07-12T02:02:59.573756+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:00:49.677905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.772289+0000","last_change":"2023-07-12T02:02:58.553955+0000","last_active":"2023-07-12T02:02:59.772289+0000","last_peered":"2023-07-12T02:02:59.772289+0000","last_clean":"2023-07-12T02:02:59.772289+0000","last_became_active":"2023-07-12T02:02:58.553638+0000","last_became_peered":"2023-07-12T02:02:58.553638+0000","last_unstale":"2023-07-12T02:02:59.772289+0000","last_undegraded":"2023-07-12T02:02:59.772289+0000","last_fullsized":"2023-07-12T02:02:59.772289+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:49:24.910550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.567964+0000","last_change":"2023-07-12T02:02:59.567398+0000","last_active":"2023-07-12T02:02:59.567964+0000","last_peered":"2023-07-12T02:02:59.567964+0000","last_clean":"2023-07-12T02:02:59.567964+0000","last_became_active":"2023-07-12T02:02:59.566080+0000","last_became_peered":"2023-07-12T02:02:59.566080+0000","last_unstale":"2023-07-12T02:02:59.567964+0000","last_undegraded":"2023-07-12T02:02:59.567964+0000","last_fullsized":"2023-07-12T02:02:59.567964+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:40:45.050634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.549173+0000","last_change":"2023-07-12T02:02:58.558296+0000","last_active":"2023-07-12T02:02:59.549173+0000","last_peered":"2023-07-12T02:02:59.549173+0000","last_clean":"2023-07-12T02:02:59.549173+0000","last_became_active":"2023-07-12T02:02:58.558054+0000","last_became_peered":"2023-07-12T02:02:58.558054+0000","last_unstale":"2023-07-12T02:02:59.549173+0000","last_undegraded":"2023-07-12T02:02:59.549173+0000","last_fullsized":"2023-07-12T02:02:59.549173+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:36:44.738971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.583819+0000","last_change":"2023-07-12T02:02:59.581474+0000","last_active":"2023-07-12T02:02:59.583819+0000","last_peered":"2023-07-12T02:02:59.583819+0000","last_clean":"2023-07-12T02:02:59.583819+0000","last_became_active":"2023-07-12T02:02:59.581173+0000","last_became_peered":"2023-07-12T02:02:59.581173+0000","last_unstale":"2023-07-12T02:02:59.583819+0000","last_undegraded":"2023-07-12T02:02:59.583819+0000","last_fullsized":"2023-07-12T02:02:59.583819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:22:20.122017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.548500+0000","last_change":"2023-07-12T02:02:58.566812+0000","last_active":"2023-07-12T02:02:59.548500+0000","last_peered":"2023-07-12T02:02:59.548500+0000","last_clean":"2023-07-12T02:02:59.548500+0000","last_became_active":"2023-07-12T02:02:58.566520+0000","last_became_peered":"2023-07-12T02:02:58.566520+0000","last_unstale":"2023-07-12T02:02:59.548500+0000","last_undegraded":"2023-07-12T02:02:59.548500+0000","last_fullsized":"2023-07-12T02:02:59.548500+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:38:49.902838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.568009+0000","last_change":"2023-07-12T02:02:59.566614+0000","last_active":"2023-07-12T02:02:59.568009+0000","last_peered":"2023-07-12T02:02:59.568009+0000","last_clean":"2023-07-12T02:02:59.568009+0000","last_became_active":"2023-07-12T02:02:59.565626+0000","last_became_peered":"2023-07-12T02:02:59.565626+0000","last_unstale":"2023-07-12T02:02:59.568009+0000","last_undegraded":"2023-07-12T02:02:59.568009+0000","last_fullsized":"2023-07-12T02:02:59.568009+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:21:03.713062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.551257+0000","last_change":"2023-07-12T02:02:58.558396+0000","last_active":"2023-07-12T02:02:59.551257+0000","last_peered":"2023-07-12T02:02:59.551257+0000","last_clean":"2023-07-12T02:02:59.551257+0000","last_became_active":"2023-07-12T02:02:58.558078+0000","last_became_peered":"2023-07-12T02:02:58.558078+0000","last_unstale":"2023-07-12T02:02:59.551257+0000","last_undegraded":"2023-07-12T02:02:59.551257+0000","last_fullsized":"2023-07-12T02:02:59.551257+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T13:24:05.494239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.572554+0000","last_change":"2023-07-12T02:02:59.569480+0000","last_active":"2023-07-12T02:02:59.572554+0000","last_peered":"2023-07-12T02:02:59.572554+0000","last_clean":"2023-07-12T02:02:59.572554+0000","last_became_active":"2023-07-12T02:02:59.569222+0000","last_became_peered":"2023-07-12T02:02:59.569222+0000","last_unstale":"2023-07-12T02:02:59.572554+0000","last_undegraded":"2023-07-12T02:02:59.572554+0000","last_fullsized":"2023-07-12T02:02:59.572554+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:43:57.894959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.563349+0000","last_change":"2023-07-12T02:02:58.561287+0000","last_active":"2023-07-12T02:02:59.563349+0000","last_peered":"2023-07-12T02:02:59.563349+0000","last_clean":"2023-07-12T02:02:59.563349+0000","last_became_active":"2023-07-12T02:02:58.560993+0000","last_became_peered":"2023-07-12T02:02:58.560993+0000","last_unstale":"2023-07-12T02:02:59.563349+0000","last_undegraded":"2023-07-12T02:02:59.563349+0000","last_fullsized":"2023-07-12T02:02:59.563349+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:06:10.377475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.564335+0000","last_change":"2023-07-12T02:02:07.598601+0000","last_active":"2023-07-12T02:02:59.564335+0000","last_peered":"2023-07-12T02:02:59.564335+0000","last_clean":"2023-07-12T02:02:59.564335+0000","last_became_active":"2023-07-12T02:02:07.598343+0000","last_became_peered":"2023-07-12T02:02:07.598343+0000","last_unstale":"2023-07-12T02:02:59.564335+0000","last_undegraded":"2023-07-12T02:02:59.564335+0000","last_fullsized":"2023-07-12T02:02:59.564335+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:29:07.010645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.582123+0000","last_change":"2023-07-12T02:02:59.579519+0000","last_active":"2023-07-12T02:02:59.582123+0000","last_peered":"2023-07-12T02:02:59.582123+0000","last_clean":"2023-07-12T02:02:59.582123+0000","last_became_active":"2023-07-12T02:02:59.579198+0000","last_became_peered":"2023-07-12T02:02:59.579198+0000","last_unstale":"2023-07-12T02:02:59.582123+0000","last_undegraded":"2023-07-12T02:02:59.582123+0000","last_fullsized":"2023-07-12T02:02:59.582123+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:06:35.297037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.549909+0000","last_change":"2023-07-12T02:02:58.563389+0000","last_active":"2023-07-12T02:02:59.549909+0000","last_peered":"2023-07-12T02:02:59.549909+0000","last_clean":"2023-07-12T02:02:59.549909+0000","last_became_active":"2023-07-12T02:02:58.563092+0000","last_became_peered":"2023-07-12T02:02:58.563092+0000","last_unstale":"2023-07-12T02:02:59.549909+0000","last_undegraded":"2023-07-12T02:02:59.549909+0000","last_fullsized":"2023-07-12T02:02:59.549909+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:29:24.511031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.550408+0000","last_change":"2023-07-12T02:02:07.268647+0000","last_active":"2023-07-12T02:02:59.550408+0000","last_peered":"2023-07-12T02:02:59.550408+0000","last_clean":"2023-07-12T02:02:59.550408+0000","last_became_active":"2023-07-12T02:02:07.268304+0000","last_became_peered":"2023-07-12T02:02:07.268304+0000","last_unstale":"2023-07-12T02:02:59.550408+0000","last_undegraded":"2023-07-12T02:02:59.550408+0000","last_fullsized":"2023-07-12T02:02:59.550408+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:48:16.142421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.566528+0000","last_change":"2023-07-12T02:02:59.565240+0000","last_active":"2023-07-12T02:02:59.566528+0000","last_peered":"2023-07-12T02:02:59.566528+0000","last_clean":"2023-07-12T02:02:59.566528+0000","last_became_active":"2023-07-12T02:02:59.564928+0000","last_became_peered":"2023-07-12T02:02:59.564928+0000","last_unstale":"2023-07-12T02:02:59.566528+0000","last_undegraded":"2023-07-12T02:02:59.566528+0000","last_fullsized":"2023-07-12T02:02:59.566528+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:08:44.156931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.773352+0000","last_change":"2023-07-12T02:02:58.562579+0000","last_active":"2023-07-12T02:02:59.773352+0000","last_peered":"2023-07-12T02:02:59.773352+0000","last_clean":"2023-07-12T02:02:59.773352+0000","last_became_active":"2023-07-12T02:02:58.562303+0000","last_became_peered":"2023-07-12T02:02:58.562303+0000","last_unstale":"2023-07-12T02:02:59.773352+0000","last_undegraded":"2023-07-12T02:02:59.773352+0000","last_fullsized":"2023-07-12T02:02:59.773352+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:25:45.833837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.548914+0000","last_change":"2023-07-12T02:02:07.270653+0000","last_active":"2023-07-12T02:02:59.548914+0000","last_peered":"2023-07-12T02:02:59.548914+0000","last_clean":"2023-07-12T02:02:59.548914+0000","last_became_active":"2023-07-12T02:02:07.270293+0000","last_became_peered":"2023-07-12T02:02:07.270293+0000","last_unstale":"2023-07-12T02:02:59.548914+0000","last_undegraded":"2023-07-12T02:02:59.548914+0000","last_fullsized":"2023-07-12T02:02:59.548914+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T06:36:34.847406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":183,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.548723+0000","last_change":"2023-07-12T02:02:07.268364+0000","last_active":"2023-07-12T02:02:59.548723+0000","last_peered":"2023-07-12T02:02:59.548723+0000","last_clean":"2023-07-12T02:02:59.548723+0000","last_became_active":"2023-07-12T02:02:07.268074+0000","last_became_peered":"2023-07-12T02:02:07.268074+0000","last_unstale":"2023-07-12T02:02:59.548723+0000","last_undegraded":"2023-07-12T02:02:59.548723+0000","last_fullsized":"2023-07-12T02:02:59.548723+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:20:11.432669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.579022+0000","last_change":"2023-07-12T02:02:59.576199+0000","last_active":"2023-07-12T02:02:59.579022+0000","last_peered":"2023-07-12T02:02:59.579022+0000","last_clean":"2023-07-12T02:02:59.579022+0000","last_became_active":"2023-07-12T02:02:59.575923+0000","last_became_peered":"2023-07-12T02:02:59.575923+0000","last_unstale":"2023-07-12T02:02:59.579022+0000","last_undegraded":"2023-07-12T02:02:59.579022+0000","last_fullsized":"2023-07-12T02:02:59.579022+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:29:59.291038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.549420+0000","last_change":"2023-07-12T02:02:58.563926+0000","last_active":"2023-07-12T02:02:59.549420+0000","last_peered":"2023-07-12T02:02:59.549420+0000","last_clean":"2023-07-12T02:02:59.549420+0000","last_became_active":"2023-07-12T02:02:58.563617+0000","last_became_peered":"2023-07-12T02:02:58.563617+0000","last_unstale":"2023-07-12T02:02:59.549420+0000","last_undegraded":"2023-07-12T02:02:59.549420+0000","last_fullsized":"2023-07-12T02:02:59.549420+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:43:49.433673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.547896+0000","last_change":"2023-07-12T02:02:07.599189+0000","last_active":"2023-07-12T02:02:59.547896+0000","last_peered":"2023-07-12T02:02:59.547896+0000","last_clean":"2023-07-12T02:02:59.547896+0000","last_became_active":"2023-07-12T02:02:07.598898+0000","last_became_peered":"2023-07-12T02:02:07.598898+0000","last_unstale":"2023-07-12T02:02:59.547896+0000","last_undegraded":"2023-07-12T02:02:59.547896+0000","last_fullsized":"2023-07-12T02:02:59.547896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T09:32:45.919383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.571542+0000","last_change":"2023-07-12T02:02:59.569636+0000","last_active":"2023-07-12T02:02:59.571542+0000","last_peered":"2023-07-12T02:02:59.571542+0000","last_clean":"2023-07-12T02:02:59.571542+0000","last_became_active":"2023-07-12T02:02:59.569357+0000","last_became_peered":"2023-07-12T02:02:59.569357+0000","last_unstale":"2023-07-12T02:02:59.571542+0000","last_undegraded":"2023-07-12T02:02:59.571542+0000","last_fullsized":"2023-07-12T02:02:59.571542+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T12:34:49.428324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.548404+0000","last_change":"2023-07-12T02:02:58.567214+0000","last_active":"2023-07-12T02:02:59.548404+0000","last_peered":"2023-07-12T02:02:59.548404+0000","last_clean":"2023-07-12T02:02:59.548404+0000","last_became_active":"2023-07-12T02:02:58.566374+0000","last_became_peered":"2023-07-12T02:02:58.566374+0000","last_unstale":"2023-07-12T02:02:59.548404+0000","last_undegraded":"2023-07-12T02:02:59.548404+0000","last_fullsized":"2023-07-12T02:02:59.548404+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:29:24.511031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.548382+0000","last_change":"2023-07-12T02:02:07.599193+0000","last_active":"2023-07-12T02:02:59.548382+0000","last_peered":"2023-07-12T02:02:59.548382+0000","last_clean":"2023-07-12T02:02:59.548382+0000","last_became_active":"2023-07-12T02:02:07.598910+0000","last_became_peered":"2023-07-12T02:02:07.598910+0000","last_unstale":"2023-07-12T02:02:59.548382+0000","last_undegraded":"2023-07-12T02:02:59.548382+0000","last_fullsized":"2023-07-12T02:02:59.548382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T03:05:19.101711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.571306+0000","last_change":"2023-07-12T02:02:59.569755+0000","last_active":"2023-07-12T02:02:59.571306+0000","last_peered":"2023-07-12T02:02:59.571306+0000","last_clean":"2023-07-12T02:02:59.571306+0000","last_became_active":"2023-07-12T02:02:59.569421+0000","last_became_peered":"2023-07-12T02:02:59.569421+0000","last_unstale":"2023-07-12T02:02:59.571306+0000","last_undegraded":"2023-07-12T02:02:59.571306+0000","last_fullsized":"2023-07-12T02:02:59.571306+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:43:57.894959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.550852+0000","last_change":"2023-07-12T02:02:58.560662+0000","last_active":"2023-07-12T02:02:59.550852+0000","last_peered":"2023-07-12T02:02:59.550852+0000","last_clean":"2023-07-12T02:02:59.550852+0000","last_became_active":"2023-07-12T02:02:58.560370+0000","last_became_peered":"2023-07-12T02:02:58.560370+0000","last_unstale":"2023-07-12T02:02:59.550852+0000","last_undegraded":"2023-07-12T02:02:59.550852+0000","last_fullsized":"2023-07-12T02:02:59.550852+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:45:10.338765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.565790+0000","last_change":"2023-07-12T02:02:07.599477+0000","last_active":"2023-07-12T02:02:59.565790+0000","last_peered":"2023-07-12T02:02:59.565790+0000","last_clean":"2023-07-12T02:02:59.565790+0000","last_became_active":"2023-07-12T02:02:07.599111+0000","last_became_peered":"2023-07-12T02:02:07.599111+0000","last_unstale":"2023-07-12T02:02:59.565790+0000","last_undegraded":"2023-07-12T02:02:59.565790+0000","last_fullsized":"2023-07-12T02:02:59.565790+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T05:14:54.632643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.579934+0000","last_change":"2023-07-12T02:02:59.579133+0000","last_active":"2023-07-12T02:02:59.579934+0000","last_peered":"2023-07-12T02:02:59.579934+0000","last_clean":"2023-07-12T02:02:59.579934+0000","last_became_active":"2023-07-12T02:02:59.578804+0000","last_became_peered":"2023-07-12T02:02:59.578804+0000","last_unstale":"2023-07-12T02:02:59.579934+0000","last_undegraded":"2023-07-12T02:02:59.579934+0000","last_fullsized":"2023-07-12T02:02:59.579934+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T02:16:47.936459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.574968+0000","last_change":"2023-07-12T02:02:58.562742+0000","last_active":"2023-07-12T02:02:59.574968+0000","last_peered":"2023-07-12T02:02:59.574968+0000","last_clean":"2023-07-12T02:02:59.574968+0000","last_became_active":"2023-07-12T02:02:58.562413+0000","last_became_peered":"2023-07-12T02:02:58.562413+0000","last_unstale":"2023-07-12T02:02:59.574968+0000","last_undegraded":"2023-07-12T02:02:59.574968+0000","last_fullsized":"2023-07-12T02:02:59.574968+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:27:38.511867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.570939+0000","last_change":"2023-07-12T02:02:07.599427+0000","last_active":"2023-07-12T02:02:59.570939+0000","last_peered":"2023-07-12T02:02:59.570939+0000","last_clean":"2023-07-12T02:02:59.570939+0000","last_became_active":"2023-07-12T02:02:07.599063+0000","last_became_peered":"2023-07-12T02:02:07.599063+0000","last_unstale":"2023-07-12T02:02:59.570939+0000","last_undegraded":"2023-07-12T02:02:59.570939+0000","last_fullsized":"2023-07-12T02:02:59.570939+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T08:26:26.888037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.561435+0000","last_change":"2023-07-12T02:02:59.560541+0000","last_active":"2023-07-12T02:02:59.561435+0000","last_peered":"2023-07-12T02:02:59.561435+0000","last_clean":"2023-07-12T02:02:59.561435+0000","last_became_active":"2023-07-12T02:02:59.560242+0000","last_became_peered":"2023-07-12T02:02:59.560242+0000","last_unstale":"2023-07-12T02:02:59.561435+0000","last_undegraded":"2023-07-12T02:02:59.561435+0000","last_fullsized":"2023-07-12T02:02:59.561435+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:58.537799+0000","last_clean_scrub_stamp":"2023-07-12T02:02:58.537799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:59:14.382477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.549236+0000","last_change":"2023-07-12T02:02:58.559053+0000","last_active":"2023-07-12T02:02:59.549236+0000","last_peered":"2023-07-12T02:02:59.549236+0000","last_clean":"2023-07-12T02:02:59.549236+0000","last_became_active":"2023-07-12T02:02:58.558775+0000","last_became_peered":"2023-07-12T02:02:58.558775+0000","last_unstale":"2023-07-12T02:02:59.549236+0000","last_undegraded":"2023-07-12T02:02:59.549236+0000","last_fullsized":"2023-07-12T02:02:59.549236+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:57.533170+0000","last_clean_scrub_stamp":"2023-07-12T02:02:57.533170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T07:35:29.605485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-07-12T02:02:59.570549+0000","last_change":"2023-07-12T02:02:07.272059+0000","last_active":"2023-07-12T02:02:59.570549+0000","last_peered":"2023-07-12T02:02:59.570549+0000","last_clean":"2023-07-12T02:02:59.570549+0000","last_became_active":"2023-07-12T02:02:07.271770+0000","last_became_peered":"2023-07-12T02:02:07.271770+0000","last_unstale":"2023-07-12T02:02:59.570549+0000","last_undegraded":"2023-07-12T02:02:59.570549+0000","last_fullsized":"2023-07-12T02:02:59.570549+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-12T02:02:06.257405+0000","last_clean_scrub_stamp":"2023-07-12T02:02:06.257405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-13T10:57:25.208935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":925696,"data_stored":723526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":126991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":913408,"data_stored":716398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.245}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":319488,"data_stored":126030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":331776,"data_stored":133158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":335872,"data_stored":134119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":339968,"data_stored":133762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":126991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-12T02:03:04.300 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-12T02:03:04.300 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-12T02:03:04.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.464+0000 7f274abf7700 1 Processor -- start 2023-07-12T02:03:04.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.464+0000 7f274abf7700 1 -- start start 2023-07-12T02:03:04.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.465+0000 7f274abf7700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f274406b120 0x7f27441474f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:04.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.465+0000 7f274abf7700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2744071b60 0x7f2744147a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:04.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.465+0000 7f274abf7700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f27440b6430 0x7f27440b68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:04.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.465+0000 7f274abf7700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2744070800 con 0x7f2744071b60 2023-07-12T02:03:04.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.465+0000 7f274abf7700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2744141c90 con 0x7f274406b120 2023-07-12T02:03:04.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.465+0000 7f274abf7700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27440b3bd0 con 0x7f27440b6430 2023-07-12T02:03:04.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.465+0000 7f2743fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2744071b60 0x7f2744147a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:04.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.465+0000 7f2743fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2744071b60 0x7f2744147a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59736/0 (socket says 172.21.15.60:59736) 2023-07-12T02:03:04.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.465+0000 7f2743fff700 1 -- 172.21.15.60:0/1557714376 learned_addr learned my addr 172.21.15.60:0/1557714376 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:03:04.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.465+0000 7f2748993700 1 --2- 172.21.15.60:0/1557714376 >> v2:172.21.15.79:3300/0 conn(0x7f274406b120 0x7f27441474f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:04.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.465+0000 7f2749194700 1 --2- 172.21.15.60:0/1557714376 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f27440b6430 0x7f27440b68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:04.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.465+0000 7f2743fff700 1 -- 172.21.15.60:0/1557714376 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f27440b6430 msgr2=0x7f27440b68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:04.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.465+0000 7f2743fff700 1 --2- 172.21.15.60:0/1557714376 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f27440b6430 0x7f27440b68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:04.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.465+0000 7f2743fff700 1 -- 172.21.15.60:0/1557714376 >> v2:172.21.15.79:3300/0 conn(0x7f274406b120 msgr2=0x7f27441474f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:04.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.465+0000 7f2743fff700 1 --2- 172.21.15.60:0/1557714376 >> v2:172.21.15.79:3300/0 conn(0x7f274406b120 0x7f27441474f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:04.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.465+0000 7f2743fff700 1 -- 172.21.15.60:0/1557714376 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27440714d0 con 0x7f2744071b60 2023-07-12T02:03:04.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.465+0000 7f2749194700 1 --2- 172.21.15.60:0/1557714376 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f27440b6430 0x7f27440b68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:03:04.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.465+0000 7f2743fff700 1 --2- 172.21.15.60:0/1557714376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2744071b60 0x7f2744147a30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f274406b830 tx=0x7f2730009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82ef88b4ec343386 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:04.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.465+0000 7f27437fe700 1 -- 172.21.15.60:0/1557714376 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273000b870 con 0x7f2744071b60 2023-07-12T02:03:04.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.465+0000 7f27437fe700 1 -- 172.21.15.60:0/1557714376 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273000b9d0 con 0x7f2744071b60 2023-07-12T02:03:04.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.465+0000 7f27437fe700 1 -- 172.21.15.60:0/1557714376 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273000bd60 con 0x7f2744071b60 2023-07-12T02:03:04.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.466+0000 7f274abf7700 1 -- 172.21.15.60:0/1557714376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2744071b60 msgr2=0x7f2744147a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:04.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.466+0000 7f274abf7700 1 --2- 172.21.15.60:0/1557714376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2744071b60 0x7f2744147a30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f274406b830 tx=0x7f2730009bd0 comp rx=0 tx=0).stop 2023-07-12T02:03:04.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.466+0000 7f274abf7700 1 -- 172.21.15.60:0/1557714376 shutdown_connections 2023-07-12T02:03:04.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.466+0000 7f274abf7700 1 --2- 172.21.15.60:0/1557714376 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f27440b6430 0x7f27440b68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:04.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.466+0000 7f274abf7700 1 --2- 172.21.15.60:0/1557714376 >> v2:172.21.15.79:3300/0 conn(0x7f274406b120 0x7f27441474f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:04.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.466+0000 7f274abf7700 1 --2- 172.21.15.60:0/1557714376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2744071b60 0x7f2744147a30 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:04.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.466+0000 7f274abf7700 1 -- 172.21.15.60:0/1557714376 >> 172.21.15.60:0/1557714376 conn(0x7f27440bd980 msgr2=0x7f27440b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:04.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.466+0000 7f274abf7700 1 -- 172.21.15.60:0/1557714376 shutdown_connections 2023-07-12T02:03:04.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.466+0000 7f274abf7700 1 -- 172.21.15.60:0/1557714376 wait complete. 2023-07-12T02:03:04.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.467+0000 7f274abf7700 1 Processor -- start 2023-07-12T02:03:04.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.467+0000 7f274abf7700 1 -- start start 2023-07-12T02:03:04.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.468+0000 7f274abf7700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f274406b120 0x7f2744146300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:04.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.468+0000 7f274abf7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2744071b60 0x7f27441cf450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:04.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.468+0000 7f274abf7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27440b6430 0x7f27441cd500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:04.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.468+0000 7f274abf7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2744146840 con 0x7f27440b6430 2023-07-12T02:03:04.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.468+0000 7f274abf7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27440b5df0 con 0x7f2744071b60 2023-07-12T02:03:04.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.468+0000 7f274abf7700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27441cee00 con 0x7f274406b120 2023-07-12T02:03:04.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.468+0000 7f2749194700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27440b6430 0x7f27441cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:04.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.468+0000 7f2749194700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27440b6430 0x7f27441cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59746/0 (socket says 172.21.15.60:59746) 2023-07-12T02:03:04.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.468+0000 7f2749194700 1 -- 172.21.15.60:0/975181979 learned_addr learned my addr 172.21.15.60:0/975181979 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:03:04.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.468+0000 7f2743fff700 1 --2- 172.21.15.60:0/975181979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2744071b60 0x7f27441cf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:04.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.468+0000 7f2748993700 1 --2- 172.21.15.60:0/975181979 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f274406b120 0x7f2744146300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:04.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.468+0000 7f2749194700 1 -- 172.21.15.60:0/975181979 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f274406b120 msgr2=0x7f2744146300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:04.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.468+0000 7f2749194700 1 --2- 172.21.15.60:0/975181979 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f274406b120 0x7f2744146300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:04.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.468+0000 7f2749194700 1 -- 172.21.15.60:0/975181979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2744071b60 msgr2=0x7f27441cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:04.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.468+0000 7f2749194700 1 --2- 172.21.15.60:0/975181979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2744071b60 0x7f27441cf450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:04.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.468+0000 7f2749194700 1 -- 172.21.15.60:0/975181979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2730009550 con 0x7f27440b6430 2023-07-12T02:03:04.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.468+0000 7f2748993700 1 --2- 172.21.15.60:0/975181979 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f274406b120 0x7f2744146300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:03:04.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.469+0000 7f2749194700 1 --2- 172.21.15.60:0/975181979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27440b6430 0x7f27441cd500 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f273c00cd50 tx=0x7f273c00a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:04.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.469+0000 7f27417fa700 1 -- 172.21.15.60:0/975181979 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273c00f480 con 0x7f27440b6430 2023-07-12T02:03:04.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.469+0000 7f27417fa700 1 -- 172.21.15.60:0/975181979 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273c00f600 con 0x7f27440b6430 2023-07-12T02:03:04.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.469+0000 7f27417fa700 1 -- 172.21.15.60:0/975181979 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273c00f9b0 con 0x7f27440b6430 2023-07-12T02:03:04.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.469+0000 7f274abf7700 1 -- 172.21.15.60:0/975181979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27440b6010 con 0x7f27440b6430 2023-07-12T02:03:04.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.469+0000 7f274abf7700 1 -- 172.21.15.60:0/975181979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27441ce600 con 0x7f27440b6430 2023-07-12T02:03:04.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.470+0000 7f274abf7700 1 -- 172.21.15.60:0/975181979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2744074360 con 0x7f27440b6430 2023-07-12T02:03:04.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.470+0000 7f27417fa700 1 -- 172.21.15.60:0/975181979 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f273c00b040 con 0x7f27440b6430 2023-07-12T02:03:04.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.470+0000 7f27417fa700 1 --2- 172.21.15.60:0/975181979 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f272806ace0 0x7f272806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:04.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.471+0000 7f27417fa700 1 -- 172.21.15.60:0/975181979 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f273c089d20 con 0x7f27440b6430 2023-07-12T02:03:04.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.471+0000 7f2748993700 1 --2- 172.21.15.60:0/975181979 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f272806ace0 0x7f272806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:04.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.471+0000 7f2748993700 1 --2- 172.21.15.60:0/975181979 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f272806ace0 0x7f272806d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f27380099e0 tx=0x7f2738008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:04.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.475+0000 7f27417fa700 1 -- 172.21.15.60:0/975181979 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f273c054dc0 con 0x7f27440b6430 2023-07-12T02:03:04.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.755+0000 7f274abf7700 1 -- 172.21.15.60:0/975181979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f27440b7a80 con 0x7f27440b6430 2023-07-12T02:03:04.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.758+0000 7f27417fa700 1 -- 172.21.15.60:0/975181979 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7f273c01d0e0 con 0x7f27440b6430 2023-07-12T02:03:04.762 INFO:teuthology.orchestra.run.smithi060.stdout:[client.0] 2023-07-12T02:03:04.763 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQBzCa5kvqP/EBAABFId+TiUCC5lJjpXOFAL7w== 2023-07-12T02:03:04.763 INFO:teuthology.orchestra.run.smithi060.stdout: caps mds = "allow" 2023-07-12T02:03:04.763 INFO:teuthology.orchestra.run.smithi060.stdout: caps mon = "allow r" 2023-07-12T02:03:04.763 INFO:teuthology.orchestra.run.smithi060.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-12T02:03:04.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.760+0000 7f274abf7700 1 -- 172.21.15.60:0/975181979 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f272806ace0 msgr2=0x7f272806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:04.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.760+0000 7f274abf7700 1 --2- 172.21.15.60:0/975181979 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f272806ace0 0x7f272806d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f27380099e0 tx=0x7f2738008040 comp rx=0 tx=0).stop 2023-07-12T02:03:04.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.760+0000 7f274abf7700 1 -- 172.21.15.60:0/975181979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27440b6430 msgr2=0x7f27441cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:04.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.760+0000 7f274abf7700 1 --2- 172.21.15.60:0/975181979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27440b6430 0x7f27441cd500 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f273c00cd50 tx=0x7f273c00a560 comp rx=0 tx=0).stop 2023-07-12T02:03:04.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.761+0000 7f274abf7700 1 -- 172.21.15.60:0/975181979 shutdown_connections 2023-07-12T02:03:04.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.761+0000 7f274abf7700 1 --2- 172.21.15.60:0/975181979 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f272806ace0 0x7f272806d190 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:04.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.761+0000 7f274abf7700 1 --2- 172.21.15.60:0/975181979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27440b6430 0x7f27441cd500 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:04.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.761+0000 7f274abf7700 1 --2- 172.21.15.60:0/975181979 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f274406b120 0x7f2744146300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:04.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.761+0000 7f274abf7700 1 --2- 172.21.15.60:0/975181979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2744071b60 0x7f27441cf450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:04.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.761+0000 7f274abf7700 1 -- 172.21.15.60:0/975181979 >> 172.21.15.60:0/975181979 conn(0x7f27440bd980 msgr2=0x7f27440baeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:04.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.761+0000 7f274abf7700 1 -- 172.21.15.60:0/975181979 shutdown_connections 2023-07-12T02:03:04.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.761+0000 7f274abf7700 1 -- 172.21.15.60:0/975181979 wait complete. 2023-07-12T02:03:04.766 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.0 2023-07-12T02:03:04.777 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-12T02:03:04.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.899+0000 7fde09b1f700 1 Processor -- start 2023-07-12T02:03:04.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.899+0000 7fde09b1f700 1 -- start start 2023-07-12T02:03:04.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.900+0000 7fde09b1f700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde0406f340 0x7fde0406edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:04.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.900+0000 7fde09b1f700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde040b93e0 con 0x7fde0406b120 2023-07-12T02:03:04.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.900+0000 7fde09b1f700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde04141200 con 0x7fde04071ab0 2023-07-12T02:03:04.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.900+0000 7fde09b1f700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde04071690 con 0x7fde0406f340 2023-07-12T02:03:04.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.900+0000 7fde037fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fde0406b120 0x7fde04140af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:38552/0 (socket says 172.21.15.60:38552) 2023-07-12T02:03:04.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.900+0000 7fde037fe700 1 -- 172.21.15.60:0/2919675900 learned_addr learned my addr 172.21.15.60:0/2919675900 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:03:04.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.901+0000 7fde03fff700 1 --2- 172.21.15.60:0/2919675900 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde0406f340 0x7fde0406edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:04.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.901+0000 7fde02ffd700 1 -- 172.21.15.60:0/2919675900 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 927329672 0 0) 0x7fde040b93e0 con 0x7fde0406b120 2023-07-12T02:03:04.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.901+0000 7fde02ffd700 1 -- 172.21.15.60:0/2919675900 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddf00035b0 con 0x7fde0406b120 2023-07-12T02:03:04.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.901+0000 7fde02ffd700 1 -- 172.21.15.60:0/2919675900 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 463284657 0 0) 0x7fde04141200 con 0x7fde04071ab0 2023-07-12T02:03:04.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.901+0000 7fde02ffd700 1 -- 172.21.15.60:0/2919675900 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde040b93e0 con 0x7fde04071ab0 2023-07-12T02:03:04.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.901+0000 7fde02ffd700 1 -- 172.21.15.60:0/2919675900 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1913201580 0 0) 0x7fddf00035b0 con 0x7fde0406b120 2023-07-12T02:03:04.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.901+0000 7fde02ffd700 1 -- 172.21.15.60:0/2919675900 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde0406f340 msgr2=0x7fde0406edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:04.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.901+0000 7fde02ffd700 1 --2- 172.21.15.60:0/2919675900 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde0406f340 0x7fde0406edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:04.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.901+0000 7fde02ffd700 1 -- 172.21.15.60:0/2919675900 >> v1:172.21.15.79:6789/0 conn(0x7fde04071ab0 legacy=0x7fde0414f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:04.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.901+0000 7fde02ffd700 1 -- 172.21.15.60:0/2919675900 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde0406f8d0 con 0x7fde0406b120 2023-07-12T02:03:04.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.901+0000 7fde02ffd700 1 -- 172.21.15.60:0/2919675900 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1141905739 0 0) 0x7fddf4001670 con 0x7fde0406b120 2023-07-12T02:03:04.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.901+0000 7fde02ffd700 1 -- 172.21.15.60:0/2919675900 >> v1:172.21.15.60:6789/0 conn(0x7fde0406b120 legacy=0x7fde04140af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:04.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.901+0000 7fde02ffd700 1 --2- 172.21.15.60:0/2919675900 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde0406f340 0x7fddf0003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:04.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.901+0000 7fde02ffd700 1 --2- 172.21.15.60:0/2919675900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddf0004120 0x7fddf0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:04.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.901+0000 7fde02ffd700 1 --2- 172.21.15.60:0/2919675900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddf0004d90 0x7fddf0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:04.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.901+0000 7fde02ffd700 1 -- 172.21.15.60:0/2919675900 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde04071690 con 0x7fddf0004d90 2023-07-12T02:03:04.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.901+0000 7fde02ffd700 1 -- 172.21.15.60:0/2919675900 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf000dcd0 con 0x7fddf0004120 2023-07-12T02:03:04.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.901+0000 7fde02ffd700 1 -- 172.21.15.60:0/2919675900 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf000de90 con 0x7fde0406f340 2023-07-12T02:03:04.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.901+0000 7fde03fff700 1 --2- 172.21.15.60:0/2919675900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddf0004d90 0x7fddf0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:04.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.901+0000 7fde037fe700 1 --2- 172.21.15.60:0/2919675900 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde0406f340 0x7fddf0003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:04.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.901+0000 7fddfbfff700 1 --2- 172.21.15.60:0/2919675900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddf0004120 0x7fddf0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:04.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.901+0000 7fde03fff700 1 -- 172.21.15.60:0/2919675900 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde0406f340 msgr2=0x7fddf0003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:04.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.901+0000 7fde03fff700 1 --2- 172.21.15.60:0/2919675900 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde0406f340 0x7fddf0003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:04.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.901+0000 7fde03fff700 1 -- 172.21.15.60:0/2919675900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddf0004120 msgr2=0x7fddf0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:04.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.901+0000 7fde03fff700 1 --2- 172.21.15.60:0/2919675900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddf0004120 0x7fddf0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:04.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.901+0000 7fde03fff700 1 -- 172.21.15.60:0/2919675900 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf00035b0 con 0x7fddf0004d90 2023-07-12T02:03:04.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.902+0000 7fde03fff700 1 --2- 172.21.15.60:0/2919675900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddf0004d90 0x7fddf0005200 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fddfc009f90 tx=0x7fddf0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dc35f5db448225c server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:04.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.902+0000 7fde02ffd700 1 -- 172.21.15.60:0/2919675900 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddfc00ec30 con 0x7fddf0004d90 2023-07-12T02:03:04.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.902+0000 7fde02ffd700 1 -- 172.21.15.60:0/2919675900 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddfc00f040 con 0x7fddf0004d90 2023-07-12T02:03:04.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.902+0000 7fde02ffd700 1 -- 172.21.15.60:0/2919675900 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddfc014480 con 0x7fddf0004d90 2023-07-12T02:03:04.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.902+0000 7fde09b1f700 1 -- 172.21.15.60:0/2919675900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddf0004d90 msgr2=0x7fddf0005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:04.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.902+0000 7fde09b1f700 1 --2- 172.21.15.60:0/2919675900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddf0004d90 0x7fddf0005200 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fddfc009f90 tx=0x7fddf0005880 comp rx=0 tx=0).stop 2023-07-12T02:03:04.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.902+0000 7fde03fff700 1 -- 172.21.15.60:0/2919675900 reap_dead start 2023-07-12T02:03:04.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.902+0000 7fde09b1f700 1 -- 172.21.15.60:0/2919675900 shutdown_connections 2023-07-12T02:03:04.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.902+0000 7fde09b1f700 1 -- 172.21.15.60:0/2919675900 >> 172.21.15.60:0/2919675900 conn(0x7fde040bd980 msgr2=0x7fde040b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:04.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.902+0000 7fde09b1f700 1 -- 172.21.15.60:0/2919675900 shutdown_connections 2023-07-12T02:03:04.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.902+0000 7fde09b1f700 1 -- 172.21.15.60:0/2919675900 wait complete. 2023-07-12T02:03:04.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.904+0000 7fde09b1f700 1 Processor -- start 2023-07-12T02:03:04.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.904+0000 7fde09b1f700 1 -- start start 2023-07-12T02:03:04.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.905+0000 7fde09b1f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddf0004d90 0x7fde041d0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:04.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.905+0000 7fde09b1f700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde04145550 0x7fde04147260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:04.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.905+0000 7fde09b1f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde041df640 0x7fde0413b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:04.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.905+0000 7fde09b1f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde041d0690 con 0x7fde041df640 2023-07-12T02:03:04.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.905+0000 7fde09b1f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde041477a0 con 0x7fddf0004d90 2023-07-12T02:03:04.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.905+0000 7fde09b1f700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde041df1b0 con 0x7fde04145550 2023-07-12T02:03:04.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.905+0000 7fde03fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde041df640 0x7fde0413b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:04.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.905+0000 7fde03fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde041df640 0x7fde0413b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59762/0 (socket says 172.21.15.60:59762) 2023-07-12T02:03:04.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.905+0000 7fde03fff700 1 -- 172.21.15.60:0/1172738894 learned_addr learned my addr 172.21.15.60:0/1172738894 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:03:04.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.905+0000 7fde037fe700 1 --2- 172.21.15.60:0/1172738894 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddf0004d90 0x7fde041d0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:04.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.905+0000 7fddfbfff700 1 --2- 172.21.15.60:0/1172738894 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde04145550 0x7fde04147260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:04.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.905+0000 7fde03fff700 1 -- 172.21.15.60:0/1172738894 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde04145550 msgr2=0x7fde04147260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:04.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.905+0000 7fde03fff700 1 --2- 172.21.15.60:0/1172738894 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde04145550 0x7fde04147260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:04.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.905+0000 7fde03fff700 1 -- 172.21.15.60:0/1172738894 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddf0004d90 msgr2=0x7fde041d0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:04.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.905+0000 7fde03fff700 1 --2- 172.21.15.60:0/1172738894 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddf0004d90 0x7fde041d0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:04.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.905+0000 7fde03fff700 1 -- 172.21.15.60:0/1172738894 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde041459d0 con 0x7fde041df640 2023-07-12T02:03:04.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.905+0000 7fde03fff700 1 --2- 172.21.15.60:0/1172738894 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde041df640 0x7fde0413b500 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fddf00047d0 tx=0x7fddfc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:04.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.905+0000 7fde00ff9700 1 -- 172.21.15.60:0/1172738894 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddfc009410 con 0x7fde041df640 2023-07-12T02:03:04.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.906+0000 7fde00ff9700 1 -- 172.21.15.60:0/1172738894 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddfc003a20 con 0x7fde041df640 2023-07-12T02:03:04.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.906+0000 7fde09b1f700 1 -- 172.21.15.60:0/1172738894 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde04145cb0 con 0x7fde041df640 2023-07-12T02:03:04.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.906+0000 7fde00ff9700 1 -- 172.21.15.60:0/1172738894 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddfc003dd0 con 0x7fde041df640 2023-07-12T02:03:04.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.906+0000 7fde09b1f700 1 -- 172.21.15.60:0/1172738894 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde040b7290 con 0x7fde041df640 2023-07-12T02:03:04.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.907+0000 7fde09b1f700 1 -- 172.21.15.60:0/1172738894 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde041df360 con 0x7fde041df640 2023-07-12T02:03:04.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.907+0000 7fde00ff9700 1 -- 172.21.15.60:0/1172738894 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fddfc023030 con 0x7fde041df640 2023-07-12T02:03:04.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.908+0000 7fde00ff9700 1 --2- 172.21.15.60:0/1172738894 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fdde406ace0 0x7fdde406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:04.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.908+0000 7fde00ff9700 1 -- 172.21.15.60:0/1172738894 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fddfc08a740 con 0x7fde041df640 2023-07-12T02:03:04.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.908+0000 7fde037fe700 1 --2- 172.21.15.60:0/1172738894 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fdde406ace0 0x7fdde406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:04.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.908+0000 7fde037fe700 1 --2- 172.21.15.60:0/1172738894 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fdde406ace0 0x7fdde406d190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fddf4007d70 tx=0x7fddf4001e10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:04.918 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:04.912+0000 7fde00ff9700 1 -- 172.21.15.60:0/1172738894 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fde041df360 con 0x7fde041df640 2023-07-12T02:03:05.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.154+0000 7fde09b1f700 1 -- 172.21.15.60:0/1172738894 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde041df320 con 0x7fde041df640 2023-07-12T02:03:05.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.154+0000 7fde00ff9700 1 -- 172.21.15.60:0/1172738894 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+3911 (secure 0 0 0) 0x7fddfc0557e0 con 0x7fde041df640 2023-07-12T02:03:05.159 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:03:05.159 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4897,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2527934877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":2527934877},{"type":"v1","addr":"172.21.15.79:6835","nonce":2527934877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4903,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2971951458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6833","nonce":2971951458},{"type":"v1","addr":"172.21.15.60:6835","nonce":2971951458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-12T02:02:58.961054+0000","modified":"2023-07-12T02:03:02.181602+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4971":{"gid":4971,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6834/646133464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":646133464},{"type":"v1","addr":"172.21.15.60:6834","nonce":646133464}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-12T02:03:05.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.157+0000 7fde09b1f700 1 -- 172.21.15.60:0/1172738894 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fdde406ace0 msgr2=0x7fdde406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:05.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.157+0000 7fde09b1f700 1 --2- 172.21.15.60:0/1172738894 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fdde406ace0 0x7fdde406d190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fddf4007d70 tx=0x7fddf4001e10 comp rx=0 tx=0).stop 2023-07-12T02:03:05.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.157+0000 7fde09b1f700 1 -- 172.21.15.60:0/1172738894 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde041df640 msgr2=0x7fde0413b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:05.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.157+0000 7fde09b1f700 1 --2- 172.21.15.60:0/1172738894 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde041df640 0x7fde0413b500 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fddf00047d0 tx=0x7fddfc009750 comp rx=0 tx=0).stop 2023-07-12T02:03:05.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.157+0000 7fde09b1f700 1 -- 172.21.15.60:0/1172738894 shutdown_connections 2023-07-12T02:03:05.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.157+0000 7fde09b1f700 1 --2- 172.21.15.60:0/1172738894 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fdde406ace0 0x7fdde406d190 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:05.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.157+0000 7fde09b1f700 1 --2- 172.21.15.60:0/1172738894 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde041df640 0x7fde0413b500 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:05.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.157+0000 7fde09b1f700 1 --2- 172.21.15.60:0/1172738894 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddf0004d90 0x7fde041d0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:05.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.157+0000 7fde09b1f700 1 --2- 172.21.15.60:0/1172738894 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde04145550 0x7fde04147260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:05.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.157+0000 7fde09b1f700 1 -- 172.21.15.60:0/1172738894 >> 172.21.15.60:0/1172738894 conn(0x7fde040bd980 msgr2=0x7fde0413f550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:05.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.157+0000 7fde09b1f700 1 -- 172.21.15.60:0/1172738894 shutdown_connections 2023-07-12T02:03:05.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.157+0000 7fde09b1f700 1 -- 172.21.15.60:0/1172738894 wait complete. 2023-07-12T02:03:05.163 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 16 2023-07-12T02:03:05.474 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-12T02:02:58.961054+0000', 'modified': '2023-07-12T02:03:02.181602+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4971}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4971': {'gid': 4971, 'name': 'a', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.60:6834/646133464', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6832', 'nonce': 646133464}, {'type': 'v1', 'addr': '172.21.15.60:6834', 'nonce': 646133464}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-12T02:03:05.475 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-12T02:03:05.475 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-07-12T02:03:05.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.600+0000 7ffbccad0700 1 Processor -- start 2023-07-12T02:03:05.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.600+0000 7ffbccad0700 1 -- start start 2023-07-12T02:03:05.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.601+0000 7ffbccad0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ffbc8071b60 0x7ffbc80b6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:05.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.601+0000 7ffbccad0700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbc80b3bd0 con 0x7ffbc8147c00 2023-07-12T02:03:05.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.601+0000 7ffbccad0700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbc80714d0 con 0x7ffbc806b120 2023-07-12T02:03:05.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.601+0000 7ffbccad0700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbc8070800 con 0x7ffbc8071b60 2023-07-12T02:03:05.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.601+0000 7ffbbdd9b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ffbc8147c00 0x7ffbc80b6430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:38566/0 (socket says 172.21.15.60:38566) 2023-07-12T02:03:05.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.601+0000 7ffbbdd9b700 1 -- 172.21.15.60:0/3845122814 learned_addr learned my addr 172.21.15.60:0/3845122814 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:03:05.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.601+0000 7ffbc6d9d700 1 --2- 172.21.15.60:0/3845122814 >> v2:172.21.15.79:3300/0 conn(0x7ffbc8071b60 0x7ffbc80b6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:05.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.602+0000 7ffbc5d9b700 1 -- 172.21.15.60:0/3845122814 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1829029264 0 0) 0x7ffbc80b3bd0 con 0x7ffbc8147c00 2023-07-12T02:03:05.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.602+0000 7ffbc5d9b700 1 -- 172.21.15.60:0/3845122814 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbb40035b0 con 0x7ffbc8147c00 2023-07-12T02:03:05.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.602+0000 7ffbc5d9b700 1 -- 172.21.15.60:0/3845122814 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2839095264 0 0) 0x7ffbb40035b0 con 0x7ffbc8147c00 2023-07-12T02:03:05.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.602+0000 7ffbc6d9d700 1 -- 172.21.15.60:0/3845122814 >> v1:172.21.15.79:6789/0 conn(0x7ffbc806b120 legacy=0x7ffbc81474f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:05.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.602+0000 7ffbc6d9d700 1 -- 172.21.15.60:0/3845122814 >> v1:172.21.15.60:6789/0 conn(0x7ffbc8147c00 legacy=0x7ffbc80b6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:05.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.602+0000 7ffbc6d9d700 1 -- 172.21.15.60:0/3845122814 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc80b3e20 con 0x7ffbc8071b60 2023-07-12T02:03:05.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.602+0000 7ffbc6d9d700 1 --2- 172.21.15.60:0/3845122814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbc8071b60 0x7ffbc80b6b40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0009d90 tx=0x7ffbc000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae64c7fa7b79bdfc server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:05.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.602+0000 7ffbc5d9b700 1 -- 172.21.15.60:0/3845122814 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc000e070 con 0x7ffbc8071b60 2023-07-12T02:03:05.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.602+0000 7ffbc5d9b700 1 -- 172.21.15.60:0/3845122814 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc0003a20 con 0x7ffbc8071b60 2023-07-12T02:03:05.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.602+0000 7ffbc5d9b700 1 -- 172.21.15.60:0/3845122814 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0001670 con 0x7ffbc8071b60 2023-07-12T02:03:05.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.603+0000 7ffbccad0700 1 -- 172.21.15.60:0/3845122814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbc8071b60 msgr2=0x7ffbc80b6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:05.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.603+0000 7ffbccad0700 1 --2- 172.21.15.60:0/3845122814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbc8071b60 0x7ffbc80b6b40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0009d90 tx=0x7ffbc000b330 comp rx=0 tx=0).stop 2023-07-12T02:03:05.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.603+0000 7ffbccad0700 1 -- 172.21.15.60:0/3845122814 shutdown_connections 2023-07-12T02:03:05.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.603+0000 7ffbccad0700 1 --2- 172.21.15.60:0/3845122814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbc8071b60 0x7ffbc80b6b40 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:05.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.603+0000 7ffbccad0700 1 -- 172.21.15.60:0/3845122814 >> 172.21.15.60:0/3845122814 conn(0x7ffbc80bd980 msgr2=0x7ffbc80b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:05.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.603+0000 7ffbccad0700 1 -- 172.21.15.60:0/3845122814 shutdown_connections 2023-07-12T02:03:05.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.603+0000 7ffbccad0700 1 -- 172.21.15.60:0/3845122814 wait complete. 2023-07-12T02:03:05.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.604+0000 7ffbccad0700 1 Processor -- start 2023-07-12T02:03:05.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.604+0000 7ffbccad0700 1 -- start start 2023-07-12T02:03:05.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.605+0000 7ffbccad0700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffbc806b120 0x7ffbc806f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:05.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.605+0000 7ffbccad0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbc8071b60 0x7ffbc8138400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:05.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.605+0000 7ffbccad0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbc8147c00 0x7ffbc813e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:05.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.605+0000 7ffbccad0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc806f570 con 0x7ffbc8147c00 2023-07-12T02:03:05.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.605+0000 7ffbccad0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc81d1100 con 0x7ffbc8071b60 2023-07-12T02:03:05.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.605+0000 7ffbccad0700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc81d0390 con 0x7ffbc806b120 2023-07-12T02:03:05.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.605+0000 7ffbc6d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbc8147c00 0x7ffbc813e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:05.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.605+0000 7ffbc6d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbc8147c00 0x7ffbc813e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59772/0 (socket says 172.21.15.60:59772) 2023-07-12T02:03:05.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.605+0000 7ffbc6d9d700 1 -- 172.21.15.60:0/2434768927 learned_addr learned my addr 172.21.15.60:0/2434768927 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:03:05.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.605+0000 7ffbc659c700 1 --2- 172.21.15.60:0/2434768927 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffbc806b120 0x7ffbc806f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:05.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.605+0000 7ffbbdd9b700 1 --2- 172.21.15.60:0/2434768927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbc8071b60 0x7ffbc8138400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:05.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.605+0000 7ffbc6d9d700 1 -- 172.21.15.60:0/2434768927 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffbc806b120 msgr2=0x7ffbc806f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:05.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.605+0000 7ffbc6d9d700 1 --2- 172.21.15.60:0/2434768927 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffbc806b120 0x7ffbc806f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:05.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.605+0000 7ffbc6d9d700 1 -- 172.21.15.60:0/2434768927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbc8071b60 msgr2=0x7ffbc8138400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:05.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.605+0000 7ffbc6d9d700 1 --2- 172.21.15.60:0/2434768927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbc8071b60 0x7ffbc8138400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:05.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.605+0000 7ffbc6d9d700 1 -- 172.21.15.60:0/2434768927 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc0009a70 con 0x7ffbc8147c00 2023-07-12T02:03:05.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.606+0000 7ffbc6d9d700 1 --2- 172.21.15.60:0/2434768927 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbc8147c00 0x7ffbc813e160 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0004000 tx=0x7ffbc0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:05.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.606+0000 7ffbbf7fe700 1 -- 172.21.15.60:0/2434768927 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc00045c0 con 0x7ffbc8147c00 2023-07-12T02:03:05.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.606+0000 7ffbbf7fe700 1 -- 172.21.15.60:0/2434768927 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc0004720 con 0x7ffbc8147c00 2023-07-12T02:03:05.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.606+0000 7ffbccad0700 1 -- 172.21.15.60:0/2434768927 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbc81d0560 con 0x7ffbc8147c00 2023-07-12T02:03:05.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.606+0000 7ffbbf7fe700 1 -- 172.21.15.60:0/2434768927 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0012430 con 0x7ffbc8147c00 2023-07-12T02:03:05.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.606+0000 7ffbccad0700 1 -- 172.21.15.60:0/2434768927 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbc81d0900 con 0x7ffbc8147c00 2023-07-12T02:03:05.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.607+0000 7ffbbf7fe700 1 -- 172.21.15.60:0/2434768927 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffbc0012590 con 0x7ffbc8147c00 2023-07-12T02:03:05.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.608+0000 7ffbbf7fe700 1 --2- 172.21.15.60:0/2434768927 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ffba806ace0 0x7ffba806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:05.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.608+0000 7ffbbf7fe700 1 -- 172.21.15.60:0/2434768927 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffbc008aa10 con 0x7ffbc8147c00 2023-07-12T02:03:05.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.608+0000 7ffbc659c700 1 --2- 172.21.15.60:0/2434768927 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ffba806ace0 0x7ffba806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:05.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.608+0000 7ffbc659c700 1 --2- 172.21.15.60:0/2434768927 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ffba806ace0 0x7ffba806d190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8007fd0 tx=0x7ffbb8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:05.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.610+0000 7ffbd8c69b80 1 Processor -- start 2023-07-12T02:03:05.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.610+0000 7ffbd8c69b80 1 -- start start 2023-07-12T02:03:05.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.611+0000 7ffbd8c69b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbc6ad0650 0x55cbc6acd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:05.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.611+0000 7ffbd8c69b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbc6accdb0 0x55cbc6afa9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:05.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.611+0000 7ffbd8c69b80 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55cbc6acd200 0x55cbc6afaf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:05.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.611+0000 7ffbd8c69b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbc6a46ea0 con 0x55cbc6accdb0 2023-07-12T02:03:05.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.611+0000 7ffbd8c69b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbc69ba600 con 0x55cbc6ad0650 2023-07-12T02:03:05.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.611+0000 7ffbd8c69b80 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cbc6a29910 con 0x55cbc6acd200 2023-07-12T02:03:05.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.611+0000 7ffbbdd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbc6accdb0 0x55cbc6afa9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:05.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.611+0000 7ffbbdd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbc6accdb0 0x55cbc6afa9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59776/0 (socket says 172.21.15.60:59776) 2023-07-12T02:03:05.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.611+0000 7ffbbdd9b700 1 -- 172.21.15.60:0/246900661 learned_addr learned my addr 172.21.15.60:0/246900661 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:03:05.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.611+0000 7ffbc659c700 1 --2- 172.21.15.60:0/246900661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbc6ad0650 0x55cbc6acd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:05.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.611+0000 7ffbc6d9d700 1 --2- 172.21.15.60:0/246900661 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55cbc6acd200 0x55cbc6afaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:05.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.611+0000 7ffbbdd9b700 1 -- 172.21.15.60:0/246900661 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55cbc6acd200 msgr2=0x55cbc6afaf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:05.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.611+0000 7ffbbdd9b700 1 --2- 172.21.15.60:0/246900661 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55cbc6acd200 0x55cbc6afaf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:05.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.611+0000 7ffbbdd9b700 1 -- 172.21.15.60:0/246900661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbc6ad0650 msgr2=0x55cbc6acd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:05.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.611+0000 7ffbbdd9b700 1 --2- 172.21.15.60:0/246900661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbc6ad0650 0x55cbc6acd9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:05.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.611+0000 7ffbbdd9b700 1 -- 172.21.15.60:0/246900661 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cbc6816790 con 0x55cbc6accdb0 2023-07-12T02:03:05.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.611+0000 7ffbbdd9b700 1 --2- 172.21.15.60:0/246900661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbc6accdb0 0x55cbc6afa9f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0004a50 tx=0x7ffbb0004d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44fc31dd7e6c0fe3 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:05.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.611+0000 7ffba7fff700 1 -- 172.21.15.60:0/246900661 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb000f8d0 con 0x55cbc6accdb0 2023-07-12T02:03:05.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.611+0000 7ffba7fff700 1 -- 172.21.15.60:0/246900661 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb000fa30 con 0x55cbc6accdb0 2023-07-12T02:03:05.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.611+0000 7ffba7fff700 1 -- 172.21.15.60:0/246900661 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb000fde0 con 0x55cbc6accdb0 2023-07-12T02:03:05.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.612+0000 7ffbd8c69b80 1 -- 172.21.15.60:0/246900661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbc6accdb0 msgr2=0x55cbc6afa9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:05.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.612+0000 7ffbd8c69b80 1 --2- 172.21.15.60:0/246900661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbc6accdb0 0x55cbc6afa9f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0004a50 tx=0x7ffbb0004d60 comp rx=0 tx=0).stop 2023-07-12T02:03:05.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.612+0000 7ffbd8c69b80 1 -- 172.21.15.60:0/246900661 shutdown_connections 2023-07-12T02:03:05.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.612+0000 7ffbd8c69b80 1 --2- 172.21.15.60:0/246900661 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55cbc6acd200 0x55cbc6afaf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:05.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.612+0000 7ffbd8c69b80 1 --2- 172.21.15.60:0/246900661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbc6ad0650 0x55cbc6acd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:05.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.612+0000 7ffbd8c69b80 1 --2- 172.21.15.60:0/246900661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbc6accdb0 0x55cbc6afa9f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:05.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.612+0000 7ffbd8c69b80 1 -- 172.21.15.60:0/246900661 >> 172.21.15.60:0/246900661 conn(0x55cbc6ac7320 msgr2=0x55cbc6ad1380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:05.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.612+0000 7ffbd8c69b80 1 -- 172.21.15.60:0/246900661 shutdown_connections 2023-07-12T02:03:05.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.612+0000 7ffbd8c69b80 1 -- 172.21.15.60:0/246900661 wait complete. 2023-07-12T02:03:05.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.613+0000 7ffbd8c69b80 1 -- start start 2023-07-12T02:03:05.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.613+0000 7ffbd8c69b80 1 Processor -- start 2023-07-12T02:03:05.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.614+0000 7ffbd8c69b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbc6accdb0 0x55cbc6b062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:05.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.614+0000 7ffbd8c69b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbc6acd200 0x55cbc6b1be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:05.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.614+0000 7ffbd8c69b80 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55cbc6ad0650 0x55cbc6b1c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:05.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.614+0000 7ffbd8c69b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbc6a22be0 con 0x55cbc6accdb0 2023-07-12T02:03:05.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.614+0000 7ffbd8c69b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbc69e05b0 con 0x55cbc6acd200 2023-07-12T02:03:05.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.614+0000 7ffbd8c69b80 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cbc69c6910 con 0x55cbc6ad0650 2023-07-12T02:03:05.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.614+0000 7ffbc659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbc6accdb0 0x55cbc6b062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:05.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.614+0000 7ffbd8c69b80 10 client.0 _ll_register_callbacks cb 0x55cbc69deb70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-12T02:03:05.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.614+0000 7ffbc659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbc6accdb0 0x55cbc6b062d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59792/0 (socket says 172.21.15.60:59792) 2023-07-12T02:03:05.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.614+0000 7ffbc659c700 1 -- 172.21.15.60:0/2086150969 learned_addr learned my addr 172.21.15.60:0/2086150969 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:03:05.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.614+0000 7ffbbdd9b700 1 --2- 172.21.15.60:0/2086150969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbc6acd200 0x55cbc6b1be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:05.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.614+0000 7ffbc6d9d700 1 --2- 172.21.15.60:0/2086150969 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55cbc6ad0650 0x55cbc6b1c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:05.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.615+0000 7ffbc659c700 1 -- 172.21.15.60:0/2086150969 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55cbc6ad0650 msgr2=0x55cbc6b1c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:05.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.615+0000 7ffbc659c700 1 --2- 172.21.15.60:0/2086150969 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55cbc6ad0650 0x55cbc6b1c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:05.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.615+0000 7ffbc659c700 1 -- 172.21.15.60:0/2086150969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbc6acd200 msgr2=0x55cbc6b1be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:05.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.615+0000 7ffbc659c700 1 --2- 172.21.15.60:0/2086150969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbc6acd200 0x55cbc6b1be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:05.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.615+0000 7ffbc659c700 1 -- 172.21.15.60:0/2086150969 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbb00016a0 con 0x55cbc6accdb0 2023-07-12T02:03:05.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.615+0000 7ffbc659c700 1 --2- 172.21.15.60:0/2086150969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbc6accdb0 0x55cbc6b062d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ffbb80144f0 tx=0x7ffbb8001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ec6f12732ea53bc server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:05.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.615+0000 7ffba57fa700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-07-12T02:03:05.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.615+0000 7ffba57fa700 1 -- 172.21.15.60:0/2086150969 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8014c80 con 0x55cbc6accdb0 2023-07-12T02:03:05.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.615+0000 7ffba57fa700 1 -- 172.21.15.60:0/2086150969 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffbb801c040 con 0x55cbc6accdb0 2023-07-12T02:03:05.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.615+0000 7ffbd8c69b80 1 -- 172.21.15.60:0/2086150969 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cbc6ac4930 con 0x55cbc6accdb0 2023-07-12T02:03:05.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.615+0000 7ffba57fa700 1 -- 172.21.15.60:0/2086150969 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffbb8014de0 con 0x55cbc6accdb0 2023-07-12T02:03:05.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.615+0000 7ffbd8c69b80 10 client.5157 fetch_fsmap learned FSMap version 16 2023-07-12T02:03:05.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.615+0000 7ffbd8c69b80 1 -- 172.21.15.60:0/2086150969 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55cbc69030a0 con 0x55cbc6accdb0 2023-07-12T02:03:05.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.615+0000 7ffba57fa700 1 -- 172.21.15.60:0/2086150969 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cbc6ac4930 con 0x55cbc6accdb0 2023-07-12T02:03:05.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.615+0000 7ffba57fa700 1 -- 172.21.15.60:0/2086150969 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 16) v1 ==== 2569+0+0 (secure 0 0 0) 0x7ffbb802a3f0 con 0x55cbc6accdb0 2023-07-12T02:03:05.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.615+0000 7ffbd8c69b80 10 client.5157 fetch_fsmap finished waiting for FSMap version 16 2023-07-12T02:03:05.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.615+0000 7ffbd8c69b80 10 client.5157 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-12T02:03:05.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.615+0000 7ffbd8c69b80 20 client.5157 populate_metadata read hostname 'smithi060' 2023-07-12T02:03:05.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.615+0000 7ffbd8c69b80 1 --2- 172.21.15.60:0/2086150969 >> [v2:172.21.15.60:6832/646133464,v1:172.21.15.60:6834/646133464] conn(0x55cbc6b1c950 0x55cbc6af06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:05.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.615+0000 7ffbd8c69b80 4 client.5157 mds_command: new command op to 4971 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-12T02:03:05.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.615+0000 7ffbd8c69b80 1 -- 172.21.15.60:0/2086150969 --> [v2:172.21.15.60:6832/646133464,v1:172.21.15.60:6834/646133464] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cbc6aa10e0 con 0x55cbc6b1c950 2023-07-12T02:03:05.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.615+0000 7ffbbdd9b700 1 --2- 172.21.15.60:0/2086150969 >> [v2:172.21.15.60:6832/646133464,v1:172.21.15.60:6834/646133464] conn(0x55cbc6b1c950 0x55cbc6af06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:05.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.616+0000 7ffba57fa700 10 client.5157 ms_handle_connect on v2:172.21.15.60:6832/646133464 2023-07-12T02:03:05.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.616+0000 7ffbbdd9b700 1 --2- 172.21.15.60:0/2086150969 >> [v2:172.21.15.60:6832/646133464,v1:172.21.15.60:6834/646133464] conn(0x55cbc6b1c950 0x55cbc6af06d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93d7263bd4c42489 server_cookie=f14b799f5f131a3 in_seq=0 out_seq=0 2023-07-12T02:03:05.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.616+0000 7ffba57fa700 1 -- 172.21.15.60:0/2086150969 <== mds.0 v2:172.21.15.60:6832/646133464 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55cbc6aa10e0 con 0x55cbc6b1c950 2023-07-12T02:03:05.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.616+0000 7ffba57fa700 10 client.5157 handle_command_reply: tid=0 2023-07-12T02:03:05.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.616+0000 7ffbd8c69b80 1 client.5157 shutdown 2023-07-12T02:03:05.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.616+0000 7ffbd8c69b80 1 -- 172.21.15.60:0/2086150969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbc6accdb0 msgr2=0x55cbc6b062d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:05.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.616+0000 7ffbd8c69b80 1 --2- 172.21.15.60:0/2086150969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbc6accdb0 0x55cbc6b062d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ffbb80144f0 tx=0x7ffbb8001120 comp rx=0 tx=0).stop 2023-07-12T02:03:05.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.617+0000 7ffbd8c69b80 1 -- 172.21.15.60:0/2086150969 shutdown_connections 2023-07-12T02:03:05.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.617+0000 7ffbd8c69b80 1 --2- 172.21.15.60:0/2086150969 >> [v2:172.21.15.60:6832/646133464,v1:172.21.15.60:6834/646133464] conn(0x55cbc6b1c950 0x55cbc6af06d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:05.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.617+0000 7ffbd8c69b80 1 --2- 172.21.15.60:0/2086150969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbc6accdb0 0x55cbc6b062d0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:05.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.617+0000 7ffba57fa700 0 client.5157 ms_handle_reset on v2:172.21.15.60:6832/646133464 2023-07-12T02:03:05.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.617+0000 7ffbd8c69b80 1 --2- 172.21.15.60:0/2086150969 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55cbc6ad0650 0x55cbc6b1c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:05.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.617+0000 7ffbd8c69b80 1 --2- 172.21.15.60:0/2086150969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbc6acd200 0x55cbc6b1be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:05.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.617+0000 7ffbd8c69b80 1 -- 172.21.15.60:0/2086150969 >> 172.21.15.60:0/2086150969 conn(0x55cbc6ac7320 msgr2=0x55cbc6af7120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:05.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.617+0000 7ffbd8c69b80 1 -- 172.21.15.60:0/2086150969 shutdown_connections 2023-07-12T02:03:05.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.617+0000 7ffbd8c69b80 1 -- 172.21.15.60:0/2086150969 wait complete. 2023-07-12T02:03:05.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.617+0000 7ffbd8c69b80 20 client.5157 trim_cache size 0 max 16384 2023-07-12T02:03:05.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.634+0000 7ffbd8c69b80 1 Processor -- start 2023-07-12T02:03:05.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.635+0000 7ffbd8c69b80 1 -- start start 2023-07-12T02:03:05.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.635+0000 7ffbd8c69b80 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55cbc6accdb0 0x55cbc6b06ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:05.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.635+0000 7ffbd8c69b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbc6acd200 0x55cbc6afd710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:05.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.635+0000 7ffbd8c69b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbc6ad0650 0x55cbc6afdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:05.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.635+0000 7ffbd8c69b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbc6817390 con 0x55cbc6ad0650 2023-07-12T02:03:05.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.635+0000 7ffbd8c69b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbc6b04a50 con 0x55cbc6acd200 2023-07-12T02:03:05.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.635+0000 7ffbd8c69b80 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cbc6b05c60 con 0x55cbc6accdb0 2023-07-12T02:03:05.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.635+0000 7ffbc6d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbc6ad0650 0x55cbc6afdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:05.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.635+0000 7ffbc6d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbc6ad0650 0x55cbc6afdc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59804/0 (socket says 172.21.15.60:59804) 2023-07-12T02:03:05.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.635+0000 7ffbc6d9d700 1 -- 172.21.15.60:0/1122430764 learned_addr learned my addr 172.21.15.60:0/1122430764 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:03:05.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.635+0000 7ffbbdd9b700 1 --2- 172.21.15.60:0/1122430764 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbc6acd200 0x55cbc6afd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:05.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.635+0000 7ffbc659c700 1 --2- 172.21.15.60:0/1122430764 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55cbc6accdb0 0x55cbc6b06ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:05.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.635+0000 7ffbc6d9d700 1 -- 172.21.15.60:0/1122430764 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55cbc6accdb0 msgr2=0x55cbc6b06ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:05.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.636+0000 7ffbc6d9d700 1 --2- 172.21.15.60:0/1122430764 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55cbc6accdb0 0x55cbc6b06ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:05.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.636+0000 7ffbc6d9d700 1 -- 172.21.15.60:0/1122430764 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbc6acd200 msgr2=0x55cbc6afd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:05.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.636+0000 7ffbc6d9d700 1 --2- 172.21.15.60:0/1122430764 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbc6acd200 0x55cbc6afd710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:05.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.636+0000 7ffbc6d9d700 1 -- 172.21.15.60:0/1122430764 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cbc69e8b10 con 0x55cbc6ad0650 2023-07-12T02:03:05.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.636+0000 7ffbc6d9d700 1 --2- 172.21.15.60:0/1122430764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbc6ad0650 0x55cbc6afdc50 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0059470 tx=0x7ffbc005f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d26e16552947765 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:05.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.636+0000 7ffbbcd99700 1 -- 172.21.15.60:0/1122430764 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0058c60 con 0x55cbc6ad0650 2023-07-12T02:03:05.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.636+0000 7ffbbcd99700 1 -- 172.21.15.60:0/1122430764 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc0058dc0 con 0x55cbc6ad0650 2023-07-12T02:03:05.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.636+0000 7ffbbcd99700 1 -- 172.21.15.60:0/1122430764 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0058f30 con 0x55cbc6ad0650 2023-07-12T02:03:05.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.636+0000 7ffbd8c69b80 1 -- 172.21.15.60:0/1122430764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbc6ad0650 msgr2=0x55cbc6afdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:05.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.636+0000 7ffbd8c69b80 1 --2- 172.21.15.60:0/1122430764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbc6ad0650 0x55cbc6afdc50 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0059470 tx=0x7ffbc005f040 comp rx=0 tx=0).stop 2023-07-12T02:03:05.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.636+0000 7ffbd8c69b80 1 -- 172.21.15.60:0/1122430764 shutdown_connections 2023-07-12T02:03:05.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.636+0000 7ffbd8c69b80 1 --2- 172.21.15.60:0/1122430764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbc6ad0650 0x55cbc6afdc50 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:05.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.636+0000 7ffbd8c69b80 1 --2- 172.21.15.60:0/1122430764 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55cbc6accdb0 0x55cbc6b06ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:05.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.636+0000 7ffbd8c69b80 1 --2- 172.21.15.60:0/1122430764 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbc6acd200 0x55cbc6afd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:05.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.636+0000 7ffbd8c69b80 1 -- 172.21.15.60:0/1122430764 >> 172.21.15.60:0/1122430764 conn(0x55cbc6ac7320 msgr2=0x55cbc6b2b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:05.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.637+0000 7ffbd8c69b80 1 -- 172.21.15.60:0/1122430764 shutdown_connections 2023-07-12T02:03:05.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.637+0000 7ffbd8c69b80 1 -- 172.21.15.60:0/1122430764 wait complete. 2023-07-12T02:03:05.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.637+0000 7ffbd8c69b80 1 -- start start 2023-07-12T02:03:05.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.637+0000 7ffbd8c69b80 1 Processor -- start 2023-07-12T02:03:05.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.638+0000 7ffbd8c69b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbc6accdb0 0x55cbc6b1bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:05.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.638+0000 7ffbd8c69b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbc6acd200 0x55cbc6b1c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:05.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.638+0000 7ffbd8c69b80 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55cbc6ad0650 0x55cbc6acb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:05.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.638+0000 7ffbd8c69b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbc6b116d0 con 0x55cbc6acd200 2023-07-12T02:03:05.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.638+0000 7ffbd8c69b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbc6b70310 con 0x55cbc6accdb0 2023-07-12T02:03:05.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.638+0000 7ffbd8c69b80 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cbc6af4120 con 0x55cbc6ad0650 2023-07-12T02:03:05.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.638+0000 7ffbd8c69b80 10 client.0 _ll_register_callbacks cb 0x7ffbb800fa70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-12T02:03:05.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.638+0000 7ffbc659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbc6accdb0 0x55cbc6b1bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:05.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.638+0000 7ffbbdd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbc6acd200 0x55cbc6b1c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:05.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.638+0000 7ffbc659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbc6accdb0 0x55cbc6b1bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.60:59528/0 (socket says 172.21.15.60:59528) 2023-07-12T02:03:05.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.638+0000 7ffbc659c700 1 -- 172.21.15.60:0/3307565846 learned_addr learned my addr 172.21.15.60:0/3307565846 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:03:05.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.638+0000 7ffbc6d9d700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55cbc6ad0650 0x55cbc6acb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:05.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.638+0000 7ffbbdd9b700 1 -- 172.21.15.60:0/3307565846 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55cbc6ad0650 msgr2=0x55cbc6acb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:05.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.638+0000 7ffbbdd9b700 1 --2- 172.21.15.60:0/3307565846 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55cbc6ad0650 0x55cbc6acb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:05.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.638+0000 7ffbbdd9b700 1 -- 172.21.15.60:0/3307565846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbc6accdb0 msgr2=0x55cbc6b1bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:05.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.638+0000 7ffbbdd9b700 1 --2- 172.21.15.60:0/3307565846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbc6accdb0 0x55cbc6b1bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:05.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.638+0000 7ffbbdd9b700 1 -- 172.21.15.60:0/3307565846 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbc81d0900 con 0x55cbc6acd200 2023-07-12T02:03:05.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.638+0000 7ffbbdd9b700 1 --2- 172.21.15.60:0/3307565846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbc6acd200 0x55cbc6b1c190 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0017000 tx=0x7ffbb0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f90899d363378338 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:05.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.638+0000 7ffba57fa700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-07-12T02:03:05.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.639+0000 7ffba57fa700 1 -- 172.21.15.60:0/3307565846 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0025070 con 0x55cbc6acd200 2023-07-12T02:03:05.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.639+0000 7ffba57fa700 1 -- 172.21.15.60:0/3307565846 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffbb0001070 con 0x55cbc6acd200 2023-07-12T02:03:05.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.639+0000 7ffbd8c69b80 1 -- 172.21.15.60:0/3307565846 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffbb000fa30 con 0x55cbc6acd200 2023-07-12T02:03:05.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.639+0000 7ffba57fa700 1 -- 172.21.15.60:0/3307565846 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffbb0026460 con 0x55cbc6acd200 2023-07-12T02:03:05.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.639+0000 7ffbd8c69b80 10 client.5163 fetch_fsmap learned FSMap version 16 2023-07-12T02:03:05.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.639+0000 7ffbd8c69b80 1 -- 172.21.15.60:0/3307565846 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55cbc68771d0 con 0x55cbc6acd200 2023-07-12T02:03:05.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.639+0000 7ffba57fa700 1 -- 172.21.15.60:0/3307565846 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb000fa30 con 0x55cbc6acd200 2023-07-12T02:03:05.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.639+0000 7ffba57fa700 1 -- 172.21.15.60:0/3307565846 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 16) v1 ==== 2569+0+0 (secure 0 0 0) 0x7ffbb0012070 con 0x55cbc6acd200 2023-07-12T02:03:05.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.639+0000 7ffbd8c69b80 10 client.5163 fetch_fsmap finished waiting for FSMap version 16 2023-07-12T02:03:05.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.639+0000 7ffbd8c69b80 10 client.5163 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-12T02:03:05.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.639+0000 7ffbd8c69b80 20 client.5163 populate_metadata read hostname 'smithi060' 2023-07-12T02:03:05.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.639+0000 7ffbd8c69b80 1 --2- 172.21.15.60:0/3307565846 >> [v2:172.21.15.60:6832/646133464,v1:172.21.15.60:6834/646133464] conn(0x55cbc6af1e90 0x55cbc6acbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:05.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.639+0000 7ffbd8c69b80 4 client.5163 mds_command: new command op to 4971 tid=0[{"prefix": "status"}] 2023-07-12T02:03:05.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.639+0000 7ffbd8c69b80 1 -- 172.21.15.60:0/3307565846 --> [v2:172.21.15.60:6832/646133464,v1:172.21.15.60:6834/646133464] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55cbc6a1bd20 con 0x55cbc6af1e90 2023-07-12T02:03:05.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.639+0000 7ffbc659c700 1 --2- 172.21.15.60:0/3307565846 >> [v2:172.21.15.60:6832/646133464,v1:172.21.15.60:6834/646133464] conn(0x55cbc6af1e90 0x55cbc6acbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:05.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.640+0000 7ffba57fa700 10 client.5163 ms_handle_connect on v2:172.21.15.60:6832/646133464 2023-07-12T02:03:05.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.640+0000 7ffbc659c700 1 --2- 172.21.15.60:0/3307565846 >> [v2:172.21.15.60:6832/646133464,v1:172.21.15.60:6834/646133464] conn(0x55cbc6af1e90 0x55cbc6acbaf0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b95f7ac571893f7 server_cookie=2ec21da4d948b3f5 in_seq=0 out_seq=0 2023-07-12T02:03:05.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.640+0000 7ffba57fa700 1 -- 172.21.15.60:0/3307565846 <== mds.0 v2:172.21.15.60:6832/646133464 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55cbc6a1bd20 con 0x55cbc6af1e90 2023-07-12T02:03:05.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.640+0000 7ffba57fa700 10 client.5163 handle_command_reply: tid=0 2023-07-12T02:03:05.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.640+0000 7ffbd8c69b80 1 client.5163 shutdown 2023-07-12T02:03:05.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.640+0000 7ffbd8c69b80 1 -- 172.21.15.60:0/3307565846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbc6acd200 msgr2=0x55cbc6b1c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:05.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.640+0000 7ffbd8c69b80 1 --2- 172.21.15.60:0/3307565846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbc6acd200 0x55cbc6b1c190 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0017000 tx=0x7ffbb0000ed0 comp rx=0 tx=0).stop 2023-07-12T02:03:05.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.640+0000 7ffbd8c69b80 1 -- 172.21.15.60:0/3307565846 shutdown_connections 2023-07-12T02:03:05.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.640+0000 7ffbd8c69b80 1 --2- 172.21.15.60:0/3307565846 >> [v2:172.21.15.60:6832/646133464,v1:172.21.15.60:6834/646133464] conn(0x55cbc6af1e90 0x55cbc6acbaf0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:05.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.640+0000 7ffbd8c69b80 1 --2- 172.21.15.60:0/3307565846 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55cbc6ad0650 0x55cbc6acb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:05.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.640+0000 7ffba57fa700 0 client.5163 ms_handle_reset on v2:172.21.15.60:6832/646133464 2023-07-12T02:03:05.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.640+0000 7ffbd8c69b80 1 --2- 172.21.15.60:0/3307565846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cbc6accdb0 0x55cbc6b1bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:05.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.640+0000 7ffbd8c69b80 1 --2- 172.21.15.60:0/3307565846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cbc6acd200 0x55cbc6b1c190 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:05.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.640+0000 7ffbd8c69b80 1 -- 172.21.15.60:0/3307565846 >> 172.21.15.60:0/3307565846 conn(0x55cbc6ac7320 msgr2=0x55cbc6b04c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:05.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.640+0000 7ffbd8c69b80 1 -- 172.21.15.60:0/3307565846 shutdown_connections 2023-07-12T02:03:05.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.640+0000 7ffbd8c69b80 1 -- 172.21.15.60:0/3307565846 wait complete. 2023-07-12T02:03:05.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.640+0000 7ffbd8c69b80 20 client.5163 trim_cache size 0 max 16384 2023-07-12T02:03:05.654 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-07-12T02:03:05.654 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "97e7c909-e567-472e-a5aa-72fde15171f2", 2023-07-12T02:03:05.654 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 0, 2023-07-12T02:03:05.654 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4971, 2023-07-12T02:03:05.654 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2023-07-12T02:03:05.655 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2023-07-12T02:03:05.655 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2023-07-12T02:03:05.655 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 5.8781205549999997, 2023-07-12T02:03:05.655 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 16, 2023-07-12T02:03:05.655 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 31, 2023-07-12T02:03:05.655 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 31, 2023-07-12T02:03:05.655 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 14.011356161 2023-07-12T02:03:05.655 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-07-12T02:03:05.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.641+0000 7ffbccad0700 1 -- 172.21.15.60:0/2434768927 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ffba806ace0 msgr2=0x7ffba806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:05.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.641+0000 7ffbccad0700 1 --2- 172.21.15.60:0/2434768927 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ffba806ace0 0x7ffba806d190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8007fd0 tx=0x7ffbb8009040 comp rx=0 tx=0).stop 2023-07-12T02:03:05.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.641+0000 7ffbccad0700 1 -- 172.21.15.60:0/2434768927 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbc8147c00 msgr2=0x7ffbc813e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:05.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.641+0000 7ffbccad0700 1 --2- 172.21.15.60:0/2434768927 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbc8147c00 0x7ffbc813e160 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0004000 tx=0x7ffbc0004ad0 comp rx=0 tx=0).stop 2023-07-12T02:03:05.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.641+0000 7ffbccad0700 1 -- 172.21.15.60:0/2434768927 shutdown_connections 2023-07-12T02:03:05.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.641+0000 7ffbccad0700 1 --2- 172.21.15.60:0/2434768927 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ffba806ace0 0x7ffba806d190 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:05.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.641+0000 7ffbccad0700 1 --2- 172.21.15.60:0/2434768927 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbc8147c00 0x7ffbc813e160 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:05.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.641+0000 7ffbccad0700 1 --2- 172.21.15.60:0/2434768927 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ffbc806b120 0x7ffbc806f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:05.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.641+0000 7ffbccad0700 1 --2- 172.21.15.60:0/2434768927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbc8071b60 0x7ffbc8138400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:05.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.641+0000 7ffbccad0700 1 -- 172.21.15.60:0/2434768927 >> 172.21.15.60:0/2434768927 conn(0x7ffbc80bd980 msgr2=0x7ffbc80bb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:05.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.641+0000 7ffbccad0700 1 -- 172.21.15.60:0/2434768927 shutdown_connections 2023-07-12T02:03:05.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.641+0000 7ffbccad0700 1 -- 172.21.15.60:0/2434768927 wait complete. 2023-07-12T02:03:05.658 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-12T02:03:05.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.780+0000 7fe9dacf0700 1 Processor -- start 2023-07-12T02:03:05.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.780+0000 7fe9dacf0700 1 -- start start 2023-07-12T02:03:05.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.781+0000 7fe9dacf0700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe9d406b120 0x7fe9d40b8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:05.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.781+0000 7fe9dacf0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe9d414aa40 0x7fe9d414aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:05.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.781+0000 7fe9dacf0700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe9d41444c0 0x7fe9d4144920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:05.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.781+0000 7fe9dacf0700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9d40b9590 con 0x7fe9d406b120 2023-07-12T02:03:05.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.781+0000 7fe9dacf0700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9d4070410 con 0x7fe9d414aa40 2023-07-12T02:03:05.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.781+0000 7fe9dacf0700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d414b400 con 0x7fe9d41444c0 2023-07-12T02:03:05.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.782+0000 7fe9d8a8c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe9d406b120 0x7fe9d40b8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:05.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.782+0000 7fe9d8a8c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe9d406b120 0x7fe9d40b8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59824/0 (socket says 172.21.15.60:59824) 2023-07-12T02:03:05.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.782+0000 7fe9d8a8c700 1 -- 172.21.15.60:0/1578411591 learned_addr learned my addr 172.21.15.60:0/1578411591 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:03:05.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.782+0000 7fe9d928d700 1 --2- 172.21.15.60:0/1578411591 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe9d41444c0 0x7fe9d4144920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:05.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.782+0000 7fe9d3fff700 1 --2- 172.21.15.60:0/1578411591 >> v2:172.21.15.79:3300/0 conn(0x7fe9d414aa40 0x7fe9d414aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:05.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.782+0000 7fe9d8a8c700 1 -- 172.21.15.60:0/1578411591 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe9d41444c0 msgr2=0x7fe9d4144920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:05.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.782+0000 7fe9d8a8c700 1 --2- 172.21.15.60:0/1578411591 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe9d41444c0 0x7fe9d4144920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:05.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.782+0000 7fe9d8a8c700 1 -- 172.21.15.60:0/1578411591 >> v2:172.21.15.79:3300/0 conn(0x7fe9d414aa40 msgr2=0x7fe9d414aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:05.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.782+0000 7fe9d8a8c700 1 --2- 172.21.15.60:0/1578411591 >> v2:172.21.15.79:3300/0 conn(0x7fe9d414aa40 0x7fe9d414aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:05.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.782+0000 7fe9d8a8c700 1 -- 172.21.15.60:0/1578411591 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d406ef60 con 0x7fe9d406b120 2023-07-12T02:03:05.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.782+0000 7fe9d3fff700 1 --2- 172.21.15.60:0/1578411591 >> v2:172.21.15.79:3300/0 conn(0x7fe9d414aa40 0x7fe9d414aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:03:05.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.782+0000 7fe9d8a8c700 1 --2- 172.21.15.60:0/1578411591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9d406b120 0x7fe9d40b8cd0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe9d406e4f0 tx=0x7fe9c8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=500f379eede160d server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:05.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.783+0000 7fe9d37fe700 1 -- 172.21.15.60:0/1578411591 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c8011830 con 0x7fe9d406b120 2023-07-12T02:03:05.791 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.783+0000 7fe9d37fe700 1 -- 172.21.15.60:0/1578411591 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c8011990 con 0x7fe9d406b120 2023-07-12T02:03:05.791 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.783+0000 7fe9d37fe700 1 -- 172.21.15.60:0/1578411591 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c8011d20 con 0x7fe9d406b120 2023-07-12T02:03:05.791 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.783+0000 7fe9dacf0700 1 -- 172.21.15.60:0/1578411591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9d406b120 msgr2=0x7fe9d40b8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:05.791 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.783+0000 7fe9dacf0700 1 --2- 172.21.15.60:0/1578411591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9d406b120 0x7fe9d40b8cd0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe9d406e4f0 tx=0x7fe9c8009bd0 comp rx=0 tx=0).stop 2023-07-12T02:03:05.791 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.783+0000 7fe9dacf0700 1 -- 172.21.15.60:0/1578411591 shutdown_connections 2023-07-12T02:03:05.791 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.783+0000 7fe9dacf0700 1 --2- 172.21.15.60:0/1578411591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9d406b120 0x7fe9d40b8cd0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:05.791 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.783+0000 7fe9dacf0700 1 --2- 172.21.15.60:0/1578411591 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe9d41444c0 0x7fe9d4144920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:05.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.784+0000 7fe9dacf0700 1 --2- 172.21.15.60:0/1578411591 >> v2:172.21.15.79:3300/0 conn(0x7fe9d414aa40 0x7fe9d414aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:05.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.784+0000 7fe9dacf0700 1 -- 172.21.15.60:0/1578411591 >> 172.21.15.60:0/1578411591 conn(0x7fe9d40bd980 msgr2=0x7fe9d40b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:05.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.784+0000 7fe9dacf0700 1 -- 172.21.15.60:0/1578411591 shutdown_connections 2023-07-12T02:03:05.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.784+0000 7fe9dacf0700 1 -- 172.21.15.60:0/1578411591 wait complete. 2023-07-12T02:03:05.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.785+0000 7fe9dacf0700 1 Processor -- start 2023-07-12T02:03:05.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.785+0000 7fe9dacf0700 1 -- start start 2023-07-12T02:03:05.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.785+0000 7fe9dacf0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9d406b120 0x7fe9d413c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:05.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.785+0000 7fe9dacf0700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe9d41444c0 0x7fe9d4136f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:05.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.785+0000 7fe9dacf0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9d414aa40 0x7fe9d4137450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:05.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.785+0000 7fe9dacf0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d413bcb0 con 0x7fe9d406b120 2023-07-12T02:03:05.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.785+0000 7fe9dacf0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d413b9d0 con 0x7fe9d414aa40 2023-07-12T02:03:05.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.785+0000 7fe9dacf0700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d41486d0 con 0x7fe9d41444c0 2023-07-12T02:03:05.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.786+0000 7fe9d8a8c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9d406b120 0x7fe9d413c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:05.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.786+0000 7fe9d8a8c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9d406b120 0x7fe9d413c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59832/0 (socket says 172.21.15.60:59832) 2023-07-12T02:03:05.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.786+0000 7fe9d8a8c700 1 -- 172.21.15.60:0/3140204069 learned_addr learned my addr 172.21.15.60:0/3140204069 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:03:05.794 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.786+0000 7fe9d3fff700 1 --2- 172.21.15.60:0/3140204069 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe9d41444c0 0x7fe9d4136f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:05.794 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.786+0000 7fe9d928d700 1 --2- 172.21.15.60:0/3140204069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9d414aa40 0x7fe9d4137450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:05.794 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.786+0000 7fe9d8a8c700 1 -- 172.21.15.60:0/3140204069 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe9d41444c0 msgr2=0x7fe9d4136f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:05.794 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.786+0000 7fe9d8a8c700 1 --2- 172.21.15.60:0/3140204069 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe9d41444c0 0x7fe9d4136f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:05.794 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.786+0000 7fe9d8a8c700 1 -- 172.21.15.60:0/3140204069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9d414aa40 msgr2=0x7fe9d4137450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:05.794 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.786+0000 7fe9d8a8c700 1 --2- 172.21.15.60:0/3140204069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9d414aa40 0x7fe9d4137450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:05.794 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.786+0000 7fe9d8a8c700 1 -- 172.21.15.60:0/3140204069 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c8009550 con 0x7fe9d406b120 2023-07-12T02:03:05.794 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.786+0000 7fe9d8a8c700 1 --2- 172.21.15.60:0/3140204069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9d406b120 0x7fe9d413c8d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8000c00 tx=0x7fe9c8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:05.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.786+0000 7fe9d17fa700 1 -- 172.21.15.60:0/3140204069 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c8004240 con 0x7fe9d406b120 2023-07-12T02:03:05.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.786+0000 7fe9d17fa700 1 -- 172.21.15.60:0/3140204069 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c801f070 con 0x7fe9d406b120 2023-07-12T02:03:05.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.786+0000 7fe9dacf0700 1 -- 172.21.15.60:0/3140204069 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9d41489b0 con 0x7fe9d406b120 2023-07-12T02:03:05.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.786+0000 7fe9d17fa700 1 -- 172.21.15.60:0/3140204069 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c80036a0 con 0x7fe9d406b120 2023-07-12T02:03:05.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.786+0000 7fe9dacf0700 1 -- 172.21.15.60:0/3140204069 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9d40b3e10 con 0x7fe9d406b120 2023-07-12T02:03:05.796 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.787+0000 7fe9dacf0700 1 -- 172.21.15.60:0/3140204069 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9d404e210 con 0x7fe9d406b120 2023-07-12T02:03:05.796 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.787+0000 7fe9d17fa700 1 -- 172.21.15.60:0/3140204069 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe9c8021030 con 0x7fe9d406b120 2023-07-12T02:03:05.796 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.788+0000 7fe9d17fa700 1 --2- 172.21.15.60:0/3140204069 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fe9b806ace0 0x7fe9b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:05.796 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.788+0000 7fe9d17fa700 1 -- 172.21.15.60:0/3140204069 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe9c808a5f0 con 0x7fe9d406b120 2023-07-12T02:03:05.796 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.788+0000 7fe9d3fff700 1 --2- 172.21.15.60:0/3140204069 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fe9b806ace0 0x7fe9b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:05.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.789+0000 7fe9d3fff700 1 --2- 172.21.15.60:0/3140204069 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fe9b806ace0 0x7fe9b806d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe9d413d2d0 tx=0x7fe9c0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:05.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:05.793+0000 7fe9d17fa700 1 -- 172.21.15.60:0/3140204069 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fe9c8055730 con 0x7fe9d406b120 2023-07-12T02:03:06.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:06.034+0000 7fe9dacf0700 1 -- 172.21.15.60:0/3140204069 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe9d4144e30 con 0x7fe9d406b120 2023-07-12T02:03:06.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:06.034+0000 7fe9d17fa700 1 -- 172.21.15.60:0/3140204069 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe9c8058d50 con 0x7fe9d406b120 2023-07-12T02:03:06.038 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-12T02:03:06.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:06.036+0000 7fe9dacf0700 1 -- 172.21.15.60:0/3140204069 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fe9b806ace0 msgr2=0x7fe9b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:06.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:06.036+0000 7fe9dacf0700 1 --2- 172.21.15.60:0/3140204069 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fe9b806ace0 0x7fe9b806d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe9d413d2d0 tx=0x7fe9c0008040 comp rx=0 tx=0).stop 2023-07-12T02:03:06.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:06.036+0000 7fe9dacf0700 1 -- 172.21.15.60:0/3140204069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9d406b120 msgr2=0x7fe9d413c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:06.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:06.036+0000 7fe9dacf0700 1 --2- 172.21.15.60:0/3140204069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9d406b120 0x7fe9d413c8d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8000c00 tx=0x7fe9c8004750 comp rx=0 tx=0).stop 2023-07-12T02:03:06.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:06.036+0000 7fe9dacf0700 1 -- 172.21.15.60:0/3140204069 shutdown_connections 2023-07-12T02:03:06.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:06.036+0000 7fe9dacf0700 1 --2- 172.21.15.60:0/3140204069 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fe9b806ace0 0x7fe9b806d190 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:06.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:06.036+0000 7fe9dacf0700 1 --2- 172.21.15.60:0/3140204069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9d406b120 0x7fe9d413c8d0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:06.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:06.036+0000 7fe9dacf0700 1 --2- 172.21.15.60:0/3140204069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9d414aa40 0x7fe9d4137450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:06.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:06.036+0000 7fe9dacf0700 1 --2- 172.21.15.60:0/3140204069 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe9d41444c0 0x7fe9d4136f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:06.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:06.036+0000 7fe9dacf0700 1 -- 172.21.15.60:0/3140204069 >> 172.21.15.60:0/3140204069 conn(0x7fe9d40bd980 msgr2=0x7fe9d4141fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:06.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:06.036+0000 7fe9dacf0700 1 -- 172.21.15.60:0/3140204069 shutdown_connections 2023-07-12T02:03:06.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:06.036+0000 7fe9dacf0700 1 -- 172.21.15.60:0/3140204069 wait complete. 2023-07-12T02:03:06.052 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-12T02:03:06.053 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-12T02:03:06.053 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi174.front.sepia.ceph.com 2023-07-12T02:03:06.053 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-12T02:03:06.053 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-12T02:03:06.054 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-12T02:03:06.054 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-12T02:03:06.054 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-12T02:03:06.054 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-12T02:03:06.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:03:06.055 DEBUG:teuthology.orchestra.run.smithi174:> ip addr 2023-07-12T02:03:06.105 INFO:teuthology.orchestra.run.smithi174.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-12T02:03:06.106 INFO:teuthology.orchestra.run.smithi174.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-12T02:03:06.106 INFO:teuthology.orchestra.run.smithi174.stdout: inet 127.0.0.1/8 scope host lo 2023-07-12T02:03:06.106 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:03:06.106 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 ::1/128 scope host 2023-07-12T02:03:06.106 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:03:06.106 INFO:teuthology.orchestra.run.smithi174.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-12T02:03:06.107 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:d9:36:e0 brd ff:ff:ff:ff:ff:ff 2023-07-12T02:03:06.107 INFO:teuthology.orchestra.run.smithi174.stdout: altname enp7s0f0 2023-07-12T02:03:06.107 INFO:teuthology.orchestra.run.smithi174.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-12T02:03:06.107 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:d9:36:e1 brd ff:ff:ff:ff:ff:ff 2023-07-12T02:03:06.107 INFO:teuthology.orchestra.run.smithi174.stdout: altname enp7s0f1 2023-07-12T02:03:06.107 INFO:teuthology.orchestra.run.smithi174.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-12T02:03:06.107 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:88:77:1a brd ff:ff:ff:ff:ff:ff 2023-07-12T02:03:06.107 INFO:teuthology.orchestra.run.smithi174.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-12T02:03:06.108 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:88:77:1b brd ff:ff:ff:ff:ff:ff 2023-07-12T02:03:06.108 INFO:teuthology.orchestra.run.smithi174.stdout: inet 172.21.15.174/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-12T02:03:06.108 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft 41893sec preferred_lft 41893sec 2023-07-12T02:03:06.108 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::ec4:7aff:fe88:771b/64 scope link 2023-07-12T02:03:06.108 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:03:06.108 INFO:teuthology.orchestra.run.smithi174.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-12T02:03:06.108 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether ba:4e:96:f9:77:54 brd ff:ff:ff:ff:ff:ff 2023-07-12T02:03:06.109 INFO:teuthology.orchestra.run.smithi174.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-12T02:03:06.109 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:03:06.109 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::e822:b3ff:fe69:bf44/64 scope link 2023-07-12T02:03:06.109 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:03:06.109 INFO:teuthology.orchestra.run.smithi174.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-12T02:03:06.109 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether ba:4e:96:f9:77:54 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-12T02:03:06.109 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::b84e:96ff:fef9:7754/64 scope link 2023-07-12T02:03:06.109 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2023-07-12T02:03:06.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:03:06.111 DEBUG:teuthology.orchestra.run.smithi174:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-12T02:03:06.181 INFO:teuthology.orchestra.run.smithi174.stdout:1 2023-07-12T02:03:06.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:03:06.184 DEBUG:teuthology.orchestra.run.smithi174:> route 2023-07-12T02:03:06.232 INFO:teuthology.orchestra.run.smithi174.stdout:Kernel IP routing table 2023-07-12T02:03:06.233 INFO:teuthology.orchestra.run.smithi174.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-12T02:03:06.233 INFO:teuthology.orchestra.run.smithi174.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-12T02:03:06.233 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-12T02:03:06.233 INFO:teuthology.orchestra.run.smithi174.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-12T02:03:06.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:03:06.234 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec bash -c ' 2023-07-12T02:03:06.235 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2023-07-12T02:03:06.235 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-12T02:03:06.235 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-12T02:03:06.235 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-12T02:03:06.236 DEBUG:teuthology.orchestra.run.smithi174:> ') 2023-07-12T02:03:06.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:03:06.402 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list 2023-07-12T02:03:06.447 INFO:teuthology.orchestra.run.smithi174.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-12T02:03:06.447 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-12T02:03:06.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:03:06.448 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link set brx.0 up 2023-07-12T02:03:06.517 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-12T02:03:06.517 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-12T02:03:06.561 INFO:teuthology.orchestra.run.smithi174.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-12T02:03:06.562 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-12T02:03:06.562 DEBUG:teuthology.orchestra.run.smithi174:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-12T02:03:06.646 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-12T02:03:06.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:03:06.646 DEBUG:teuthology.orchestra.run.smithi174:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-12T02:03:06.788 INFO:teuthology.orchestra.run.smithi174.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-12T02:03:06.789 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-12T02:03:06.789 INFO:teuthology.orchestra.run.smithi174.stdout:invalid new device string format 2023-07-12T02:03:06.804 INFO:teuthology.orchestra.run.smithi174.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-12T02:03:06.804 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-12T02:03:06.805 INFO:teuthology.orchestra.run.smithi174.stdout:invalid new device string format 2023-07-12T02:03:06.805 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.79:3300,172.21.15.79:3301" 2023-07-12T02:03:06.805 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-12T02:03:06.827 INFO:teuthology.orchestra.run.smithi174.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-12T02:03:06.827 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-12T02:03:06.828 INFO:teuthology.orchestra.run.smithi174.stdout:invalid new device string format 2023-07-12T02:03:06.828 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.79:3300,172.21.15.79:3301" 2023-07-12T02:03:06.828 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-12T02:03:06.828 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: resolved to: "172.21.15.60:6789,172.21.15.79:6789,172.21.15.79:6790" 2023-07-12T02:03:06.828 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.60:6789,172.21.15.79:6789,172.21.15.79:6790:/ 2023-07-12T02:03:06.828 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=97e7c909-e567-472e-a5aa-72fde15171f2" will pass to kernel 2023-07-12T02:03:06.833 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-12T02:03:06.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:03:06.833 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-12T02:03:06.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:03:06.902 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-12T02:03:07.008 INFO:teuthology.orchestra.run.smithi174.stdout:client5172 2023-07-12T02:03:07.009 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-07-12T02:03:07.009 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-12T02:03:07.053 DEBUG:teuthology.orchestra.run.smithi174:> mktemp -d --suffix=xfstests-dev 2023-07-12T02:03:07.138 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.CBamI6wQNAxfstests-dev 2023-07-12T02:03:07.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:03:07.139 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.CBamI6wQNAxfstests-dev) 2023-07-12T02:03:07.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:03:07.248 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.CBamI6wQNAxfstests-dev) 2023-07-12T02:03:07.301 INFO:teuthology.orchestra.run.smithi174.stderr:Cloning into '/tmp/tmp.CBamI6wQNAxfstests-dev'... 2023-07-12T02:03:08.174 DEBUG:teuthology.orchestra.run.smithi174:> mktemp -d --suffix=xfsprogs-dev 2023-07-12T02:03:08.218 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.MhsN8hlsQwxfsprogs-dev 2023-07-12T02:03:08.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:03:08.219 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.MhsN8hlsQwxfsprogs-dev) 2023-07-12T02:03:08.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:03:08.329 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfsprogs-dev.git --depth 1 /tmp/tmp.MhsN8hlsQwxfsprogs-dev) 2023-07-12T02:03:08.380 INFO:teuthology.orchestra.run.smithi174.stderr:Cloning into '/tmp/tmp.MhsN8hlsQwxfsprogs-dev'... 2023-07-12T02:03:08.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:03:08.894 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-07-12T02:03:08.948 DEBUG:teuthology.orchestra.run.smithi174:> mktemp -d --suffix=test 2023-07-12T02:03:08.992 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.bp3K5ctJhDtest 2023-07-12T02:03:08.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:03:08.993 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-07-12T02:03:09.080 DEBUG:teuthology.orchestra.run.smithi174:> mktemp -d --suffix=scratch 2023-07-12T02:03:09.124 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.3EzHOaP1bIscratch 2023-07-12T02:03:09.124 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "8". 2023-07-12T02:03:09.125 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python2 sqlite inih-devel userspace-rcu-devel libblkid-devel gettext libedit-devel libattr-devel device-mapper-devel libicu-devel xfsprogs-qa-devel 2023-07-12T02:03:10.229 INFO:teuthology.orchestra.run.smithi174.stdout:Last metadata expiration check: 0:05:07 ago on Wed 12 Jul 2023 01:58:03 AM UTC. 2023-07-12T02:03:11.440 INFO:teuthology.orchestra.run.smithi174.stdout:Package acl-2.2.53-1.el8.x86_64 is already installed. 2023-07-12T02:03:11.441 INFO:teuthology.orchestra.run.smithi174.stdout:Package attr-2.4.48-3.el8.x86_64 is already installed. 2023-07-12T02:03:11.442 INFO:teuthology.orchestra.run.smithi174.stdout:Package automake-1.16.1-7.el8.noarch is already installed. 2023-07-12T02:03:11.443 INFO:teuthology.orchestra.run.smithi174.stdout:Package bc-1.07.1-5.el8.x86_64 is already installed. 2023-07-12T02:03:11.444 INFO:teuthology.orchestra.run.smithi174.stdout:Package dbench-4.0-20.el8.x86_64 is already installed. 2023-07-12T02:03:11.446 INFO:teuthology.orchestra.run.smithi174.stdout:Package e2fsprogs-1.45.6-5.el8.x86_64 is already installed. 2023-07-12T02:03:11.448 INFO:teuthology.orchestra.run.smithi174.stdout:Package gawk-4.2.1-4.el8.x86_64 is already installed. 2023-07-12T02:03:11.449 INFO:teuthology.orchestra.run.smithi174.stdout:Package gcc-8.5.0-19.el8.x86_64 is already installed. 2023-07-12T02:03:11.451 INFO:teuthology.orchestra.run.smithi174.stdout:Package libtool-2.4.6-25.el8.x86_64 is already installed. 2023-07-12T02:03:11.452 INFO:teuthology.orchestra.run.smithi174.stdout:Package lvm2-8:2.03.14-9.el8.x86_64 is already installed. 2023-07-12T02:03:11.453 INFO:teuthology.orchestra.run.smithi174.stdout:Package make-1:4.2.1-11.el8.x86_64 is already installed. 2023-07-12T02:03:11.454 INFO:teuthology.orchestra.run.smithi174.stdout:Package psmisc-23.1-5.el8.x86_64 is already installed. 2023-07-12T02:03:11.455 INFO:teuthology.orchestra.run.smithi174.stdout:Package quota-1:4.04-14.el8.x86_64 is already installed. 2023-07-12T02:03:11.456 INFO:teuthology.orchestra.run.smithi174.stdout:Package sed-4.5-5.el8.x86_64 is already installed. 2023-07-12T02:03:11.457 INFO:teuthology.orchestra.run.smithi174.stdout:Package xfsdump-3.1.8-6.el8.x86_64 is already installed. 2023-07-12T02:03:11.459 INFO:teuthology.orchestra.run.smithi174.stdout:Package xfsprogs-5.0.0-12.el8.x86_64 is already installed. 2023-07-12T02:03:11.460 INFO:teuthology.orchestra.run.smithi174.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-12T02:03:11.461 INFO:teuthology.orchestra.run.smithi174.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-12T02:03:11.462 INFO:teuthology.orchestra.run.smithi174.stdout:Package libaio-devel-0.3.112-1.el8.x86_64 is already installed. 2023-07-12T02:03:11.463 INFO:teuthology.orchestra.run.smithi174.stdout:Package libuuid-devel-2.32.1-42.el8.x86_64 is already installed. 2023-07-12T02:03:11.464 INFO:teuthology.orchestra.run.smithi174.stdout:Package xfsprogs-devel-5.0.0-12.el8.x86_64 is already installed. 2023-07-12T02:03:11.466 INFO:teuthology.orchestra.run.smithi174.stdout:Package sqlite-3.26.0-17.el8.x86_64 is already installed. 2023-07-12T02:03:11.470 INFO:teuthology.orchestra.run.smithi174.stdout:Package gettext-0.19.8.1-17.el8.x86_64 is already installed. 2023-07-12T02:03:11.477 INFO:teuthology.orchestra.run.smithi174.stdout:Package xfsprogs-5.0.0-12.el8.x86_64 is already installed. 2023-07-12T02:03:11.656 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2023-07-12T02:03:11.660 INFO:teuthology.orchestra.run.smithi174.stdout:======================================================================================== 2023-07-12T02:03:11.660 INFO:teuthology.orchestra.run.smithi174.stdout: Package Arch Version Repository Size 2023-07-12T02:03:11.660 INFO:teuthology.orchestra.run.smithi174.stdout:======================================================================================== 2023-07-12T02:03:11.660 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2023-07-12T02:03:11.660 INFO:teuthology.orchestra.run.smithi174.stdout: device-mapper-devel x86_64 8:1.02.181-9.el8 powertools 284 k 2023-07-12T02:03:11.660 INFO:teuthology.orchestra.run.smithi174.stdout: dump x86_64 1:0.4-0.36.b46.el8 baseos 164 k 2023-07-12T02:03:11.661 INFO:teuthology.orchestra.run.smithi174.stdout: fio x86_64 3.19-4.el8 appstream 538 k 2023-07-12T02:03:11.661 INFO:teuthology.orchestra.run.smithi174.stdout: indent x86_64 2.2.13-2.el8 epel 187 k 2023-07-12T02:03:11.661 INFO:teuthology.orchestra.run.smithi174.stdout: inih-devel x86_64 56-1.el8 epel 13 k 2023-07-12T02:03:11.661 INFO:teuthology.orchestra.run.smithi174.stdout: libblkid-devel x86_64 2.32.1-42.el8 baseos 87 k 2023-07-12T02:03:11.661 INFO:teuthology.orchestra.run.smithi174.stdout: libedit-devel x86_64 3.1-23.20170329cvs.el8 powertools 44 k 2023-07-12T02:03:11.661 INFO:teuthology.orchestra.run.smithi174.stdout: libicu-devel x86_64 60.3-2.el8_1 baseos 922 k 2023-07-12T02:03:11.661 INFO:teuthology.orchestra.run.smithi174.stdout: python2 x86_64 2.7.18-12.module_el8+299+aa6e9afa appstream 110 k 2023-07-12T02:03:11.661 INFO:teuthology.orchestra.run.smithi174.stdout: userspace-rcu-devel x86_64 0.10.1-4.el8 powertools 84 k 2023-07-12T02:03:11.662 INFO:teuthology.orchestra.run.smithi174.stdout:Upgrading: 2023-07-12T02:03:11.662 INFO:teuthology.orchestra.run.smithi174.stdout: cpp x86_64 8.5.0-20.el8 baseos 10 M 2023-07-12T02:03:11.662 INFO:teuthology.orchestra.run.smithi174.stdout: gcc x86_64 8.5.0-20.el8 baseos 24 M 2023-07-12T02:03:11.662 INFO:teuthology.orchestra.run.smithi174.stdout: gcc-gdb-plugin x86_64 8.5.0-20.el8 appstream 121 k 2023-07-12T02:03:11.662 INFO:teuthology.orchestra.run.smithi174.stdout: gcc-plugin-annobin x86_64 8.5.0-20.el8 baseos 36 k 2023-07-12T02:03:11.662 INFO:teuthology.orchestra.run.smithi174.stdout: libgcc x86_64 8.5.0-20.el8 baseos 81 k 2023-07-12T02:03:11.662 INFO:teuthology.orchestra.run.smithi174.stdout: libgomp x86_64 8.5.0-20.el8 baseos 208 k 2023-07-12T02:03:11.662 INFO:teuthology.orchestra.run.smithi174.stdout: sqlite x86_64 3.26.0-18.el8 baseos 668 k 2023-07-12T02:03:11.663 INFO:teuthology.orchestra.run.smithi174.stdout: sqlite-libs x86_64 3.26.0-18.el8 baseos 581 k 2023-07-12T02:03:11.663 INFO:teuthology.orchestra.run.smithi174.stdout:Installing dependencies: 2023-07-12T02:03:11.663 INFO:teuthology.orchestra.run.smithi174.stdout: daxctl-libs x86_64 71.1-7.el8 baseos 42 k 2023-07-12T02:03:11.663 INFO:teuthology.orchestra.run.smithi174.stdout: inih x86_64 56-1.el8 epel 27 k 2023-07-12T02:03:11.663 INFO:teuthology.orchestra.run.smithi174.stdout: libpmemblk x86_64 1.6.1-1.el8 appstream 92 k 2023-07-12T02:03:11.663 INFO:teuthology.orchestra.run.smithi174.stdout: ndctl-libs x86_64 71.1-7.el8 baseos 80 k 2023-07-12T02:03:11.663 INFO:teuthology.orchestra.run.smithi174.stdout: python2-libs x86_64 2.7.18-12.module_el8+299+aa6e9afa appstream 6.5 M 2023-07-12T02:03:11.663 INFO:teuthology.orchestra.run.smithi174.stdout: python2-pip-wheel noarch 9.0.3-19.module_el8+299+aa6e9afa appstream 892 k 2023-07-12T02:03:11.664 INFO:teuthology.orchestra.run.smithi174.stdout: python2-setuptools-wheel noarch 39.0.1-13.module_el8+299+aa6e9afa appstream 287 k 2023-07-12T02:03:11.664 INFO:teuthology.orchestra.run.smithi174.stdout: python2-wheel-wheel noarch 1:0.31.1-3.module_el8+299+aa6e9afa appstream 44 k 2023-07-12T02:03:11.664 INFO:teuthology.orchestra.run.smithi174.stdout: rmt x86_64 2:1.5.3-13.el8 baseos 51 k 2023-07-12T02:03:11.664 INFO:teuthology.orchestra.run.smithi174.stdout: systemd-devel x86_64 239-75.el8 baseos 511 k 2023-07-12T02:03:11.664 INFO:teuthology.orchestra.run.smithi174.stdout:Installing weak dependencies: 2023-07-12T02:03:11.664 INFO:teuthology.orchestra.run.smithi174.stdout: python2-pip noarch 9.0.3-19.module_el8+299+aa6e9afa appstream 1.8 M 2023-07-12T02:03:11.664 INFO:teuthology.orchestra.run.smithi174.stdout: python2-setuptools noarch 39.0.1-13.module_el8+299+aa6e9afa appstream 702 k 2023-07-12T02:03:11.664 INFO:teuthology.orchestra.run.smithi174.stdout:Enabling module streams: 2023-07-12T02:03:11.665 INFO:teuthology.orchestra.run.smithi174.stdout: python27 2.7 2023-07-12T02:03:11.665 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T02:03:11.665 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2023-07-12T02:03:11.665 INFO:teuthology.orchestra.run.smithi174.stdout:======================================================================================== 2023-07-12T02:03:11.665 INFO:teuthology.orchestra.run.smithi174.stdout:Install 22 Packages 2023-07-12T02:03:11.665 INFO:teuthology.orchestra.run.smithi174.stdout:Upgrade 8 Packages 2023-07-12T02:03:11.665 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T02:03:11.666 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 49 M 2023-07-12T02:03:11.666 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading Packages: 2023-07-12T02:03:14.396 INFO:teuthology.orchestra.run.smithi174.stdout:(1/30): libpmemblk-1.6.1-1.el8.x86_64.rpm 61 kB/s | 92 kB 00:01 2023-07-12T02:03:14.463 INFO:teuthology.orchestra.run.smithi174.stdout:(2/30): python2-2.7.18-12.module_el8+299+aa6e9a 71 kB/s | 110 kB 00:01 2023-07-12T02:03:16.163 INFO:teuthology.orchestra.run.smithi174.stdout:(3/30): fio-3.19-4.el8.x86_64.rpm 165 kB/s | 538 kB 00:03 2023-07-12T02:03:19.622 INFO:teuthology.orchestra.run.smithi174.stdout:(4/30): python2-pip-wheel-9.0.3-19.module_el8+2 258 kB/s | 892 kB 00:03 2023-07-12T02:03:19.680 INFO:teuthology.orchestra.run.smithi174.stdout:(5/30): python2-pip-9.0.3-19.module_el8+299+aa6 357 kB/s | 1.8 MB 00:05 2023-07-12T02:03:20.324 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:03:20.327 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:03:20.330 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:03:20.514 INFO:teuthology.orchestra.run.smithi174.stdout:(6/30): python2-setuptools-wheel-39.0.1-13.modu 344 kB/s | 287 kB 00:00 2023-07-12T02:03:20.697 INFO:teuthology.orchestra.run.smithi174.stdout:(7/30): python2-wheel-wheel-0.31.1-3.module_el8 243 kB/s | 44 kB 00:00 2023-07-12T02:03:20.931 INFO:teuthology.orchestra.run.smithi174.stdout:(8/30): daxctl-libs-71.1-7.el8.x86_64.rpm 181 kB/s | 42 kB 00:00 2023-07-12T02:03:21.090 INFO:teuthology.orchestra.run.smithi174.stdout:(9/30): dump-0.4-0.36.b46.el8.x86_64.rpm 1.0 MB/s | 164 kB 00:00 2023-07-12T02:03:21.198 INFO:teuthology.orchestra.run.smithi174.stdout:(10/30): libblkid-devel-2.32.1-42.el8.x86_64.rp 809 kB/s | 87 kB 00:00 2023-07-12T02:03:21.665 INFO:teuthology.orchestra.run.smithi174.stdout:(11/30): libicu-devel-60.3-2.el8_1.x86_64.rpm 1.9 MB/s | 922 kB 00:00 2023-07-12T02:03:21.724 INFO:teuthology.orchestra.run.smithi174.stdout:(12/30): ndctl-libs-71.1-7.el8.x86_64.rpm 1.4 MB/s | 80 kB 00:00 2023-07-12T02:03:21.782 INFO:teuthology.orchestra.run.smithi174.stdout:(13/30): rmt-1.5.3-13.el8.x86_64.rpm 883 kB/s | 51 kB 00:00 2023-07-12T02:03:22.016 INFO:teuthology.orchestra.run.smithi174.stdout:(14/30): systemd-devel-239-75.el8.x86_64.rpm 2.1 MB/s | 511 kB 00:00 2023-07-12T02:03:22.124 INFO:teuthology.orchestra.run.smithi174.stdout:(15/30): python2-setuptools-39.0.1-13.module_el 280 kB/s | 702 kB 00:02 2023-07-12T02:03:22.160 INFO:teuthology.orchestra.run.smithi174.stdout:[MIRROR] device-mapper-devel-1.02.181-9.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirror.genesisadaptive.com/centos/8-stream/PowerTools/x86_64/os/Packages/device-mapper-devel-1.02.181-9.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-07-12T02:03:22.189 INFO:teuthology.orchestra.run.smithi174.stdout:[MIRROR] libedit-devel-3.1-23.20170329cvs.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirror.genesisadaptive.com/centos/8-stream/PowerTools/x86_64/os/Packages/libedit-devel-3.1-23.20170329cvs.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-07-12T02:03:22.508 INFO:teuthology.orchestra.run.smithi174.stdout:(16/30): libedit-devel-3.1-23.20170329cvs.el8.x 115 kB/s | 44 kB 00:00 2023-07-12T02:03:22.581 INFO:teuthology.orchestra.run.smithi174.stdout:[MIRROR] userspace-rcu-devel-0.10.1-4.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirror.genesisadaptive.com/centos/8-stream/PowerTools/x86_64/os/Packages/userspace-rcu-devel-0.10.1-4.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-07-12T02:03:22.659 INFO:teuthology.orchestra.run.smithi174.stdout:(17/30): device-mapper-devel-1.02.181-9.el8.x86 443 kB/s | 284 kB 00:00 2023-07-12T02:03:22.717 INFO:teuthology.orchestra.run.smithi174.stdout:(18/30): userspace-rcu-devel-0.10.1-4.el8.x86_6 403 kB/s | 84 kB 00:00 2023-07-12T02:03:22.859 INFO:teuthology.orchestra.run.smithi174.stdout:(19/30): inih-56-1.el8.x86_64.rpm 192 kB/s | 27 kB 00:00 2023-07-12T02:03:22.892 INFO:teuthology.orchestra.run.smithi174.stdout:(20/30): indent-2.2.13-2.el8.x86_64.rpm 799 kB/s | 187 kB 00:00 2023-07-12T02:03:22.926 INFO:teuthology.orchestra.run.smithi174.stdout:(21/30): inih-devel-56-1.el8.x86_64.rpm 198 kB/s | 13 kB 00:00 2023-07-12T02:03:23.510 INFO:teuthology.orchestra.run.smithi174.stdout:(22/30): gcc-gdb-plugin-8.5.0-20.el8.x86_64.rpm 196 kB/s | 121 kB 00:00 2023-07-12T02:03:26.584 INFO:teuthology.orchestra.run.smithi174.stdout:(23/30): cpp-8.5.0-20.el8.x86_64.rpm 2.9 MB/s | 10 MB 00:03 2023-07-12T02:03:26.685 INFO:teuthology.orchestra.run.smithi174.stdout:(24/30): gcc-plugin-annobin-8.5.0-20.el8.x86_64 359 kB/s | 36 kB 00:00 2023-07-12T02:03:26.785 INFO:teuthology.orchestra.run.smithi174.stdout:(25/30): libgcc-8.5.0-20.el8.x86_64.rpm 817 kB/s | 81 kB 00:00 2023-07-12T02:03:26.927 INFO:teuthology.orchestra.run.smithi174.stdout:(26/30): libgomp-8.5.0-20.el8.x86_64.rpm 1.4 MB/s | 208 kB 00:00 2023-07-12T02:03:27.169 INFO:teuthology.orchestra.run.smithi174.stdout:(27/30): sqlite-3.26.0-18.el8.x86_64.rpm 2.7 MB/s | 668 kB 00:00 2023-07-12T02:03:27.378 INFO:teuthology.orchestra.run.smithi174.stdout:(28/30): sqlite-libs-3.26.0-18.el8.x86_64.rpm 2.7 MB/s | 581 kB 00:00 2023-07-12T02:03:31.619 INFO:teuthology.orchestra.run.smithi174.stdout:(29/30): python2-libs-2.7.18-12.module_el8+299+ 384 kB/s | 6.5 MB 00:17 2023-07-12T02:03:32.169 INFO:teuthology.orchestra.run.smithi174.stdout:(30/30): gcc-8.5.0-20.el8.x86_64.rpm 2.7 MB/s | 24 MB 00:08 2023-07-12T02:03:32.170 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2023-07-12T02:03:32.170 INFO:teuthology.orchestra.run.smithi174.stdout:Total 2.4 MB/s | 49 MB 00:20 2023-07-12T02:03:32.991 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2023-07-12T02:03:33.111 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction check succeeded. 2023-07-12T02:03:33.111 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2023-07-12T02:03:33.621 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded. 2023-07-12T02:03:33.625 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2023-07-12T02:03:35.023 INFO:teuthology.orchestra.run.smithi174.stdout: Preparing : 1/1 2023-07-12T02:03:35.186 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : libgcc-8.5.0-20.el8.x86_64 1/38 2023-07-12T02:03:35.313 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libgcc-8.5.0-20.el8.x86_64 1/38 2023-07-12T02:03:35.492 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : sqlite-libs-3.26.0-18.el8.x86_64 2/38 2023-07-12T02:03:35.670 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : daxctl-libs-71.1-7.el8.x86_64 3/38 2023-07-12T02:03:35.759 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: daxctl-libs-71.1-7.el8.x86_64 3/38 2023-07-12T02:03:35.936 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ndctl-libs-71.1-7.el8.x86_64 4/38 2023-07-12T02:03:36.010 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ndctl-libs-71.1-7.el8.x86_64 4/38 2023-07-12T02:03:36.144 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libpmemblk-1.6.1-1.el8.x86_64 5/38 2023-07-12T02:03:36.230 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libpmemblk-1.6.1-1.el8.x86_64 5/38 2023-07-12T02:03:36.434 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : inih-56-1.el8.x86_64 6/38 2023-07-12T02:03:36.586 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : libgomp-8.5.0-20.el8.x86_64 7/38 2023-07-12T02:03:37.651 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libgomp-8.5.0-20.el8.x86_64 7/38 2023-07-12T02:03:37.869 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : cpp-8.5.0-20.el8.x86_64 8/38 2023-07-12T02:03:39.647 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: cpp-8.5.0-20.el8.x86_64 8/38 2023-07-12T02:03:39.919 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : gcc-8.5.0-20.el8.x86_64 9/38 2023-07-12T02:03:40.249 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: gcc-8.5.0-20.el8.x86_64 9/38 2023-07-12T02:03:40.468 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : systemd-devel-239-75.el8.x86_64 10/38 2023-07-12T02:03:40.640 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rmt-2:1.5.3-13.el8.x86_64 11/38 2023-07-12T02:03:40.775 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python2-setuptools-wheel-39.0.1-13.module_el8+299+ 12/38 2023-07-12T02:03:42.210 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python2-pip-wheel-9.0.3-19.module_el8+299+aa6e9afa 13/38 2023-07-12T02:03:43.077 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python2-libs-2.7.18-12.module_el8+299+aa6e9afa.x86 14/38 2023-07-12T02:03:43.471 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python2-pip-9.0.3-19.module_el8+299+aa6e9afa.noarc 15/38 2023-07-12T02:03:43.692 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python2-setuptools-39.0.1-13.module_el8+299+aa6e9a 16/38 2023-07-12T02:03:43.862 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 17/38 2023-07-12T02:03:43.905 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 17/38 2023-07-12T02:03:44.099 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : dump-1:0.4-0.36.b46.el8.x86_64 18/38 2023-07-12T02:03:44.258 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : device-mapper-devel-8:1.02.181-9.el8.x86_64 19/38 2023-07-12T02:03:44.434 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : gcc-gdb-plugin-8.5.0-20.el8.x86_64 20/38 2023-07-12T02:03:44.516 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: gcc-gdb-plugin-8.5.0-20.el8.x86_64 20/38 2023-07-12T02:03:44.677 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : gcc-plugin-annobin-8.5.0-20.el8.x86_64 21/38 2023-07-12T02:03:44.718 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: gcc-plugin-annobin-8.5.0-20.el8.x86_64 21/38 2023-07-12T02:03:44.974 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : inih-devel-56-1.el8.x86_64 22/38 2023-07-12T02:03:45.251 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : fio-3.19-4.el8.x86_64 23/38 2023-07-12T02:03:45.794 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : sqlite-3.26.0-18.el8.x86_64 24/38 2023-07-12T02:03:46.123 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libicu-devel-60.3-2.el8_1.x86_64 25/38 2023-07-12T02:03:46.434 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : indent-2.2.13-2.el8.x86_64 26/38 2023-07-12T02:03:46.648 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : userspace-rcu-devel-0.10.1-4.el8.x86_64 27/38 2023-07-12T02:03:46.813 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libedit-devel-3.1-23.20170329cvs.el8.x86_64 28/38 2023-07-12T02:03:46.972 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libblkid-devel-2.32.1-42.el8.x86_64 29/38 2023-07-12T02:03:47.127 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e 30/38 2023-07-12T02:03:47.128 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : gcc-gdb-plugin-8.5.0-19.el8.x86_64 31/38 2023-07-12T02:03:47.378 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: gcc-gdb-plugin-8.5.0-19.el8.x86_64 31/38 2023-07-12T02:03:47.378 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : gcc-plugin-annobin-8.5.0-19.el8.x86_64 32/38 2023-07-12T02:03:47.553 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: gcc-plugin-annobin-8.5.0-19.el8.x86_64 32/38 2023-07-12T02:03:47.574 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: gcc-8.5.0-19.el8.x86_64 33/38 2023-07-12T02:03:47.810 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : gcc-8.5.0-19.el8.x86_64 33/38 2023-07-12T02:03:47.977 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : sqlite-3.26.0-17.el8.x86_64 34/38 2023-07-12T02:03:48.135 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : sqlite-libs-3.26.0-17.el8.x86_64 35/38 2023-07-12T02:03:48.151 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: cpp-8.5.0-19.el8.x86_64 36/38 2023-07-12T02:03:48.286 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : cpp-8.5.0-19.el8.x86_64 36/38 2023-07-12T02:03:48.286 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : libgcc-8.5.0-19.el8.x86_64 37/38 2023-07-12T02:03:48.519 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libgcc-8.5.0-19.el8.x86_64 37/38 2023-07-12T02:03:48.535 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libgomp-8.5.0-19.el8.x86_64 38/38 2023-07-12T02:03:48.535 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : libgomp-8.5.0-19.el8.x86_64 38/38 2023-07-12T02:03:49.339 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libgomp-8.5.0-19.el8.x86_64 38/38 2023-07-12T02:03:49.340 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : fio-3.19-4.el8.x86_64 1/38 2023-07-12T02:03:49.340 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libpmemblk-1.6.1-1.el8.x86_64 2/38 2023-07-12T02:03:49.340 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 3/38 2023-07-12T02:03:49.340 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python2-libs-2.7.18-12.module_el8+299+aa6e9afa.x86 4/38 2023-07-12T02:03:49.340 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python2-pip-9.0.3-19.module_el8+299+aa6e9afa.noarc 5/38 2023-07-12T02:03:49.340 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python2-pip-wheel-9.0.3-19.module_el8+299+aa6e9afa 6/38 2023-07-12T02:03:49.340 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python2-setuptools-39.0.1-13.module_el8+299+aa6e9a 7/38 2023-07-12T02:03:49.341 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python2-setuptools-wheel-39.0.1-13.module_el8+299+ 8/38 2023-07-12T02:03:49.341 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e 9/38 2023-07-12T02:03:49.341 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : daxctl-libs-71.1-7.el8.x86_64 10/38 2023-07-12T02:03:49.341 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : dump-1:0.4-0.36.b46.el8.x86_64 11/38 2023-07-12T02:03:49.341 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libblkid-devel-2.32.1-42.el8.x86_64 12/38 2023-07-12T02:03:49.341 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libicu-devel-60.3-2.el8_1.x86_64 13/38 2023-07-12T02:03:49.341 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ndctl-libs-71.1-7.el8.x86_64 14/38 2023-07-12T02:03:49.342 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rmt-2:1.5.3-13.el8.x86_64 15/38 2023-07-12T02:03:49.342 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : systemd-devel-239-75.el8.x86_64 16/38 2023-07-12T02:03:49.342 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : device-mapper-devel-8:1.02.181-9.el8.x86_64 17/38 2023-07-12T02:03:49.342 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libedit-devel-3.1-23.20170329cvs.el8.x86_64 18/38 2023-07-12T02:03:49.342 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : userspace-rcu-devel-0.10.1-4.el8.x86_64 19/38 2023-07-12T02:03:49.342 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : indent-2.2.13-2.el8.x86_64 20/38 2023-07-12T02:03:49.342 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : inih-56-1.el8.x86_64 21/38 2023-07-12T02:03:49.342 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : inih-devel-56-1.el8.x86_64 22/38 2023-07-12T02:03:49.343 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : gcc-gdb-plugin-8.5.0-20.el8.x86_64 23/38 2023-07-12T02:03:49.343 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : gcc-gdb-plugin-8.5.0-19.el8.x86_64 24/38 2023-07-12T02:03:49.343 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cpp-8.5.0-20.el8.x86_64 25/38 2023-07-12T02:03:49.344 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cpp-8.5.0-19.el8.x86_64 26/38 2023-07-12T02:03:49.344 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : gcc-8.5.0-20.el8.x86_64 27/38 2023-07-12T02:03:49.344 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : gcc-8.5.0-19.el8.x86_64 28/38 2023-07-12T02:03:49.344 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : gcc-plugin-annobin-8.5.0-20.el8.x86_64 29/38 2023-07-12T02:03:49.344 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : gcc-plugin-annobin-8.5.0-19.el8.x86_64 30/38 2023-07-12T02:03:49.345 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libgcc-8.5.0-20.el8.x86_64 31/38 2023-07-12T02:03:49.345 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libgcc-8.5.0-19.el8.x86_64 32/38 2023-07-12T02:03:49.345 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libgomp-8.5.0-20.el8.x86_64 33/38 2023-07-12T02:03:49.345 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libgomp-8.5.0-19.el8.x86_64 34/38 2023-07-12T02:03:49.345 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : sqlite-3.26.0-18.el8.x86_64 35/38 2023-07-12T02:03:49.345 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : sqlite-3.26.0-17.el8.x86_64 36/38 2023-07-12T02:03:49.345 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : sqlite-libs-3.26.0-18.el8.x86_64 37/38 2023-07-12T02:03:50.340 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : sqlite-libs-3.26.0-17.el8.x86_64 38/38 2023-07-12T02:03:50.341 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T02:03:50.341 INFO:teuthology.orchestra.run.smithi174.stdout:Upgraded: 2023-07-12T02:03:50.341 INFO:teuthology.orchestra.run.smithi174.stdout: cpp-8.5.0-20.el8.x86_64 gcc-8.5.0-20.el8.x86_64 2023-07-12T02:03:50.341 INFO:teuthology.orchestra.run.smithi174.stdout: gcc-gdb-plugin-8.5.0-20.el8.x86_64 gcc-plugin-annobin-8.5.0-20.el8.x86_64 2023-07-12T02:03:50.341 INFO:teuthology.orchestra.run.smithi174.stdout: libgcc-8.5.0-20.el8.x86_64 libgomp-8.5.0-20.el8.x86_64 2023-07-12T02:03:50.341 INFO:teuthology.orchestra.run.smithi174.stdout: sqlite-3.26.0-18.el8.x86_64 sqlite-libs-3.26.0-18.el8.x86_64 2023-07-12T02:03:50.342 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2023-07-12T02:03:50.342 INFO:teuthology.orchestra.run.smithi174.stdout: daxctl-libs-71.1-7.el8.x86_64 2023-07-12T02:03:50.342 INFO:teuthology.orchestra.run.smithi174.stdout: device-mapper-devel-8:1.02.181-9.el8.x86_64 2023-07-12T02:03:50.342 INFO:teuthology.orchestra.run.smithi174.stdout: dump-1:0.4-0.36.b46.el8.x86_64 2023-07-12T02:03:50.342 INFO:teuthology.orchestra.run.smithi174.stdout: fio-3.19-4.el8.x86_64 2023-07-12T02:03:50.342 INFO:teuthology.orchestra.run.smithi174.stdout: indent-2.2.13-2.el8.x86_64 2023-07-12T02:03:50.342 INFO:teuthology.orchestra.run.smithi174.stdout: inih-56-1.el8.x86_64 2023-07-12T02:03:50.342 INFO:teuthology.orchestra.run.smithi174.stdout: inih-devel-56-1.el8.x86_64 2023-07-12T02:03:50.343 INFO:teuthology.orchestra.run.smithi174.stdout: libblkid-devel-2.32.1-42.el8.x86_64 2023-07-12T02:03:50.343 INFO:teuthology.orchestra.run.smithi174.stdout: libedit-devel-3.1-23.20170329cvs.el8.x86_64 2023-07-12T02:03:50.343 INFO:teuthology.orchestra.run.smithi174.stdout: libicu-devel-60.3-2.el8_1.x86_64 2023-07-12T02:03:50.343 INFO:teuthology.orchestra.run.smithi174.stdout: libpmemblk-1.6.1-1.el8.x86_64 2023-07-12T02:03:50.343 INFO:teuthology.orchestra.run.smithi174.stdout: ndctl-libs-71.1-7.el8.x86_64 2023-07-12T02:03:50.343 INFO:teuthology.orchestra.run.smithi174.stdout: python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 2023-07-12T02:03:50.343 INFO:teuthology.orchestra.run.smithi174.stdout: python2-libs-2.7.18-12.module_el8+299+aa6e9afa.x86_64 2023-07-12T02:03:50.344 INFO:teuthology.orchestra.run.smithi174.stdout: python2-pip-9.0.3-19.module_el8+299+aa6e9afa.noarch 2023-07-12T02:03:50.344 INFO:teuthology.orchestra.run.smithi174.stdout: python2-pip-wheel-9.0.3-19.module_el8+299+aa6e9afa.noarch 2023-07-12T02:03:50.344 INFO:teuthology.orchestra.run.smithi174.stdout: python2-setuptools-39.0.1-13.module_el8+299+aa6e9afa.noarch 2023-07-12T02:03:50.344 INFO:teuthology.orchestra.run.smithi174.stdout: python2-setuptools-wheel-39.0.1-13.module_el8+299+aa6e9afa.noarch 2023-07-12T02:03:50.344 INFO:teuthology.orchestra.run.smithi174.stdout: python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e9afa.noarch 2023-07-12T02:03:50.344 INFO:teuthology.orchestra.run.smithi174.stdout: rmt-2:1.5.3-13.el8.x86_64 2023-07-12T02:03:50.344 INFO:teuthology.orchestra.run.smithi174.stdout: systemd-devel-239-75.el8.x86_64 2023-07-12T02:03:50.344 INFO:teuthology.orchestra.run.smithi174.stdout: userspace-rcu-devel-0.10.1-4.el8.x86_64 2023-07-12T02:03:50.345 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T02:03:50.345 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2023-07-12T02:03:50.462 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:03:50.465 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:03:50.467 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:03:50.566 DEBUG:teuthology.orchestra.run.smithi174:> sudo useradd -m fsgqa 2023-07-12T02:03:50.640 INFO:teuthology.orchestra.run.smithi174.stderr:useradd: user 'fsgqa' already exists 2023-07-12T02:03:50.643 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-07-12T02:03:50.644 DEBUG:teuthology.orchestra.run.smithi174:> sudo groupadd fsgqa 2023-07-12T02:03:50.711 INFO:teuthology.orchestra.run.smithi174.stderr:groupadd: group 'fsgqa' already exists 2023-07-12T02:03:50.713 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-07-12T02:03:50.714 DEBUG:teuthology.orchestra.run.smithi174:> sudo useradd fsgqa2 2023-07-12T02:03:51.300 DEBUG:teuthology.orchestra.run.smithi174:> sudo useradd 123456-fsgqa 2023-07-12T02:03:51.929 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-07-12T02:03:52.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.066+0000 7f3b35e4f700 1 Processor -- start 2023-07-12T02:03:52.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.066+0000 7f3b35e4f700 1 -- start start 2023-07-12T02:03:52.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.067+0000 7f3b35e4f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3b3006b120 0x7f3b30071350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:52.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.067+0000 7f3b35e4f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3b300b5fc0 0x7f3b300b6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:52.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.067+0000 7f3b35e4f700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b300b7180 con 0x7f3b300ba160 2023-07-12T02:03:52.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.067+0000 7f3b35e4f700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b300b90b0 con 0x7f3b3006b120 2023-07-12T02:03:52.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.067+0000 7f3b35e4f700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b300b6980 con 0x7f3b300b5fc0 2023-07-12T02:03:52.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.067+0000 7f3b2f7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3b3006b120 0x7f3b30071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:52.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.067+0000 7f3b2f7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3b3006b120 0x7f3b30071350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50644/0 (socket says 172.21.15.60:50644) 2023-07-12T02:03:52.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.067+0000 7f3b2f7fe700 1 -- 172.21.15.60:0/3368150052 learned_addr learned my addr 172.21.15.60:0/3368150052 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:03:52.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.067+0000 7f3b2ffff700 1 --2- 172.21.15.60:0/3368150052 >> v2:172.21.15.79:3300/0 conn(0x7f3b300b5fc0 0x7f3b300b6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:52.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.067+0000 7f3b2f7fe700 1 -- 172.21.15.60:0/3368150052 >> v2:172.21.15.79:3300/0 conn(0x7f3b300b5fc0 msgr2=0x7f3b300b6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:52.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.067+0000 7f3b2f7fe700 1 --2- 172.21.15.60:0/3368150052 >> v2:172.21.15.79:3300/0 conn(0x7f3b300b5fc0 0x7f3b300b6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:52.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.067+0000 7f3b2f7fe700 1 -- 172.21.15.60:0/3368150052 >> v1:172.21.15.79:6789/0 conn(0x7f3b300ba160 legacy=0x7f3b301485e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:52.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.067+0000 7f3b2f7fe700 1 -- 172.21.15.60:0/3368150052 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b30071070 con 0x7f3b3006b120 2023-07-12T02:03:52.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.067+0000 7f3b2ffff700 1 --2- 172.21.15.60:0/3368150052 >> v2:172.21.15.79:3300/0 conn(0x7f3b300b5fc0 0x7f3b300b6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-12T02:03:52.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.067+0000 7f3b2f7fe700 1 --2- 172.21.15.60:0/3368150052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b3006b120 0x7f3b30071350 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3b30072750 tx=0x7f3b20009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2a4a49243d0fc39 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:52.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.068+0000 7f3b2e7fc700 1 -- 172.21.15.60:0/3368150052 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b20004230 con 0x7f3b3006b120 2023-07-12T02:03:52.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.068+0000 7f3b2e7fc700 1 -- 172.21.15.60:0/3368150052 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b20004390 con 0x7f3b3006b120 2023-07-12T02:03:52.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.068+0000 7f3b2e7fc700 1 -- 172.21.15.60:0/3368150052 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b200036a0 con 0x7f3b3006b120 2023-07-12T02:03:52.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.068+0000 7f3b35e4f700 1 -- 172.21.15.60:0/3368150052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b3006b120 msgr2=0x7f3b30071350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:52.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.068+0000 7f3b35e4f700 1 --2- 172.21.15.60:0/3368150052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b3006b120 0x7f3b30071350 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3b30072750 tx=0x7f3b20009bd0 comp rx=0 tx=0).stop 2023-07-12T02:03:52.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.068+0000 7f3b35e4f700 1 -- 172.21.15.60:0/3368150052 shutdown_connections 2023-07-12T02:03:52.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.068+0000 7f3b35e4f700 1 --2- 172.21.15.60:0/3368150052 >> v2:172.21.15.79:3300/0 conn(0x7f3b300b5fc0 0x7f3b300b6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:52.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.068+0000 7f3b35e4f700 1 --2- 172.21.15.60:0/3368150052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b3006b120 0x7f3b30071350 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:52.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.068+0000 7f3b35e4f700 1 -- 172.21.15.60:0/3368150052 >> 172.21.15.60:0/3368150052 conn(0x7f3b300bd980 msgr2=0x7f3b300b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:52.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.068+0000 7f3b35e4f700 1 -- 172.21.15.60:0/3368150052 shutdown_connections 2023-07-12T02:03:52.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.068+0000 7f3b35e4f700 1 -- 172.21.15.60:0/3368150052 wait complete. 2023-07-12T02:03:52.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.069+0000 7f3b35e4f700 1 Processor -- start 2023-07-12T02:03:52.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.070+0000 7f3b35e4f700 1 -- start start 2023-07-12T02:03:52.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.070+0000 7f3b35e4f700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3b3006b120 0x7f3b301459c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:52.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.070+0000 7f3b35e4f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b300b5fc0 0x7f3b301463e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:52.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.070+0000 7f3b35e4f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b300ba160 0x7f3b301448b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:52.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.070+0000 7f3b35e4f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b30145f00 con 0x7f3b300ba160 2023-07-12T02:03:52.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.070+0000 7f3b35e4f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b30143e30 con 0x7f3b300b5fc0 2023-07-12T02:03:52.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.070+0000 7f3b35e4f700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b301d1a40 con 0x7f3b3006b120 2023-07-12T02:03:52.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.070+0000 7f3b2ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b300ba160 0x7f3b301448b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:52.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.070+0000 7f3b2ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b300ba160 0x7f3b301448b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50656/0 (socket says 172.21.15.60:50656) 2023-07-12T02:03:52.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.070+0000 7f3b2ffff700 1 -- 172.21.15.60:0/3292638964 learned_addr learned my addr 172.21.15.60:0/3292638964 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:03:52.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.070+0000 7f3b2f7fe700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3b3006b120 0x7f3b301459c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:52.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.070+0000 7f3b2effd700 1 --2- 172.21.15.60:0/3292638964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b300b5fc0 0x7f3b301463e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:52.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.071+0000 7f3b2ffff700 1 -- 172.21.15.60:0/3292638964 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3b3006b120 msgr2=0x7f3b301459c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:52.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.071+0000 7f3b2ffff700 1 --2- 172.21.15.60:0/3292638964 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3b3006b120 0x7f3b301459c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:52.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.071+0000 7f3b2ffff700 1 -- 172.21.15.60:0/3292638964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b300b5fc0 msgr2=0x7f3b301463e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:52.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.071+0000 7f3b2ffff700 1 --2- 172.21.15.60:0/3292638964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b300b5fc0 0x7f3b301463e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:52.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.071+0000 7f3b2ffff700 1 -- 172.21.15.60:0/3292638964 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b20009550 con 0x7f3b300ba160 2023-07-12T02:03:52.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.071+0000 7f3b2ffff700 1 --2- 172.21.15.60:0/3292638964 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b300ba160 0x7f3b301448b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3b2800cef0 tx=0x7f3b2800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:52.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.071+0000 7f3b17fff700 1 -- 172.21.15.60:0/3292638964 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2800ad00 con 0x7f3b300ba160 2023-07-12T02:03:52.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.071+0000 7f3b17fff700 1 -- 172.21.15.60:0/3292638964 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2800ae60 con 0x7f3b300ba160 2023-07-12T02:03:52.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.071+0000 7f3b35e4f700 1 -- 172.21.15.60:0/3292638964 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b301d1d20 con 0x7f3b300ba160 2023-07-12T02:03:52.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.071+0000 7f3b17fff700 1 -- 172.21.15.60:0/3292638964 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b28015680 con 0x7f3b300ba160 2023-07-12T02:03:52.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.071+0000 7f3b35e4f700 1 -- 172.21.15.60:0/3292638964 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b301d2240 con 0x7f3b300ba160 2023-07-12T02:03:52.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.072+0000 7f3b35e4f700 1 -- 172.21.15.60:0/3292638964 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b301d1f60 con 0x7f3b300ba160 2023-07-12T02:03:52.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.073+0000 7f3b17fff700 1 -- 172.21.15.60:0/3292638964 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3b2800d430 con 0x7f3b300ba160 2023-07-12T02:03:52.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.073+0000 7f3b17fff700 1 --2- 172.21.15.60:0/3292638964 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f3b1c06ace0 0x7f3b1c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:52.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.073+0000 7f3b17fff700 1 -- 172.21.15.60:0/3292638964 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3b280898b0 con 0x7f3b300ba160 2023-07-12T02:03:52.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.073+0000 7f3b2f7fe700 1 --2- 172.21.15.60:0/3292638964 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f3b1c06ace0 0x7f3b1c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:52.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.074+0000 7f3b2f7fe700 1 --2- 172.21.15.60:0/3292638964 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f3b1c06ace0 0x7f3b1c06d190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3b20009130 tx=0x7f3b20008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:52.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.078+0000 7f3b17fff700 1 -- 172.21.15.60:0/3292638964 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f3b301d1f60 con 0x7f3b300ba160 2023-07-12T02:03:52.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.353+0000 7f3b35e4f700 1 -- 172.21.15.60:0/3292638964 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f3b301d1f60 con 0x7f3b300ba160 2023-07-12T02:03:52.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.353+0000 7f3b17fff700 1 -- 172.21.15.60:0/3292638964 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1268 (secure 0 0 0) 0x7f3b301d1f60 con 0x7f3b300ba160 2023-07-12T02:03:52.357 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:03:52.357 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":1,"fsid":"97e7c909-e567-472e-a5aa-72fde15171f2","modified":"2023-07-12T02:01:21.993079Z","created":"2023-07-12T02:01:21.993079Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:3300","nonce":0},{"type":"v1","addr":"172.21.15.79:6789","nonce":0}]},"addr":"172.21.15.79:6789/0","public_addr":"172.21.15.79:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:3301","nonce":0},{"type":"v1","addr":"172.21.15.79:6790","nonce":0}]},"addr":"172.21.15.79:6790/0","public_addr":"172.21.15.79:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-07-12T02:03:52.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.356+0000 7f3b35e4f700 1 -- 172.21.15.60:0/3292638964 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f3b1c06ace0 msgr2=0x7f3b1c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:52.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.356+0000 7f3b35e4f700 1 --2- 172.21.15.60:0/3292638964 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f3b1c06ace0 0x7f3b1c06d190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3b20009130 tx=0x7f3b20008030 comp rx=0 tx=0).stop 2023-07-12T02:03:52.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.356+0000 7f3b35e4f700 1 -- 172.21.15.60:0/3292638964 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b300ba160 msgr2=0x7f3b301448b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:52.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.356+0000 7f3b35e4f700 1 --2- 172.21.15.60:0/3292638964 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b300ba160 0x7f3b301448b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3b2800cef0 tx=0x7f3b2800cf20 comp rx=0 tx=0).stop 2023-07-12T02:03:52.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.356+0000 7f3b35e4f700 1 -- 172.21.15.60:0/3292638964 shutdown_connections 2023-07-12T02:03:52.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.356+0000 7f3b35e4f700 1 --2- 172.21.15.60:0/3292638964 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f3b1c06ace0 0x7f3b1c06d190 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:52.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.356+0000 7f3b35e4f700 1 --2- 172.21.15.60:0/3292638964 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b300ba160 0x7f3b301448b0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:52.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.356+0000 7f3b35e4f700 1 --2- 172.21.15.60:0/3292638964 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3b3006b120 0x7f3b301459c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:52.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.356+0000 7f3b35e4f700 1 --2- 172.21.15.60:0/3292638964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b300b5fc0 0x7f3b301463e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:52.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.356+0000 7f3b35e4f700 1 -- 172.21.15.60:0/3292638964 >> 172.21.15.60:0/3292638964 conn(0x7f3b300bd980 msgr2=0x7f3b300bc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:52.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.356+0000 7f3b35e4f700 1 -- 172.21.15.60:0/3292638964 shutdown_connections 2023-07-12T02:03:52.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.356+0000 7f3b35e4f700 1 -- 172.21.15.60:0/3292638964 wait complete. 2023-07-12T02:03:52.361 INFO:teuthology.orchestra.run.smithi060.stderr:dumped monmap epoch 1 2023-07-12T02:03:52.371 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-07-12T02:03:52.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.494+0000 7f6670d03700 1 Processor -- start 2023-07-12T02:03:52.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.494+0000 7f6670d03700 1 -- start start 2023-07-12T02:03:52.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.495+0000 7f6670d03700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f666c144820 0x7f666c0b65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:52.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.495+0000 7f6670d03700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f666c0b5a10 0x7f666c0b6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:52.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.495+0000 7f6670d03700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f666c0b5f00 con 0x7f666c14a800 2023-07-12T02:03:52.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.495+0000 7f6670d03700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f666c0b61e0 con 0x7f666c0b5a10 2023-07-12T02:03:52.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.495+0000 7f6670d03700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f666c0c17d0 con 0x7f666c144820 2023-07-12T02:03:52.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.495+0000 7f6669d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f666c0b5a10 0x7f666c0b6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:52.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.495+0000 7f6669d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f666c0b5a10 0x7f666c0b6b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50660/0 (socket says 172.21.15.60:50660) 2023-07-12T02:03:52.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.495+0000 7f6669d9b700 1 -- 172.21.15.60:0/3549888855 learned_addr learned my addr 172.21.15.60:0/3549888855 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:03:52.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.496+0000 7f666a59c700 1 --2- 172.21.15.60:0/3549888855 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f666c144820 0x7f666c0b65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:52.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.496+0000 7f6669d9b700 1 -- 172.21.15.60:0/3549888855 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f666c144820 msgr2=0x7f666c0b65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:52.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.496+0000 7f6669d9b700 1 --2- 172.21.15.60:0/3549888855 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f666c144820 0x7f666c0b65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:52.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.496+0000 7f6669d9b700 1 -- 172.21.15.60:0/3549888855 >> v1:172.21.15.79:6789/0 conn(0x7f666c14a800 legacy=0x7f666c14ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:03:52.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.496+0000 7f6669d9b700 1 -- 172.21.15.60:0/3549888855 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f666c0b7160 con 0x7f666c0b5a10 2023-07-12T02:03:52.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.496+0000 7f6669d9b700 1 --2- 172.21.15.60:0/3549888855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f666c0b5a10 0x7f666c0b6b10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f66540098f0 tx=0x7f6654009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1a48ce50dacac9a server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:52.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.496+0000 7f666959a700 1 -- 172.21.15.60:0/3549888855 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6654004230 con 0x7f666c0b5a10 2023-07-12T02:03:52.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.496+0000 7f666959a700 1 -- 172.21.15.60:0/3549888855 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6654004390 con 0x7f666c0b5a10 2023-07-12T02:03:52.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.496+0000 7f666959a700 1 -- 172.21.15.60:0/3549888855 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66540036a0 con 0x7f666c0b5a10 2023-07-12T02:03:52.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.497+0000 7f6670d03700 1 -- 172.21.15.60:0/3549888855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f666c0b5a10 msgr2=0x7f666c0b6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:52.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.497+0000 7f6670d03700 1 --2- 172.21.15.60:0/3549888855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f666c0b5a10 0x7f666c0b6b10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f66540098f0 tx=0x7f6654009c00 comp rx=0 tx=0).stop 2023-07-12T02:03:52.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.497+0000 7f6670d03700 1 -- 172.21.15.60:0/3549888855 shutdown_connections 2023-07-12T02:03:52.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.497+0000 7f6670d03700 1 --2- 172.21.15.60:0/3549888855 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f666c144820 0x7f666c0b65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:52.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.497+0000 7f6670d03700 1 --2- 172.21.15.60:0/3549888855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f666c0b5a10 0x7f666c0b6b10 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:52.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.497+0000 7f6670d03700 1 -- 172.21.15.60:0/3549888855 >> 172.21.15.60:0/3549888855 conn(0x7f666c0c08f0 msgr2=0x7f666c0c0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:52.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.497+0000 7f6670d03700 1 -- 172.21.15.60:0/3549888855 shutdown_connections 2023-07-12T02:03:52.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.497+0000 7f6670d03700 1 -- 172.21.15.60:0/3549888855 wait complete. 2023-07-12T02:03:52.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.498+0000 7f6670d03700 1 Processor -- start 2023-07-12T02:03:52.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.498+0000 7f6670d03700 1 -- start start 2023-07-12T02:03:52.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.499+0000 7f6670d03700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f666c0b5a10 0x7f666c146790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:52.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.499+0000 7f6670d03700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f666c144820 0x7f666c1473a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:52.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.499+0000 7f6670d03700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f666c14a800 0x7f666c1478e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:52.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.499+0000 7f6670d03700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f666c141730 con 0x7f666c0b5a10 2023-07-12T02:03:52.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.499+0000 7f6670d03700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f666c1419d0 con 0x7f666c144820 2023-07-12T02:03:52.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.499+0000 7f6670d03700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f666c147060 con 0x7f666c14a800 2023-07-12T02:03:52.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.499+0000 7f666a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f666c0b5a10 0x7f666c146790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:52.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.499+0000 7f666a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f666c0b5a10 0x7f666c146790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50674/0 (socket says 172.21.15.60:50674) 2023-07-12T02:03:52.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.499+0000 7f666a59c700 1 -- 172.21.15.60:0/3232393803 learned_addr learned my addr 172.21.15.60:0/3232393803 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:03:52.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.499+0000 7f666ad9d700 1 --2- 172.21.15.60:0/3232393803 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f666c14a800 0x7f666c1478e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:52.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.499+0000 7f6669d9b700 1 --2- 172.21.15.60:0/3232393803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f666c144820 0x7f666c1473a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:52.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.499+0000 7f666a59c700 1 -- 172.21.15.60:0/3232393803 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f666c14a800 msgr2=0x7f666c1478e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:52.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.499+0000 7f666a59c700 1 --2- 172.21.15.60:0/3232393803 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f666c14a800 0x7f666c1478e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:52.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.499+0000 7f666a59c700 1 -- 172.21.15.60:0/3232393803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f666c144820 msgr2=0x7f666c1473a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:52.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.499+0000 7f666a59c700 1 --2- 172.21.15.60:0/3232393803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f666c144820 0x7f666c1473a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:52.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.499+0000 7f666a59c700 1 -- 172.21.15.60:0/3232393803 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6654009550 con 0x7f666c0b5a10 2023-07-12T02:03:52.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.499+0000 7f666a59c700 1 --2- 172.21.15.60:0/3232393803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f666c0b5a10 0x7f666c146790 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f665c007ef0 tx=0x7f665c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:52.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.499+0000 7f6662ffd700 1 -- 172.21.15.60:0/3232393803 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665c014420 con 0x7f666c0b5a10 2023-07-12T02:03:52.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.499+0000 7f6662ffd700 1 -- 172.21.15.60:0/3232393803 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f665c014580 con 0x7f666c0b5a10 2023-07-12T02:03:52.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.499+0000 7f6670d03700 1 -- 172.21.15.60:0/3232393803 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f666c146cd0 con 0x7f666c0b5a10 2023-07-12T02:03:52.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.499+0000 7f6662ffd700 1 -- 172.21.15.60:0/3232393803 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665c014910 con 0x7f666c0b5a10 2023-07-12T02:03:52.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.499+0000 7f6670d03700 1 -- 172.21.15.60:0/3232393803 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f666c1452b0 con 0x7f666c0b5a10 2023-07-12T02:03:52.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.500+0000 7f6670d03700 1 -- 172.21.15.60:0/3232393803 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f666c141b90 con 0x7f666c0b5a10 2023-07-12T02:03:52.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.501+0000 7f6662ffd700 1 -- 172.21.15.60:0/3232393803 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f665c014a70 con 0x7f666c0b5a10 2023-07-12T02:03:52.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.501+0000 7f6662ffd700 1 --2- 172.21.15.60:0/3232393803 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f664c06ace0 0x7f664c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:03:52.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.501+0000 7f6662ffd700 1 -- 172.21.15.60:0/3232393803 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f665c089c10 con 0x7f666c0b5a10 2023-07-12T02:03:52.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.501+0000 7f6669d9b700 1 --2- 172.21.15.60:0/3232393803 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f664c06ace0 0x7f664c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:03:52.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.502+0000 7f6669d9b700 1 --2- 172.21.15.60:0/3232393803 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f664c06ace0 0x7f664c06d190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6654009130 tx=0x7f6654008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:03:52.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.506+0000 7f6662ffd700 1 -- 172.21.15.60:0/3232393803 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f665c054d50 con 0x7f666c0b5a10 2023-07-12T02:03:52.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.781+0000 7f6670d03700 1 -- 172.21.15.60:0/3232393803 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f666c145100 con 0x7f666c0b5a10 2023-07-12T02:03:52.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.781+0000 7f6662ffd700 1 -- 172.21.15.60:0/3232393803 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v15) v1 ==== 92+0+63 (secure 0 0 0) 0x7f665c058370 con 0x7f666c0b5a10 2023-07-12T02:03:52.785 INFO:teuthology.orchestra.run.smithi060.stdout:[client.admin] 2023-07-12T02:03:52.785 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQByCa5ke/CcDxAAY+pvZk+ZKWFzmiAdhJKT1w== 2023-07-12T02:03:52.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.784+0000 7f6670d03700 1 -- 172.21.15.60:0/3232393803 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f664c06ace0 msgr2=0x7f664c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:52.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.784+0000 7f6670d03700 1 --2- 172.21.15.60:0/3232393803 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f664c06ace0 0x7f664c06d190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6654009130 tx=0x7f6654008030 comp rx=0 tx=0).stop 2023-07-12T02:03:52.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.784+0000 7f6670d03700 1 -- 172.21.15.60:0/3232393803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f666c0b5a10 msgr2=0x7f666c146790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:03:52.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.784+0000 7f6670d03700 1 --2- 172.21.15.60:0/3232393803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f666c0b5a10 0x7f666c146790 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f665c007ef0 tx=0x7f665c00e3c0 comp rx=0 tx=0).stop 2023-07-12T02:03:52.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.784+0000 7f6670d03700 1 -- 172.21.15.60:0/3232393803 shutdown_connections 2023-07-12T02:03:52.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.784+0000 7f6670d03700 1 --2- 172.21.15.60:0/3232393803 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f664c06ace0 0x7f664c06d190 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:52.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.784+0000 7f6670d03700 1 --2- 172.21.15.60:0/3232393803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f666c0b5a10 0x7f666c146790 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:52.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.784+0000 7f6670d03700 1 --2- 172.21.15.60:0/3232393803 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f666c14a800 0x7f666c1478e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:52.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.784+0000 7f6670d03700 1 --2- 172.21.15.60:0/3232393803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f666c144820 0x7f666c1473a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:03:52.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.784+0000 7f6670d03700 1 -- 172.21.15.60:0/3232393803 >> 172.21.15.60:0/3232393803 conn(0x7f666c0c08f0 msgr2=0x7f666c0bbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:03:52.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.784+0000 7f6670d03700 1 -- 172.21.15.60:0/3232393803 shutdown_connections 2023-07-12T02:03:52.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:03:52.784+0000 7f6670d03700 1 -- 172.21.15.60:0/3232393803 wait complete. 2023-07-12T02:03:52.799 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-07-12T02:03:52.799 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/tmp/tmp.CBamI6wQNAxfstests-dev/local.config 2023-07-12T02:03:52.869 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.60:6789:/test export TEST_DIR=/tmp/tmp.bp3K5ctJhDtest export SCRATCH_DEV=172.21.15.60:6789:/scratch export SCRATCH_MNT=/tmp/tmp.3EzHOaP1bIscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQByCa5ke/CcDxAAY+pvZk+ZKWFzmiAdhJKT1w==" 2023-07-12T02:03:52.869 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-07-12T02:03:52.870 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/tmp/tmp.CBamI6wQNAxfstests-dev/ceph.exclude 2023-07-12T02:03:52.980 DEBUG:teuthology.orchestra.run.smithi174:> (cd /tmp/tmp.CBamI6wQNAxfstests-dev && exec sudo make) 2023-07-12T02:03:53.108 INFO:teuthology.orchestra.run.smithi174.stdout:libtoolize -cfi 2023-07-12T02:03:53.595 INFO:teuthology.orchestra.run.smithi174.stdout:libtoolize: putting auxiliary files in '.'. 2023-07-12T02:03:53.595 INFO:teuthology.orchestra.run.smithi174.stdout:libtoolize: copying file './config.guess' 2023-07-12T02:03:53.605 INFO:teuthology.orchestra.run.smithi174.stdout:libtoolize: copying file './config.sub' 2023-07-12T02:03:53.615 INFO:teuthology.orchestra.run.smithi174.stdout:libtoolize: copying file './install-sh' 2023-07-12T02:03:53.626 INFO:teuthology.orchestra.run.smithi174.stdout:libtoolize: copying file './ltmain.sh' 2023-07-12T02:03:53.691 INFO:teuthology.orchestra.run.smithi174.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-07-12T02:03:53.691 INFO:teuthology.orchestra.run.smithi174.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-07-12T02:03:53.705 INFO:teuthology.orchestra.run.smithi174.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-07-12T02:03:53.718 INFO:teuthology.orchestra.run.smithi174.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-07-12T02:03:53.730 INFO:teuthology.orchestra.run.smithi174.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-07-12T02:03:53.743 INFO:teuthology.orchestra.run.smithi174.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-07-12T02:03:53.759 INFO:teuthology.orchestra.run.smithi174.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-07-12T02:03:53.763 INFO:teuthology.orchestra.run.smithi174.stdout:cp include/install-sh . 2023-07-12T02:03:53.765 INFO:teuthology.orchestra.run.smithi174.stdout:aclocal -I m4 2023-07-12T02:03:55.098 INFO:teuthology.orchestra.run.smithi174.stdout:autoheader 2023-07-12T02:03:55.481 INFO:teuthology.orchestra.run.smithi174.stdout:autoconf 2023-07-12T02:03:55.694 INFO:teuthology.orchestra.run.smithi174.stdout:./configure \ 2023-07-12T02:03:55.695 INFO:teuthology.orchestra.run.smithi174.stdout: --libexecdir=/usr/lib \ 2023-07-12T02:03:55.695 INFO:teuthology.orchestra.run.smithi174.stdout: --exec_prefix=/var/lib 2023-07-12T02:03:56.081 INFO:teuthology.orchestra.run.smithi174.stdout:checking build system type... x86_64-pc-linux-gnu 2023-07-12T02:03:56.081 INFO:teuthology.orchestra.run.smithi174.stdout:checking host system type... x86_64-pc-linux-gnu 2023-07-12T02:03:56.085 INFO:teuthology.orchestra.run.smithi174.stdout:checking how to print strings... printf 2023-07-12T02:03:56.085 INFO:teuthology.orchestra.run.smithi174.stdout:checking for gcc... gcc 2023-07-12T02:03:56.237 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether the C compiler works... yes 2023-07-12T02:03:56.237 INFO:teuthology.orchestra.run.smithi174.stdout:checking for C compiler default output file name... a.out 2023-07-12T02:03:56.287 INFO:teuthology.orchestra.run.smithi174.stdout:checking for suffix of executables... 2023-07-12T02:03:56.363 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether we are cross compiling... no 2023-07-12T02:03:56.400 INFO:teuthology.orchestra.run.smithi174.stdout:checking for suffix of object files... o 2023-07-12T02:03:56.434 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether we are using the GNU C compiler... yes 2023-07-12T02:03:56.468 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether gcc accepts -g... yes 2023-07-12T02:03:56.515 INFO:teuthology.orchestra.run.smithi174.stdout:checking for gcc option to accept ISO C89... none needed 2023-07-12T02:03:56.523 INFO:teuthology.orchestra.run.smithi174.stdout:checking for a sed that does not truncate output... /bin/sed 2023-07-12T02:03:56.528 INFO:teuthology.orchestra.run.smithi174.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-07-12T02:03:56.531 INFO:teuthology.orchestra.run.smithi174.stdout:checking for egrep... /bin/grep -E 2023-07-12T02:03:56.533 INFO:teuthology.orchestra.run.smithi174.stdout:checking for fgrep... /bin/grep -F 2023-07-12T02:03:56.542 INFO:teuthology.orchestra.run.smithi174.stdout:checking for ld used by gcc... /bin/ld 2023-07-12T02:03:56.545 INFO:teuthology.orchestra.run.smithi174.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-07-12T02:03:56.554 INFO:teuthology.orchestra.run.smithi174.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-07-12T02:03:56.594 INFO:teuthology.orchestra.run.smithi174.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-07-12T02:03:56.594 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether ln -s works... yes 2023-07-12T02:03:56.609 INFO:teuthology.orchestra.run.smithi174.stdout:checking the maximum length of command line arguments... 1572864 2023-07-12T02:03:56.615 INFO:teuthology.orchestra.run.smithi174.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-07-12T02:03:56.615 INFO:teuthology.orchestra.run.smithi174.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-07-12T02:03:56.615 INFO:teuthology.orchestra.run.smithi174.stdout:checking for /bin/ld option to reload object files... -r 2023-07-12T02:03:56.616 INFO:teuthology.orchestra.run.smithi174.stdout:checking for objdump... objdump 2023-07-12T02:03:56.616 INFO:teuthology.orchestra.run.smithi174.stdout:checking how to recognize dependent libraries... pass_all 2023-07-12T02:03:56.617 INFO:teuthology.orchestra.run.smithi174.stdout:checking for dlltool... no 2023-07-12T02:03:56.617 INFO:teuthology.orchestra.run.smithi174.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-07-12T02:03:56.617 INFO:teuthology.orchestra.run.smithi174.stdout:checking for ar... ar 2023-07-12T02:03:56.671 INFO:teuthology.orchestra.run.smithi174.stdout:checking for archiver @FILE support... @ 2023-07-12T02:03:56.671 INFO:teuthology.orchestra.run.smithi174.stdout:checking for strip... strip 2023-07-12T02:03:56.672 INFO:teuthology.orchestra.run.smithi174.stdout:checking for ranlib... ranlib 2023-07-12T02:03:56.672 INFO:teuthology.orchestra.run.smithi174.stdout:checking for gawk... gawk 2023-07-12T02:03:56.781 INFO:teuthology.orchestra.run.smithi174.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-07-12T02:03:56.784 INFO:teuthology.orchestra.run.smithi174.stdout:checking for sysroot... no 2023-07-12T02:03:56.791 INFO:teuthology.orchestra.run.smithi174.stdout:checking for a working dd... /bin/dd 2023-07-12T02:03:56.799 INFO:teuthology.orchestra.run.smithi174.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-07-12T02:03:56.827 INFO:teuthology.orchestra.run.smithi174.stdout:checking for mt... no 2023-07-12T02:03:56.833 INFO:teuthology.orchestra.run.smithi174.stdout:checking if : is a manifest tool... no 2023-07-12T02:03:56.891 INFO:teuthology.orchestra.run.smithi174.stdout:checking how to run the C preprocessor... gcc -E 2023-07-12T02:03:57.119 INFO:teuthology.orchestra.run.smithi174.stdout:checking for ANSI C header files... yes 2023-07-12T02:03:57.162 INFO:teuthology.orchestra.run.smithi174.stdout:checking for sys/types.h... yes 2023-07-12T02:03:57.227 INFO:teuthology.orchestra.run.smithi174.stdout:checking for sys/stat.h... yes 2023-07-12T02:03:57.278 INFO:teuthology.orchestra.run.smithi174.stdout:checking for stdlib.h... yes 2023-07-12T02:03:57.331 INFO:teuthology.orchestra.run.smithi174.stdout:checking for string.h... yes 2023-07-12T02:03:57.392 INFO:teuthology.orchestra.run.smithi174.stdout:checking for memory.h... yes 2023-07-12T02:03:57.445 INFO:teuthology.orchestra.run.smithi174.stdout:checking for strings.h... yes 2023-07-12T02:03:57.502 INFO:teuthology.orchestra.run.smithi174.stdout:checking for inttypes.h... yes 2023-07-12T02:03:57.556 INFO:teuthology.orchestra.run.smithi174.stdout:checking for stdint.h... yes 2023-07-12T02:03:57.627 INFO:teuthology.orchestra.run.smithi174.stdout:checking for unistd.h... yes 2023-07-12T02:03:57.688 INFO:teuthology.orchestra.run.smithi174.stdout:checking for dlfcn.h... yes 2023-07-12T02:03:57.696 INFO:teuthology.orchestra.run.smithi174.stdout:checking for objdir... .libs 2023-07-12T02:03:57.830 INFO:teuthology.orchestra.run.smithi174.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-07-12T02:03:57.830 INFO:teuthology.orchestra.run.smithi174.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-07-12T02:03:57.868 INFO:teuthology.orchestra.run.smithi174.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-07-12T02:03:57.905 INFO:teuthology.orchestra.run.smithi174.stdout:checking if gcc static flag -static works... no 2023-07-12T02:03:57.958 INFO:teuthology.orchestra.run.smithi174.stdout:checking if gcc supports -c -o file.o... yes 2023-07-12T02:03:57.959 INFO:teuthology.orchestra.run.smithi174.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-07-12T02:03:57.974 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-07-12T02:03:58.023 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether -lc should be explicitly linked in... no 2023-07-12T02:03:58.121 INFO:teuthology.orchestra.run.smithi174.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-07-12T02:03:58.121 INFO:teuthology.orchestra.run.smithi174.stdout:checking how to hardcode library paths into programs... immediate 2023-07-12T02:03:58.128 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether stripping libraries is possible... yes 2023-07-12T02:03:58.128 INFO:teuthology.orchestra.run.smithi174.stdout:checking if libtool supports shared libraries... yes 2023-07-12T02:03:58.129 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether to build shared libraries... yes 2023-07-12T02:03:58.129 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether to build static libraries... yes 2023-07-12T02:03:58.140 INFO:teuthology.orchestra.run.smithi174.stdout:checking for gcc... (cached) gcc 2023-07-12T02:03:58.178 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-07-12T02:03:58.179 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether gcc accepts -g... (cached) yes 2023-07-12T02:03:58.179 INFO:teuthology.orchestra.run.smithi174.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-07-12T02:03:58.179 INFO:teuthology.orchestra.run.smithi174.stdout:checking for gmake... /usr/bin/gmake 2023-07-12T02:03:58.180 INFO:teuthology.orchestra.run.smithi174.stderr:./configure: line 12070: test: $(SHELL): binary operator expected 2023-07-12T02:03:58.180 INFO:teuthology.orchestra.run.smithi174.stdout:checking for tar... /bin/tar 2023-07-12T02:03:58.181 INFO:teuthology.orchestra.run.smithi174.stdout:checking for gzip... /bin/gzip 2023-07-12T02:03:58.196 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether gcc -MM is supported... yes 2023-07-12T02:03:58.197 INFO:teuthology.orchestra.run.smithi174.stdout:checking for sort... /bin/sort 2023-07-12T02:03:58.197 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether ln -s works... yes 2023-07-12T02:03:58.197 INFO:teuthology.orchestra.run.smithi174.stdout:checking for rpm... /bin/rpm 2023-07-12T02:03:58.205 INFO:teuthology.orchestra.run.smithi174.stdout:checking for rpmbuild... no 2023-07-12T02:03:58.258 INFO:teuthology.orchestra.run.smithi174.stdout:checking assert.h usability... yes 2023-07-12T02:03:58.274 INFO:teuthology.orchestra.run.smithi174.stdout:checking assert.h presence... yes 2023-07-12T02:03:58.275 INFO:teuthology.orchestra.run.smithi174.stdout:checking for assert.h... yes 2023-07-12T02:03:58.331 INFO:teuthology.orchestra.run.smithi174.stdout:checking bstring.h usability... no 2023-07-12T02:03:58.355 INFO:teuthology.orchestra.run.smithi174.stdout:checking bstring.h presence... no 2023-07-12T02:03:58.355 INFO:teuthology.orchestra.run.smithi174.stdout:checking for bstring.h... no 2023-07-12T02:03:58.404 INFO:teuthology.orchestra.run.smithi174.stdout:checking libgen.h usability... yes 2023-07-12T02:03:58.420 INFO:teuthology.orchestra.run.smithi174.stdout:checking libgen.h presence... yes 2023-07-12T02:03:58.420 INFO:teuthology.orchestra.run.smithi174.stdout:checking for libgen.h... yes 2023-07-12T02:03:58.486 INFO:teuthology.orchestra.run.smithi174.stdout:checking dirent.h usability... yes 2023-07-12T02:03:58.503 INFO:teuthology.orchestra.run.smithi174.stdout:checking dirent.h presence... yes 2023-07-12T02:03:58.503 INFO:teuthology.orchestra.run.smithi174.stdout:checking for dirent.h... yes 2023-07-12T02:03:58.585 INFO:teuthology.orchestra.run.smithi174.stdout:checking errno.h usability... yes 2023-07-12T02:03:58.602 INFO:teuthology.orchestra.run.smithi174.stdout:checking errno.h presence... yes 2023-07-12T02:03:58.602 INFO:teuthology.orchestra.run.smithi174.stdout:checking for errno.h... yes 2023-07-12T02:03:58.664 INFO:teuthology.orchestra.run.smithi174.stdout:checking malloc.h usability... yes 2023-07-12T02:03:58.682 INFO:teuthology.orchestra.run.smithi174.stdout:checking malloc.h presence... yes 2023-07-12T02:03:58.682 INFO:teuthology.orchestra.run.smithi174.stdout:checking for malloc.h... yes 2023-07-12T02:03:58.739 INFO:teuthology.orchestra.run.smithi174.stdout:checking uuid.h usability... no 2023-07-12T02:03:58.762 INFO:teuthology.orchestra.run.smithi174.stdout:checking uuid.h presence... no 2023-07-12T02:03:58.763 INFO:teuthology.orchestra.run.smithi174.stdout:checking for uuid.h... no 2023-07-12T02:03:58.824 INFO:teuthology.orchestra.run.smithi174.stdout:checking uuid/uuid.h usability... yes 2023-07-12T02:03:58.843 INFO:teuthology.orchestra.run.smithi174.stdout:checking uuid/uuid.h presence... yes 2023-07-12T02:03:58.843 INFO:teuthology.orchestra.run.smithi174.stdout:checking for uuid/uuid.h... yes 2023-07-12T02:03:58.899 INFO:teuthology.orchestra.run.smithi174.stdout:checking sys/uuid.h usability... no 2023-07-12T02:03:58.923 INFO:teuthology.orchestra.run.smithi174.stdout:checking sys/uuid.h presence... no 2023-07-12T02:03:58.924 INFO:teuthology.orchestra.run.smithi174.stdout:checking for sys/uuid.h... no 2023-07-12T02:03:58.974 INFO:teuthology.orchestra.run.smithi174.stdout:checking sys/file.h usability... yes 2023-07-12T02:03:58.991 INFO:teuthology.orchestra.run.smithi174.stdout:checking sys/file.h presence... yes 2023-07-12T02:03:58.991 INFO:teuthology.orchestra.run.smithi174.stdout:checking for sys/file.h... yes 2023-07-12T02:03:59.048 INFO:teuthology.orchestra.run.smithi174.stdout:checking sys/fcntl.h usability... yes 2023-07-12T02:03:59.065 INFO:teuthology.orchestra.run.smithi174.stdout:checking sys/fcntl.h presence... yes 2023-07-12T02:03:59.065 INFO:teuthology.orchestra.run.smithi174.stdout:checking for sys/fcntl.h... yes 2023-07-12T02:03:59.124 INFO:teuthology.orchestra.run.smithi174.stdout:checking sys/syssgi.h usability... no 2023-07-12T02:03:59.145 INFO:teuthology.orchestra.run.smithi174.stdout:checking sys/syssgi.h presence... no 2023-07-12T02:03:59.146 INFO:teuthology.orchestra.run.smithi174.stdout:checking for sys/syssgi.h... no 2023-07-12T02:03:59.227 INFO:teuthology.orchestra.run.smithi174.stdout:checking sys/param.h usability... yes 2023-07-12T02:03:59.248 INFO:teuthology.orchestra.run.smithi174.stdout:checking sys/param.h presence... yes 2023-07-12T02:03:59.249 INFO:teuthology.orchestra.run.smithi174.stdout:checking for sys/param.h... yes 2023-07-12T02:03:59.263 INFO:teuthology.orchestra.run.smithi174.stdout:checking for sys/stat.h... (cached) yes 2023-07-12T02:03:59.329 INFO:teuthology.orchestra.run.smithi174.stdout:checking sys/statvfs.h usability... yes 2023-07-12T02:03:59.345 INFO:teuthology.orchestra.run.smithi174.stdout:checking sys/statvfs.h presence... yes 2023-07-12T02:03:59.346 INFO:teuthology.orchestra.run.smithi174.stdout:checking for sys/statvfs.h... yes 2023-07-12T02:03:59.402 INFO:teuthology.orchestra.run.smithi174.stdout:checking sys/time.h usability... yes 2023-07-12T02:03:59.419 INFO:teuthology.orchestra.run.smithi174.stdout:checking sys/time.h presence... yes 2023-07-12T02:03:59.420 INFO:teuthology.orchestra.run.smithi174.stdout:checking for sys/time.h... yes 2023-07-12T02:03:59.491 INFO:teuthology.orchestra.run.smithi174.stdout:checking sys/ioctl.h usability... yes 2023-07-12T02:03:59.507 INFO:teuthology.orchestra.run.smithi174.stdout:checking sys/ioctl.h presence... yes 2023-07-12T02:03:59.508 INFO:teuthology.orchestra.run.smithi174.stdout:checking for sys/ioctl.h... yes 2023-07-12T02:03:59.568 INFO:teuthology.orchestra.run.smithi174.stdout:checking sys/wait.h usability... yes 2023-07-12T02:03:59.587 INFO:teuthology.orchestra.run.smithi174.stdout:checking sys/wait.h presence... yes 2023-07-12T02:03:59.587 INFO:teuthology.orchestra.run.smithi174.stdout:checking for sys/wait.h... yes 2023-07-12T02:03:59.601 INFO:teuthology.orchestra.run.smithi174.stdout:checking for sys/types.h... (cached) yes 2023-07-12T02:03:59.615 INFO:teuthology.orchestra.run.smithi174.stdout:checking for strings.h... (cached) yes 2023-07-12T02:03:59.672 INFO:teuthology.orchestra.run.smithi174.stdout:checking err.h usability... yes 2023-07-12T02:03:59.688 INFO:teuthology.orchestra.run.smithi174.stdout:checking err.h presence... yes 2023-07-12T02:03:59.688 INFO:teuthology.orchestra.run.smithi174.stdout:checking for err.h... yes 2023-07-12T02:03:59.745 INFO:teuthology.orchestra.run.smithi174.stdout:checking linux/falloc.h usability... yes 2023-07-12T02:03:59.760 INFO:teuthology.orchestra.run.smithi174.stdout:checking linux/falloc.h presence... yes 2023-07-12T02:03:59.760 INFO:teuthology.orchestra.run.smithi174.stdout:checking for linux/falloc.h... yes 2023-07-12T02:03:59.816 INFO:teuthology.orchestra.run.smithi174.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-07-12T02:03:59.840 INFO:teuthology.orchestra.run.smithi174.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-07-12T02:03:59.840 INFO:teuthology.orchestra.run.smithi174.stdout:checking for sys/fs/xfs_fsops.h... no 2023-07-12T02:03:59.888 INFO:teuthology.orchestra.run.smithi174.stdout:checking sys/fs/xfs_itable.h usability... no 2023-07-12T02:03:59.912 INFO:teuthology.orchestra.run.smithi174.stdout:checking sys/fs/xfs_itable.h presence... no 2023-07-12T02:03:59.912 INFO:teuthology.orchestra.run.smithi174.stdout:checking for sys/fs/xfs_itable.h... no 2023-07-12T02:03:59.960 INFO:teuthology.orchestra.run.smithi174.stdout:checking xfs/platform_defs.h usability... no 2023-07-12T02:03:59.984 INFO:teuthology.orchestra.run.smithi174.stdout:checking xfs/platform_defs.h presence... no 2023-07-12T02:03:59.985 INFO:teuthology.orchestra.run.smithi174.stdout:checking for xfs/platform_defs.h... no 2023-07-12T02:04:00.032 INFO:teuthology.orchestra.run.smithi174.stdout:checking btrfs/ioctl.h usability... no 2023-07-12T02:04:00.057 INFO:teuthology.orchestra.run.smithi174.stdout:checking btrfs/ioctl.h presence... no 2023-07-12T02:04:00.057 INFO:teuthology.orchestra.run.smithi174.stdout:checking for btrfs/ioctl.h... no 2023-07-12T02:04:00.105 INFO:teuthology.orchestra.run.smithi174.stdout:checking cifs/ioctl.h usability... no 2023-07-12T02:04:00.129 INFO:teuthology.orchestra.run.smithi174.stdout:checking cifs/ioctl.h presence... no 2023-07-12T02:04:00.129 INFO:teuthology.orchestra.run.smithi174.stdout:checking for cifs/ioctl.h... no 2023-07-12T02:04:00.181 INFO:teuthology.orchestra.run.smithi174.stdout:checking sys/mman.h usability... yes 2023-07-12T02:04:00.197 INFO:teuthology.orchestra.run.smithi174.stdout:checking sys/mman.h presence... yes 2023-07-12T02:04:00.198 INFO:teuthology.orchestra.run.smithi174.stdout:checking for sys/mman.h... yes 2023-07-12T02:04:00.235 INFO:teuthology.orchestra.run.smithi174.stdout:checking for xfs/xfs_log_format.h... no 2023-07-12T02:04:00.302 INFO:teuthology.orchestra.run.smithi174.stdout:checking for uuid_compare... no 2023-07-12T02:04:00.358 INFO:teuthology.orchestra.run.smithi174.stdout:checking for uuid_compare in -luuid... yes 2023-07-12T02:04:00.441 INFO:teuthology.orchestra.run.smithi174.stdout:checking for xfs/xfs.h... yes 2023-07-12T02:04:00.473 INFO:teuthology.orchestra.run.smithi174.stdout:checking for xfs/libxfs.h... no 2023-07-12T02:04:00.512 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether xlog_assign_lsn is declared... no 2023-07-12T02:04:00.563 INFO:teuthology.orchestra.run.smithi174.stdout:checking for xfs/xqm.h... yes 2023-07-12T02:04:00.643 INFO:teuthology.orchestra.run.smithi174.stdout:checking xfsctl from xfs/xfs.h... ok 2023-07-12T02:04:00.687 INFO:teuthology.orchestra.run.smithi174.stdout:checking xfs/handle.h usability... yes 2023-07-12T02:04:00.703 INFO:teuthology.orchestra.run.smithi174.stdout:checking xfs/handle.h presence... yes 2023-07-12T02:04:00.703 INFO:teuthology.orchestra.run.smithi174.stdout:checking for xfs/handle.h... yes 2023-07-12T02:04:00.762 INFO:teuthology.orchestra.run.smithi174.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-07-12T02:04:00.816 INFO:teuthology.orchestra.run.smithi174.stdout:checking sys/acl.h usability... yes 2023-07-12T02:04:00.834 INFO:teuthology.orchestra.run.smithi174.stdout:checking sys/acl.h presence... yes 2023-07-12T02:04:00.834 INFO:teuthology.orchestra.run.smithi174.stdout:checking for sys/acl.h... yes 2023-07-12T02:04:00.893 INFO:teuthology.orchestra.run.smithi174.stdout:checking acl/libacl.h usability... yes 2023-07-12T02:04:00.911 INFO:teuthology.orchestra.run.smithi174.stdout:checking acl/libacl.h presence... yes 2023-07-12T02:04:00.911 INFO:teuthology.orchestra.run.smithi174.stdout:checking for acl/libacl.h... yes 2023-07-12T02:04:00.971 INFO:teuthology.orchestra.run.smithi174.stdout:checking for acl_init in -lacl... yes 2023-07-12T02:04:01.015 INFO:teuthology.orchestra.run.smithi174.stdout:checking gdbm-ndbm.h usability... no 2023-07-12T02:04:01.039 INFO:teuthology.orchestra.run.smithi174.stdout:checking gdbm-ndbm.h presence... no 2023-07-12T02:04:01.040 INFO:teuthology.orchestra.run.smithi174.stdout:checking for gdbm-ndbm.h... no 2023-07-12T02:04:01.082 INFO:teuthology.orchestra.run.smithi174.stdout:checking gdbm/ndbm.h usability... no 2023-07-12T02:04:01.106 INFO:teuthology.orchestra.run.smithi174.stdout:checking gdbm/ndbm.h presence... no 2023-07-12T02:04:01.106 INFO:teuthology.orchestra.run.smithi174.stdout:checking for gdbm/ndbm.h... no 2023-07-12T02:04:01.149 INFO:teuthology.orchestra.run.smithi174.stdout:checking ndbm.h usability... no 2023-07-12T02:04:01.174 INFO:teuthology.orchestra.run.smithi174.stdout:checking ndbm.h presence... no 2023-07-12T02:04:01.174 INFO:teuthology.orchestra.run.smithi174.stdout:checking for ndbm.h... no 2023-07-12T02:04:01.221 INFO:teuthology.orchestra.run.smithi174.stdout:checking libaio.h usability... yes 2023-07-12T02:04:01.242 INFO:teuthology.orchestra.run.smithi174.stdout:checking libaio.h presence... yes 2023-07-12T02:04:01.242 INFO:teuthology.orchestra.run.smithi174.stdout:checking for libaio.h... yes 2023-07-12T02:04:01.287 INFO:teuthology.orchestra.run.smithi174.stdout:checking liburing.h usability... no 2023-07-12T02:04:01.311 INFO:teuthology.orchestra.run.smithi174.stdout:checking liburing.h presence... no 2023-07-12T02:04:01.311 INFO:teuthology.orchestra.run.smithi174.stdout:checking for liburing.h... no 2023-07-12T02:04:01.354 INFO:teuthology.orchestra.run.smithi174.stdout:checking sys/capability.h usability... no 2023-07-12T02:04:01.378 INFO:teuthology.orchestra.run.smithi174.stdout:checking sys/capability.h presence... no 2023-07-12T02:04:01.378 INFO:teuthology.orchestra.run.smithi174.stdout:checking for sys/capability.h... no 2023-07-12T02:04:01.423 INFO:teuthology.orchestra.run.smithi174.stdout:checking linux/fiemap.h usability... yes 2023-07-12T02:04:01.439 INFO:teuthology.orchestra.run.smithi174.stdout:checking linux/fiemap.h presence... yes 2023-07-12T02:04:01.439 INFO:teuthology.orchestra.run.smithi174.stdout:checking for linux/fiemap.h... yes 2023-07-12T02:04:01.500 INFO:teuthology.orchestra.run.smithi174.stdout:checking for fallocate... yes 2023-07-12T02:04:01.560 INFO:teuthology.orchestra.run.smithi174.stdout:checking for open_by_handle_at... yes 2023-07-12T02:04:01.607 INFO:teuthology.orchestra.run.smithi174.stdout:checking sys/prctl.h usability... yes 2023-07-12T02:04:01.624 INFO:teuthology.orchestra.run.smithi174.stdout:checking sys/prctl.h presence... yes 2023-07-12T02:04:01.624 INFO:teuthology.orchestra.run.smithi174.stdout:checking for sys/prctl.h... yes 2023-07-12T02:04:01.671 INFO:teuthology.orchestra.run.smithi174.stdout:checking linux/fs.h usability... yes 2023-07-12T02:04:01.688 INFO:teuthology.orchestra.run.smithi174.stdout:checking linux/fs.h presence... yes 2023-07-12T02:04:01.688 INFO:teuthology.orchestra.run.smithi174.stdout:checking for linux/fs.h... yes 2023-07-12T02:04:01.730 INFO:teuthology.orchestra.run.smithi174.stdout:checking btrfsutil.h usability... no 2023-07-12T02:04:01.754 INFO:teuthology.orchestra.run.smithi174.stdout:checking btrfsutil.h presence... no 2023-07-12T02:04:01.754 INFO:teuthology.orchestra.run.smithi174.stdout:checking for btrfsutil.h... no 2023-07-12T02:04:01.817 INFO:teuthology.orchestra.run.smithi174.stdout:checking for copy_file_range... yes 2023-07-12T02:04:01.881 INFO:teuthology.orchestra.run.smithi174.stdout:checking for SEEK_DATA... yes 2023-07-12T02:04:01.960 INFO:teuthology.orchestra.run.smithi174.stdout:checking for BMV_OF_SHARED... yes 2023-07-12T02:04:02.024 INFO:teuthology.orchestra.run.smithi174.stdout:checking for nftw... yes 2023-07-12T02:04:02.085 INFO:teuthology.orchestra.run.smithi174.stdout:checking for RLIMIT_NOFILE... yes 2023-07-12T02:04:02.123 INFO:teuthology.orchestra.run.smithi174.stdout:checking for FIEXCHANGE_RANGE... no 2023-07-12T02:04:02.183 INFO:teuthology.orchestra.run.smithi174.stdout:checking for renameat2... yes 2023-07-12T02:04:02.245 INFO:teuthology.orchestra.run.smithi174.stdout:checking for reallocarray... yes 2023-07-12T02:04:02.277 INFO:teuthology.orchestra.run.smithi174.stdout:checking for struct mount_attr... no 2023-07-12T02:04:02.349 INFO:teuthology.orchestra.run.smithi174.stdout:checking for struct btrfs_qgroup_limit... yes 2023-07-12T02:04:02.422 INFO:teuthology.orchestra.run.smithi174.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-07-12T02:04:02.495 INFO:teuthology.orchestra.run.smithi174.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-07-12T02:04:02.567 INFO:teuthology.orchestra.run.smithi174.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-07-12T02:04:02.640 INFO:teuthology.orchestra.run.smithi174.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-07-12T02:04:02.714 INFO:teuthology.orchestra.run.smithi174.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-07-12T02:04:02.787 INFO:teuthology.orchestra.run.smithi174.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-07-12T02:04:02.840 INFO:teuthology.orchestra.run.smithi174.stdout:checking linux/btrfs.h usability... yes 2023-07-12T02:04:02.856 INFO:teuthology.orchestra.run.smithi174.stdout:checking linux/btrfs.h presence... yes 2023-07-12T02:04:02.857 INFO:teuthology.orchestra.run.smithi174.stdout:checking for linux/btrfs.h... yes 2023-07-12T02:04:02.917 INFO:teuthology.orchestra.run.smithi174.stdout:checking linux/btrfs_tree.h usability... yes 2023-07-12T02:04:02.934 INFO:teuthology.orchestra.run.smithi174.stdout:checking linux/btrfs_tree.h presence... yes 2023-07-12T02:04:02.934 INFO:teuthology.orchestra.run.smithi174.stdout:checking for linux/btrfs_tree.h... yes 2023-07-12T02:04:03.007 INFO:teuthology.orchestra.run.smithi174.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-07-12T02:04:03.036 INFO:teuthology.orchestra.run.smithi174.stdout:configure: creating ./config.status 2023-07-12T02:04:03.929 INFO:teuthology.orchestra.run.smithi174.stdout:config.status: creating include/builddefs 2023-07-12T02:04:03.958 INFO:teuthology.orchestra.run.smithi174.stdout:config.status: creating include/config.h 2023-07-12T02:04:03.980 INFO:teuthology.orchestra.run.smithi174.stdout:config.status: executing libtool commands 2023-07-12T02:04:04.059 INFO:teuthology.orchestra.run.smithi174.stdout:Building include 2023-07-12T02:04:04.066 INFO:teuthology.orchestra.run.smithi174.stdout:Building lib 2023-07-12T02:04:04.073 INFO:teuthology.orchestra.run.smithi174.stdout: [LTDEP] 2023-07-12T02:04:04.281 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] dataascii.lo 2023-07-12T02:04:04.483 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] databin.lo 2023-07-12T02:04:04.716 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] datapid.lo 2023-07-12T02:04:04.904 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] file_lock.lo 2023-07-12T02:04:05.139 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] forker.lo 2023-07-12T02:04:05.355 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] pattern.lo 2023-07-12T02:04:05.555 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] open_flags.lo 2023-07-12T02:04:05.783 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] random_range.lo 2023-07-12T02:04:06.089 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] string_to_tokens.lo 2023-07-12T02:04:06.275 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] str_to_bytes.lo 2023-07-12T02:04:06.489 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] tlibio.lo 2023-07-12T02:04:06.807 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] write_log.lo 2023-07-12T02:04:07.129 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] random.lo 2023-07-12T02:04:07.330 INFO:teuthology.orchestra.run.smithi174.stdout: [LD] 2023-07-12T02:04:07.465 INFO:teuthology.orchestra.run.smithi174.stdout:Building ltp 2023-07-12T02:04:07.472 INFO:teuthology.orchestra.run.smithi174.stdout: [DEP] 2023-07-12T02:04:07.676 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] doio 2023-07-12T02:04:08.410 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] fsstress 2023-07-12T02:04:09.774 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] fsx 2023-07-12T02:04:10.706 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] growfiles 2023-07-12T02:04:11.299 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] iogen 2023-07-12T02:04:11.747 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] aio-stress 2023-07-12T02:04:12.256 INFO:teuthology.orchestra.run.smithi174.stdout:Building src 2023-07-12T02:04:12.265 INFO:teuthology.orchestra.run.smithi174.stdout: [DEP] 2023-07-12T02:04:14.864 INFO:teuthology.orchestra.run.smithi174.stdout: [DEP] 2023-07-12T02:04:14.914 INFO:teuthology.orchestra.run.smithi174.stdout: [DEP] 2023-07-12T02:04:14.930 INFO:teuthology.orchestra.run.smithi174.stdout: [DEP] 2023-07-12T02:04:15.271 INFO:teuthology.orchestra.run.smithi174.stdout: [DEP] 2023-07-12T02:04:15.311 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] dirstress 2023-07-12T02:04:15.647 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] fill 2023-07-12T02:04:15.897 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] fill2 2023-07-12T02:04:16.226 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] getpagesize 2023-07-12T02:04:16.459 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] holes 2023-07-12T02:04:16.753 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] lstat64 2023-07-12T02:04:17.032 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] nametest 2023-07-12T02:04:17.369 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] permname 2023-07-12T02:04:17.667 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] randholes 2023-07-12T02:04:18.011 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] runas 2023-07-12T02:04:18.288 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] truncfile 2023-07-12T02:04:18.569 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] usemem 2023-07-12T02:04:18.819 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] mmapcat 2023-07-12T02:04:19.066 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] append_reader 2023-07-12T02:04:19.315 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] append_writer 2023-07-12T02:04:19.565 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] dirperf 2023-07-12T02:04:19.885 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] metaperf 2023-07-12T02:04:20.234 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] devzero 2023-07-12T02:04:20.509 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] feature 2023-07-12T02:04:20.576 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:04:20.578 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:04:20.581 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:04:20.826 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] alloc 2023-07-12T02:04:21.137 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] fault 2023-07-12T02:04:21.402 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] fstest 2023-07-12T02:04:21.735 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] t_access_root 2023-07-12T02:04:21.988 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] godown 2023-07-12T02:04:22.257 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] resvtest 2023-07-12T02:04:22.543 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] writemod 2023-07-12T02:04:22.787 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] writev_on_pagefault 2023-07-12T02:04:23.044 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] makeextents 2023-07-12T02:04:23.324 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] itrash 2023-07-12T02:04:23.577 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] rename 2023-07-12T02:04:23.813 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] multi_open_unlink 2023-07-12T02:04:24.078 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] unwritten_sync 2023-07-12T02:04:24.359 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] genhashnames 2023-07-12T02:04:24.642 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] t_holes 2023-07-12T02:04:24.887 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] t_mmap_writev 2023-07-12T02:04:25.134 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] t_truncate_cmtime 2023-07-12T02:04:25.391 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] dirhash_collide 2023-07-12T02:04:25.670 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] t_rename_overwrite 2023-07-12T02:04:25.909 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] holetest 2023-07-12T02:04:26.223 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] t_truncate_self 2023-07-12T02:04:26.461 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] af_unix 2023-07-12T02:04:26.713 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] t_mmap_stale_pmd 2023-07-12T02:04:26.965 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] t_mmap_cow_race 2023-07-12T02:04:27.229 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] t_mmap_fallocate 2023-07-12T02:04:27.477 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] fsync-err 2023-07-12T02:04:27.758 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] t_mmap_write_ro 2023-07-12T02:04:28.009 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] t_ext4_dax_journal_corruption 2023-07-12T02:04:28.265 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] t_ext4_dax_inline_corruption 2023-07-12T02:04:28.520 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] t_ofd_locks 2023-07-12T02:04:28.818 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] t_mmap_collision 2023-07-12T02:04:29.112 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] mmap-write-concurrent 2023-07-12T02:04:29.380 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] t_get_file_time 2023-07-12T02:04:29.626 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] t_create_short_dirs 2023-07-12T02:04:29.891 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] t_create_long_dirs 2023-07-12T02:04:30.154 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] t_enospc 2023-07-12T02:04:30.439 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] t_mmap_writev_overlap 2023-07-12T02:04:30.705 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] checkpoint_journal 2023-07-12T02:04:30.958 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] mmap-rw-fault 2023-07-12T02:04:31.242 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] allocstale 2023-07-12T02:04:31.511 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] t_mmap_cow_memory_failure 2023-07-12T02:04:31.781 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] fake-dump-rootino 2023-07-12T02:04:32.030 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] dio-buf-fault 2023-07-12T02:04:32.281 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfsctl 2023-07-12T02:04:32.569 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] bstat 2023-07-12T02:04:32.872 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] t_mtab 2023-07-12T02:04:33.152 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] getdevicesize 2023-07-12T02:04:33.392 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] preallo_rw_pattern_reader 2023-07-12T02:04:33.653 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] preallo_rw_pattern_writer 2023-07-12T02:04:33.913 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] ftrunc 2023-07-12T02:04:34.160 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] trunc 2023-07-12T02:04:34.420 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] fs_perms 2023-07-12T02:04:34.684 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] testx 2023-07-12T02:04:34.914 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] looptest 2023-07-12T02:04:35.204 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] locktest 2023-07-12T02:04:35.603 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] unwritten_mmap 2023-07-12T02:04:35.867 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] bulkstat_unlink_test 2023-07-12T02:04:36.167 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] deduperace 2023-07-12T02:04:36.464 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] bulkstat_unlink_test_modified 2023-07-12T02:04:36.761 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] t_dir_offset 2023-07-12T02:04:37.009 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] t_futimens 2023-07-12T02:04:37.248 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] t_immutable 2023-07-12T02:04:37.932 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] stale_handle 2023-07-12T02:04:38.204 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] pwrite_mmap_blocked 2023-07-12T02:04:38.456 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] t_dir_offset2 2023-07-12T02:04:38.746 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] seek_sanity_test 2023-07-12T02:04:39.249 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] seek_copy_test 2023-07-12T02:04:39.526 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] t_readdir_1 2023-07-12T02:04:39.773 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] t_readdir_2 2023-07-12T02:04:40.023 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] fsync-tester 2023-07-12T02:04:40.367 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] nsexec 2023-07-12T02:04:40.642 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] cloner 2023-07-12T02:04:40.918 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] renameat2 2023-07-12T02:04:41.187 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] t_getcwd 2023-07-12T02:04:41.443 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] e4compact 2023-07-12T02:04:41.743 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] test-nextquota 2023-07-12T02:04:42.014 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] punch-alternating 2023-07-12T02:04:42.286 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] attr-list-by-handle-cursor-test 2023-07-12T02:04:42.555 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] listxattr 2023-07-12T02:04:42.801 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] dio-interleaved 2023-07-12T02:04:43.060 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] t_dir_type 2023-07-12T02:04:43.314 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] dio-invalidate-cache 2023-07-12T02:04:43.616 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] stat_test 2023-07-12T02:04:44.009 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] t_encrypted_d_revalidate 2023-07-12T02:04:44.276 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] attr_replace_test 2023-07-12T02:04:44.538 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] swapon 2023-07-12T02:04:44.802 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] mkswap 2023-07-12T02:04:45.054 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] t_attr_corruption 2023-07-12T02:04:45.304 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] t_open_tmpfiles 2023-07-12T02:04:45.585 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] fscrypt-crypt-util 2023-07-12T02:04:46.298 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] bulkstat_null_ocount 2023-07-12T02:04:46.559 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] splice-test 2023-07-12T02:04:46.839 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] chprojid_fail 2023-07-12T02:04:47.103 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] detached_mounts_propagation 2023-07-12T02:04:47.389 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] ext4_resize 2023-07-12T02:04:47.637 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] t_readdir_3 2023-07-12T02:04:47.929 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] splice2pipe 2023-07-12T02:04:48.192 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] uuid_ioctl 2023-07-12T02:04:48.446 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] fiemap-tester 2023-07-12T02:04:48.813 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] t_stripealign 2023-07-12T02:04:49.066 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] open_by_handle 2023-07-12T02:04:49.419 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] t_mmap_dio 2023-07-12T02:04:49.680 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfsfind 2023-07-12T02:04:49.974 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] fssum 2023-07-12T02:04:50.497 INFO:teuthology.orchestra.run.smithi174.stdout:Building log-writes 2023-07-12T02:04:50.507 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] replay-log 2023-07-12T02:04:50.690 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:04:50.693 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:04:50.695 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:04:50.924 INFO:teuthology.orchestra.run.smithi174.stdout:Building perf 2023-07-12T02:04:50.931 INFO:teuthology.orchestra.run.smithi174.stdout:Building aio-dio-regress 2023-07-12T02:04:50.942 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] aio-dio-append-write-fallocate-race 2023-07-12T02:04:51.220 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] aio-dio-fcntl-race 2023-07-12T02:04:51.487 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] aio-dio-subblock-eof-read 2023-07-12T02:04:51.735 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] aio-dio-append-write-read-race 2023-07-12T02:04:52.013 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] aio-dio-invalidate-readahead 2023-07-12T02:04:52.281 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] aio-dio-hole-filling-race 2023-07-12T02:04:52.534 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-07-12T02:04:52.772 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] aio-last-ref-held-by-io 2023-07-12T02:04:53.049 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] aio-dio-cycle-write 2023-07-12T02:04:53.337 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] aio-dio-extend-stat 2023-07-12T02:04:53.606 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-07-12T02:04:53.843 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] aio-dio-invalidate-failure 2023-07-12T02:04:54.106 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] aiodio_sparse2 2023-07-12T02:04:54.422 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] aiocp 2023-07-12T02:04:54.744 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] aio-dio-cow-race 2023-07-12T02:04:55.002 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] aio-dio-write-verify 2023-07-12T02:04:55.294 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] aio-dio-eof-race 2023-07-12T02:04:55.579 INFO:teuthology.orchestra.run.smithi174.stdout:Building vfs 2023-07-12T02:04:55.589 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] vfstest 2023-07-12T02:04:57.569 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] mount-idmapped 2023-07-12T02:04:58.042 INFO:teuthology.orchestra.run.smithi174.stdout:Building m4 2023-07-12T02:04:58.049 INFO:teuthology.orchestra.run.smithi174.stdout:Building common 2023-07-12T02:04:58.057 INFO:teuthology.orchestra.run.smithi174.stdout:Building tests 2023-07-12T02:04:58.067 INFO:teuthology.orchestra.run.smithi174.stdout:Building perf 2023-07-12T02:04:58.076 INFO:teuthology.orchestra.run.smithi174.stdout: [GROUP] /tmp/tmp.CBamI6wQNAxfstests-dev/tests/perf/group.list 2023-07-12T02:04:58.105 INFO:teuthology.orchestra.run.smithi174.stdout:Building ext4 2023-07-12T02:04:58.115 INFO:teuthology.orchestra.run.smithi174.stdout: [GROUP] /tmp/tmp.CBamI6wQNAxfstests-dev/tests/ext4/group.list 2023-07-12T02:04:58.209 INFO:teuthology.orchestra.run.smithi174.stdout:Building ocfs2 2023-07-12T02:04:58.219 INFO:teuthology.orchestra.run.smithi174.stdout: [GROUP] /tmp/tmp.CBamI6wQNAxfstests-dev/tests/ocfs2/group.list 2023-07-12T02:04:58.253 INFO:teuthology.orchestra.run.smithi174.stdout:Building overlay 2023-07-12T02:04:58.263 INFO:teuthology.orchestra.run.smithi174.stdout: [GROUP] /tmp/tmp.CBamI6wQNAxfstests-dev/tests/overlay/group.list 2023-07-12T02:04:58.357 INFO:teuthology.orchestra.run.smithi174.stdout:Building cifs 2023-07-12T02:04:58.367 INFO:teuthology.orchestra.run.smithi174.stdout: [GROUP] /tmp/tmp.CBamI6wQNAxfstests-dev/tests/cifs/group.list 2023-07-12T02:04:58.398 INFO:teuthology.orchestra.run.smithi174.stdout:Building generic 2023-07-12T02:04:58.410 INFO:teuthology.orchestra.run.smithi174.stdout: [GROUP] /tmp/tmp.CBamI6wQNAxfstests-dev/tests/generic/group.list 2023-07-12T02:04:58.652 INFO:teuthology.orchestra.run.smithi174.stdout:Building shared 2023-07-12T02:04:58.662 INFO:teuthology.orchestra.run.smithi174.stdout: [GROUP] /tmp/tmp.CBamI6wQNAxfstests-dev/tests/shared/group.list 2023-07-12T02:04:58.705 INFO:teuthology.orchestra.run.smithi174.stdout:Building nfs 2023-07-12T02:04:58.715 INFO:teuthology.orchestra.run.smithi174.stdout: [GROUP] /tmp/tmp.CBamI6wQNAxfstests-dev/tests/nfs/group.list 2023-07-12T02:04:58.751 INFO:teuthology.orchestra.run.smithi174.stdout:Building f2fs 2023-07-12T02:04:58.761 INFO:teuthology.orchestra.run.smithi174.stdout: [GROUP] /tmp/tmp.CBamI6wQNAxfstests-dev/tests/f2fs/group.list 2023-07-12T02:04:58.804 INFO:teuthology.orchestra.run.smithi174.stdout:Building udf 2023-07-12T02:04:58.814 INFO:teuthology.orchestra.run.smithi174.stdout: [GROUP] /tmp/tmp.CBamI6wQNAxfstests-dev/tests/udf/group.list 2023-07-12T02:04:58.843 INFO:teuthology.orchestra.run.smithi174.stdout:Building ceph 2023-07-12T02:04:58.853 INFO:teuthology.orchestra.run.smithi174.stdout: [GROUP] /tmp/tmp.CBamI6wQNAxfstests-dev/tests/ceph/group.list 2023-07-12T02:04:58.889 INFO:teuthology.orchestra.run.smithi174.stdout:Building xfs 2023-07-12T02:04:58.901 INFO:teuthology.orchestra.run.smithi174.stdout: [GROUP] /tmp/tmp.CBamI6wQNAxfstests-dev/tests/xfs/group.list 2023-07-12T02:04:59.148 INFO:teuthology.orchestra.run.smithi174.stdout:Building btrfs 2023-07-12T02:04:59.158 INFO:teuthology.orchestra.run.smithi174.stdout: [GROUP] /tmp/tmp.CBamI6wQNAxfstests-dev/tests/btrfs/group.list 2023-07-12T02:04:59.306 INFO:teuthology.orchestra.run.smithi174.stdout:Building tmpfs 2023-07-12T02:04:59.316 INFO:teuthology.orchestra.run.smithi174.stdout: [GROUP] /tmp/tmp.CBamI6wQNAxfstests-dev/tests/tmpfs/group.list 2023-07-12T02:04:59.350 INFO:teuthology.orchestra.run.smithi174.stdout:Building selftest 2023-07-12T02:04:59.359 INFO:teuthology.orchestra.run.smithi174.stdout: [GROUP] /tmp/tmp.CBamI6wQNAxfstests-dev/tests/selftest/group.list 2023-07-12T02:04:59.394 DEBUG:teuthology.orchestra.run.smithi174:> (cd /tmp/tmp.CBamI6wQNAxfstests-dev && exec sudo make install) 2023-07-12T02:04:59.484 INFO:teuthology.orchestra.run.smithi174.stdout:Building include 2023-07-12T02:04:59.491 INFO:teuthology.orchestra.run.smithi174.stdout:Building lib 2023-07-12T02:04:59.499 INFO:teuthology.orchestra.run.smithi174.stdout:Building ltp 2023-07-12T02:04:59.507 INFO:teuthology.orchestra.run.smithi174.stdout:Building src 2023-07-12T02:04:59.568 INFO:teuthology.orchestra.run.smithi174.stdout:Building log-writes 2023-07-12T02:04:59.575 INFO:teuthology.orchestra.run.smithi174.stdout:Building perf 2023-07-12T02:04:59.582 INFO:teuthology.orchestra.run.smithi174.stdout:Building aio-dio-regress 2023-07-12T02:04:59.590 INFO:teuthology.orchestra.run.smithi174.stdout:Building vfs 2023-07-12T02:04:59.598 INFO:teuthology.orchestra.run.smithi174.stdout:Building m4 2023-07-12T02:04:59.605 INFO:teuthology.orchestra.run.smithi174.stdout:Building common 2023-07-12T02:04:59.612 INFO:teuthology.orchestra.run.smithi174.stdout:Building tests 2023-07-12T02:04:59.623 INFO:teuthology.orchestra.run.smithi174.stdout:Building perf 2023-07-12T02:04:59.632 INFO:teuthology.orchestra.run.smithi174.stdout: [GROUP] /tmp/tmp.CBamI6wQNAxfstests-dev/tests/perf/group.list 2023-07-12T02:04:59.662 INFO:teuthology.orchestra.run.smithi174.stdout:Building ext4 2023-07-12T02:04:59.671 INFO:teuthology.orchestra.run.smithi174.stdout: [GROUP] /tmp/tmp.CBamI6wQNAxfstests-dev/tests/ext4/group.list 2023-07-12T02:04:59.764 INFO:teuthology.orchestra.run.smithi174.stdout:Building ocfs2 2023-07-12T02:04:59.774 INFO:teuthology.orchestra.run.smithi174.stdout: [GROUP] /tmp/tmp.CBamI6wQNAxfstests-dev/tests/ocfs2/group.list 2023-07-12T02:04:59.808 INFO:teuthology.orchestra.run.smithi174.stdout:Building overlay 2023-07-12T02:04:59.818 INFO:teuthology.orchestra.run.smithi174.stdout: [GROUP] /tmp/tmp.CBamI6wQNAxfstests-dev/tests/overlay/group.list 2023-07-12T02:04:59.913 INFO:teuthology.orchestra.run.smithi174.stdout:Building cifs 2023-07-12T02:04:59.923 INFO:teuthology.orchestra.run.smithi174.stdout: [GROUP] /tmp/tmp.CBamI6wQNAxfstests-dev/tests/cifs/group.list 2023-07-12T02:04:59.955 INFO:teuthology.orchestra.run.smithi174.stdout:Building generic 2023-07-12T02:04:59.967 INFO:teuthology.orchestra.run.smithi174.stdout: [GROUP] /tmp/tmp.CBamI6wQNAxfstests-dev/tests/generic/group.list 2023-07-12T02:05:00.204 INFO:teuthology.orchestra.run.smithi174.stdout:Building shared 2023-07-12T02:05:00.214 INFO:teuthology.orchestra.run.smithi174.stdout: [GROUP] /tmp/tmp.CBamI6wQNAxfstests-dev/tests/shared/group.list 2023-07-12T02:05:00.257 INFO:teuthology.orchestra.run.smithi174.stdout:Building nfs 2023-07-12T02:05:00.267 INFO:teuthology.orchestra.run.smithi174.stdout: [GROUP] /tmp/tmp.CBamI6wQNAxfstests-dev/tests/nfs/group.list 2023-07-12T02:05:00.303 INFO:teuthology.orchestra.run.smithi174.stdout:Building f2fs 2023-07-12T02:05:00.313 INFO:teuthology.orchestra.run.smithi174.stdout: [GROUP] /tmp/tmp.CBamI6wQNAxfstests-dev/tests/f2fs/group.list 2023-07-12T02:05:00.356 INFO:teuthology.orchestra.run.smithi174.stdout:Building udf 2023-07-12T02:05:00.366 INFO:teuthology.orchestra.run.smithi174.stdout: [GROUP] /tmp/tmp.CBamI6wQNAxfstests-dev/tests/udf/group.list 2023-07-12T02:05:00.395 INFO:teuthology.orchestra.run.smithi174.stdout:Building ceph 2023-07-12T02:05:00.405 INFO:teuthology.orchestra.run.smithi174.stdout: [GROUP] /tmp/tmp.CBamI6wQNAxfstests-dev/tests/ceph/group.list 2023-07-12T02:05:00.441 INFO:teuthology.orchestra.run.smithi174.stdout:Building xfs 2023-07-12T02:05:00.453 INFO:teuthology.orchestra.run.smithi174.stdout: [GROUP] /tmp/tmp.CBamI6wQNAxfstests-dev/tests/xfs/group.list 2023-07-12T02:05:00.694 INFO:teuthology.orchestra.run.smithi174.stdout:Building btrfs 2023-07-12T02:05:00.705 INFO:teuthology.orchestra.run.smithi174.stdout: [GROUP] /tmp/tmp.CBamI6wQNAxfstests-dev/tests/btrfs/group.list 2023-07-12T02:05:00.853 INFO:teuthology.orchestra.run.smithi174.stdout:Building tmpfs 2023-07-12T02:05:00.863 INFO:teuthology.orchestra.run.smithi174.stdout: [GROUP] /tmp/tmp.CBamI6wQNAxfstests-dev/tests/tmpfs/group.list 2023-07-12T02:05:00.897 INFO:teuthology.orchestra.run.smithi174.stdout:Building selftest 2023-07-12T02:05:00.906 INFO:teuthology.orchestra.run.smithi174.stdout: [GROUP] /tmp/tmp.CBamI6wQNAxfstests-dev/tests/selftest/group.list 2023-07-12T02:05:00.937 INFO:teuthology.orchestra.run.smithi174.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-07-12T02:05:00.939 INFO:teuthology.orchestra.run.smithi174.stdout:gmake[1]: Nothing to be done for 'install'. 2023-07-12T02:05:00.940 INFO:teuthology.orchestra.run.smithi174.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-07-12T02:05:00.943 INFO:teuthology.orchestra.run.smithi174.stdout:gmake[1]: Nothing to be done for 'install'. 2023-07-12T02:05:00.943 INFO:teuthology.orchestra.run.smithi174.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-07-12T02:05:00.947 INFO:teuthology.orchestra.run.smithi174.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-07-12T02:05:00.970 INFO:teuthology.orchestra.run.smithi174.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-07-12T02:05:01.143 INFO:teuthology.orchestra.run.smithi174.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-07-12T02:05:01.166 INFO:teuthology.orchestra.run.smithi174.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-07-12T02:05:01.196 INFO:teuthology.orchestra.run.smithi174.stdout:Building log-writes 2023-07-12T02:05:01.203 INFO:teuthology.orchestra.run.smithi174.stdout:Building perf 2023-07-12T02:05:01.210 INFO:teuthology.orchestra.run.smithi174.stdout:Building aio-dio-regress 2023-07-12T02:05:01.218 INFO:teuthology.orchestra.run.smithi174.stdout:Building vfs 2023-07-12T02:05:01.224 INFO:teuthology.orchestra.run.smithi174.stdout:/usr/bin/gmake -C log-writes install 2023-07-12T02:05:01.226 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-07-12T02:05:01.249 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-07-12T02:05:01.273 INFO:teuthology.orchestra.run.smithi174.stdout:/usr/bin/gmake -C perf install 2023-07-12T02:05:01.276 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-07-12T02:05:01.298 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-07-12T02:05:01.358 INFO:teuthology.orchestra.run.smithi174.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-07-12T02:05:01.361 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-07-12T02:05:01.384 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 755 aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-hole-filling-race aio-dio-append-write-fallocate-race aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aio-dio-invalidate-failure aiodio_sparse2 aiocp aio-dio-cow-race aio-dio-write-verify aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2023-07-12T02:05:01.525 INFO:teuthology.orchestra.run.smithi174.stdout:/usr/bin/gmake -C vfs install 2023-07-12T02:05:01.528 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-07-12T02:05:01.551 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-07-12T02:05:01.583 INFO:teuthology.orchestra.run.smithi174.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-07-12T02:05:01.605 INFO:teuthology.orchestra.run.smithi174.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-07-12T02:05:04.571 INFO:teuthology.orchestra.run.smithi174.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py /var/lib/xfstests/src 2023-07-12T02:05:04.789 INFO:teuthology.orchestra.run.smithi174.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-07-12T02:05:04.844 INFO:teuthology.orchestra.run.smithi174.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-07-12T02:05:04.846 INFO:teuthology.orchestra.run.smithi174.stdout:gmake[1]: Nothing to be done for 'install'. 2023-07-12T02:05:04.847 INFO:teuthology.orchestra.run.smithi174.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-07-12T02:05:04.849 INFO:teuthology.orchestra.run.smithi174.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-07-12T02:05:04.872 INFO:teuthology.orchestra.run.smithi174.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-07-12T02:05:05.224 INFO:teuthology.orchestra.run.smithi174.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-07-12T02:05:05.227 INFO:teuthology.orchestra.run.smithi174.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.CBamI6wQNAxfstests-dev/tests/btrfs/ install 2023-07-12T02:05:05.231 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-07-12T02:05:05.254 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 299 /var/lib/xfstests/tests/btrfs 2023-07-12T02:05:07.401 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-07-12T02:05:07.424 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 036.out 275.out 016.out 175.out 240.out 180.out 069.out 282.out 015.out 280.out 140.out 056.out 008.out 004.out 199.out 233.out 194.out 234.out 248.out 109.out 033.out 252.out 270.out 040.out 176.out 202.out 137.out 125.out 078.out 152.out 003.out 264.out 243.out 192.out 148.out 075.out 178.out 284.out 052.out 256.out 207.out 228.out 128.out 028.out 183.out 225.out 094.out 046.out 273.out 090.out 251.out 089.out 206.out 215.out 115.out 197.out 250.out 266.out 051.out 246.out 219.out 119.out 244.out 232.out 121.out 112.out 012.out 195.out 107.out 162.out 083.out 147.out 288.out 242.out 187.out 024.out 220.out 153.out 020.out 102.out 002.out 171.out 261.out 135.out 156.out 092.out 255.out 072.out 068.out 143.out 048.out 062.out 084.out 129.out 029.out 229.out 103.out 254.out 111.out 011.out 155.out 134.out 170.out 260.out 034.out 161.out 043.out 247.out 216.out 116.out 157.out 274.out 110.out 101.out 238.out 276.out 114.out 138.out 095.out 038.out 145.out 160.out 091.out 081.out 071.out 061.out 085.out 265.out 200.out 100.out 025.out 258.out 286.out 269.out 039.out 196.out 098.out 080.out 070.out 060.out 208.out 106.out 009.out 167.out 217.out 120.out 191.out 117.out 017.out 211.out 158.out 182.out 066.out 146.out 212.out 188.out 065.out 204.out 104.out 041.out 177.out 279.out 241.out 235.out 253.out 257.out 124.out 035.out 172.out 278.out 058.out 262.out 169.out 042.out 193.out 097.out 271.out 283.out 236.out 186.out 053.out 133.out 164.out 154.out 239.out 189.out 037.out 139.out 267.out 141.out 214.out 014.out 223.out 086.out 132.out 179.out 144.out 032.out 277.out 205.out 136.out 005.out 096.out 198.out 108.out 190.out 173.out 050.out 105.out 291.out 185.out 067.out 088.out 285.out 209.out 123.out 044.out 201.out 019.out 001.out 287.out 142.out 237.out 151.out 231.out 163.out 131.out 213.out 113.out 013.out 031.out 027.out 057.out 272.out 268.out 184.out 259.out 210.out 227.out 010.out 263.out 127.out 230.out 166.out 130.out 023.out 073.out 099.out 082.out 030.out 203.out 063.out 055.out 076.out 245.out 122.out 074.out 222.out 159.out 249.out 022.out 289.out 174.out 006.out 045.out 281.out 290.out 299.out 224.out 181.out 149.out 064.out 218.out 118.out 018.out 047.out 168.out 007.out 093.out 079.out 054.out 059.out 150.out 049.out 226.out 126.out 165.out 026.out 021.out 077.out 221.out 087.out /var/lib/xfstests/tests/btrfs 2023-07-12T02:05:09.558 INFO:teuthology.orchestra.run.smithi174.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.CBamI6wQNAxfstests-dev/tests/ceph/ install 2023-07-12T02:05:09.560 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-07-12T02:05:09.583 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-07-12T02:05:09.635 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-07-12T02:05:09.659 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-07-12T02:05:09.711 INFO:teuthology.orchestra.run.smithi174.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.CBamI6wQNAxfstests-dev/tests/cifs/ install 2023-07-12T02:05:09.713 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-07-12T02:05:09.736 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-07-12T02:05:09.759 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-07-12T02:05:09.782 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-07-12T02:05:09.806 INFO:teuthology.orchestra.run.smithi174.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.CBamI6wQNAxfstests-dev/tests/ext4/ install 2023-07-12T02:05:09.809 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-07-12T02:05:09.832 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-07-12T02:05:10.339 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-07-12T02:05:10.362 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 032.out 039.out 005.out 026.out 308.out 008.out 040.out 304.out 007.out 021.out 016.out 037.out 044.out 012.out 009.out 033.out 057.out 050.out 301.out 019.out 034.out 046.out 058.out 047.out 302.out 020.out 002.out 024.out 013.out 031.out 025.out 306.out 017.out 004.out 048.out 038.out 056.out 042.out 052.out 307.out 029.out 011.out 027.out 303.out 003.out 045.out 055.out 053.out 035.out 043.out 059.out 010.out 023.out 022.out 014.out 006.out 015.out 305.out 036.out 271.out 051.out 041.out 030.out 018.out 028.out 054.out 049.out /var/lib/xfstests/tests/ext4 2023-07-12T02:05:10.892 INFO:teuthology.orchestra.run.smithi174.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.CBamI6wQNAxfstests-dev/tests/f2fs/ install 2023-07-12T02:05:10.894 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-07-12T02:05:10.917 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-07-12T02:05:10.947 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-07-12T02:05:10.969 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-07-12T02:05:11.000 INFO:teuthology.orchestra.run.smithi174.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.CBamI6wQNAxfstests-dev/tests/generic/ install 2023-07-12T02:05:11.006 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-07-12T02:05:11.029 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 /var/lib/xfstests/tests/generic 2023-07-12T02:05:16.325 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-07-12T02:05:16.348 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 035.out.nfs 050.out.xfsquota 035.out.default 050.out.nojournal 050.out.default 050.cfg 035.cfg 537.out 194.out 133.out 683.out 033.out 489.out 696.out 237.out 502.out 310.out 202.out 137.out 586.out 181.out 664.out 571.out 126.out 243.out 592.out 282.out 272.out 728.out 178.out 628.out 528.out 607.out 428.out 507.out 407.out 328.out 171.out 028.out 620.out 273.out 570.out 468.out 182.out 265.out 420.out 492.out 120.out 059.out 595.out 346.out 466.out 443.out 700.out 632.out 652.out 311.out 655.out 591.out 064.out 471.out 432.out 255.out 623.out 371.out 319.out 177.out 523.out 119.out 423.out 232.out 673.out 260.out 312.out 718.out 034.out 465.out 716.out 616.out 246.out 416.out 247.out 216.out 116.out 041.out 358.out 338.out 287.out 238.out 295.out 390.out 497.out 160.out 691.out 274.out 061.out 239.out 457.out 025.out 530.out 258.out 362.out 039.out 098.out 690.out 573.out 706.out 606.out 506.out 406.out 306.out 106.out 642.out 217.out 446.out 017.out 211.out 130.out 158.out 370.out 442.out 188.out 640.out 199.out 467.out 281.out 174.out 163.out 324.out 224.out 355.out 124.out 672.out 278.out 058.out 384.out 296.out 042.out 193.out 097.out 271.out 283.out 541.out 709.out 609.out 045.out 509.out 309.out 391.out 441.out 009.out 356.out 341.out 494.out 189.out 037.out 555.out 712.out 241.out 501.out 612.out 540.out 365.out 412.out 614.out 514.out 414.out 314.out 440.out 114.out 316.out 014.out 026.out 012.out 634.out 340.out 156.out 572.out 240.out 180.out 549.out 473.out 633.out 321.out 140.out 348.out 568.out 185.out 408.out 308.out 566.out 433.out 704.out 108.out 504.out 404.out 304.out 104.out 175.out 297.out 393.out 333.out 599.out 476.out 099.out 233.out 639.out 107.out 086.out 053.out 500.out 164.out 339.out 294.out 352.out 498.out 139.out 267.out 317.out 399.out 220.out 552.out 695.out 480.out 436.out 544.out 169.out 593.out 067.out 186.out 187.out 679.out 252.out 585.out 003.out 376.out 724.out 206.out 663.out 651.out 248.out 625.out 525.out 670.out 488.out 040.out 325.out 551.out 225.out 636.out 125.out 142.out 715.out 279.out 222.out 515.out 650.out 152.out 658.out 563.out 215.out 451.out 015.out 392.out 682.out 472.out 684.out 674.out 550.out 052.out 351.out 430.out 276.out 094.out 266.out 450.out 463.out 157.out 600.out 349.out 444.out 644.out 487.out 688.out 643.out 615.out 395.out 151.out 415.out 315.out 344.out 115.out 539.out 179.out 542.out 250.out 705.out 475.out 536.out 228.out 518.out 101.out 030.out 244.out 128.out 385.out 005.out 336.out 579.out 236.out 405.out 667.out 205.out 136.out 598.out 036.out 198.out 723.out 008.out 680.out 605.out 505.out 305.out 105.out 263.out 144.out 291.out 437.out 044.out 719.out 619.out 721.out 323.out 685.out 088.out 382.out 337.out 219.out 527.out 019.out 577.out 481.out 574.out 556.out 332.out 060.out 521.out 027.out 191.out 582.out 372.out 478.out 584.out 462.out 597.out 350.out 132.out 693.out 638.out 448.out 660.out 063.out 561.out 214.out 074.out 648.out 387.out 594.out 335.out 438.out 076.out 289.out 699.out 545.out 516.out 477.out 621.out 519.out 290.out 548.out 560.out 166.out 707.out 461.out 381.out 445.out 647.out 626.out 380.out 562.out 526.out 479.out 426.out 192.out 150.out 613.out 326.out 082.out 226.out 668.out 454.out 121.out 447.out 499.out 580.out 460.out 485.out 694.out 347.out 077.out 361.out 564.out 455.out 089.out 558.out 162.out 686.out 147.out 173.out 197.out 396.out 051.out 354.out 298.out 024.out 148.out 360.out 543.out 270.out 261.out 251.out 657.out 692.out 482.out 046.out 726.out 729.out 378.out 004.out 458.out 062.out 529.out 231.out 343.out 662.out 503.out 329.out 334.out 590.out 254.out 363.out 131.out 155.out 661.out 547.out 368.out 486.out 223.out 123.out 669.out 023.out 459.out 032.out 277.out 398.out 366.out 161.out 190.out 280.out 470.out 484.out 257.out 006.out 016.out 091.out 201.out 656.out 227.out 676.out 374.out 583.out 285.out 127.out 256.out 654.out 389.out 649.out 301.out 431.out 635.out 288.out 722.out 331.out 377.out 713.out 535.out 513.out 554.out 622.out 313.out 213.out 113.out 013.out 031.out 435.out 630.out 645.out 057.out 727.out 078.out 510.out 627.out 184.out 534.out 427.out 210.out 449.out 327.out 330.out 493.out 604.out 419.out 230.out 071.out 083.out 292.out 299.out 434.out 575.out 073.out 603.out 135.out 403.out 303.out 203.out 103.out 345.out 165.out 386.out 055.out 532.out 245.out 522.out 422.out 624.out 322.out 394.out 159.out 524.out 122.out 689.out 234.out 022.out 424.out 637.out 578.out 490.out 439.out 517.out 154.out 149.out 618.out 675.out 418.out 318.out 264.out 218.out 118.out 018.out 047.out 172.out 168.out 293.out 079.out 469.out 054.out 049.out 208.out 379.out 569.out 456.out 268.out 421.out 533.out 512.out 221.out 087.out 212.out 538.out 112.out 342.out 021.out 195.out 388.out 483.out 397.out 070.out 596.out 720.out 565.out 196.out 520.out 242.out 576.out 587.out 320.out 629.out 702.out 602.out 153.out 402.out 302.out 020.out 102.out 002.out 717.out 617.out 129.out 429.out 417.out 138.out 167.out 092.out 117.out 357.out 072.out 068.out 143.out 229.out 038.out 084.out 369.out 711.out 262.out 611.out 511.out 411.out 029.out 111.out 011.out 659.out 183.out 170.out 065.out 286.out 043.out 056.out 714.out 559.out 710.out 610.out 687.out 413.out 410.out 701.out 601.out 401.out 110.out 010.out 001.out 141.out 495.out 048.out 665.out 589.out 095.out 581.out 697.out 145.out 641.out 464.out 491.out 081.out 075.out 653.out 671.out 400.out 300.out 200.out 100.out 359.out 367.out 269.out 546.out 677.out 698.out 553.out 375.out 259.out 090.out 080.out 708.out 608.out 508.out 409.out 307.out 209.out 109.out 007.out 567.out 284.out 557.out 453.out 666.out 364.out 725.out 383.out 085.out 066.out 588.out 146.out 631.out 204.out 353.out 425.out 069.out 093.out 681.out 249.out 207.out 531.out 235.out 646.out 474.out 703.out 253.out 275.out 678.out 496.out 373.out 176.out 134.out 452.out 096.out /var/lib/xfstests/tests/generic 2023-07-12T02:05:20.808 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:05:20.811 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:05:20.814 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:05:21.698 INFO:teuthology.orchestra.run.smithi174.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.CBamI6wQNAxfstests-dev/tests/nfs/ install 2023-07-12T02:05:21.701 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-07-12T02:05:21.724 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-07-12T02:05:21.747 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-07-12T02:05:21.770 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-07-12T02:05:21.793 INFO:teuthology.orchestra.run.smithi174.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.CBamI6wQNAxfstests-dev/tests/ocfs2/ install 2023-07-12T02:05:21.796 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-07-12T02:05:21.819 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-07-12T02:05:21.842 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-07-12T02:05:21.865 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-07-12T02:05:21.888 INFO:teuthology.orchestra.run.smithi174.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.CBamI6wQNAxfstests-dev/tests/overlay/ install 2023-07-12T02:05:21.891 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-07-12T02:05:21.914 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-07-12T02:05:22.625 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-07-12T02:05:22.648 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 110.out 067.out 018.out 024.out 010.out 065.out 020.out 102.out 002.out 113.out 013.out 031.out 045.out 117.out 046.out 075.out 072.out 068.out 063.out 014.out 062.out 038.out 042.out 052.out 029.out 027.out 043.out 112.out 023.out 073.out 078.out 030.out 058.out 003.out 004.out 055.out 053.out 109.out 035.out 116.out 016.out 059.out 101.out 001.out 009.out 047.out 076.out 022.out 074.out 006.out 044.out 115.out 015.out 064.out 114.out 026.out 071.out 111.out 061.out 011.out 041.out 048.out 100.out 019.out 107.out 007.out 028.out 069.out 054.out 049.out 032.out 039.out 077.out 105.out 025.out 056.out 057.out 108.out 070.out 060.out 008.out 040.out 106.out 005.out 021.out 017.out 012.out 037.out 103.out 033.out 066.out 050.out 036.out 051.out 034.out 104.out /var/lib/xfstests/tests/overlay 2023-07-12T02:05:23.362 INFO:teuthology.orchestra.run.smithi174.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.CBamI6wQNAxfstests-dev/tests/perf/ install 2023-07-12T02:05:23.365 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-07-12T02:05:23.388 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-07-12T02:05:23.411 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-07-12T02:05:23.434 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-07-12T02:05:23.457 INFO:teuthology.orchestra.run.smithi174.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.CBamI6wQNAxfstests-dev/tests/selftest/ install 2023-07-12T02:05:23.460 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-07-12T02:05:23.483 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-07-12T02:05:23.541 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-07-12T02:05:23.565 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 006.out 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-07-12T02:05:23.624 INFO:teuthology.orchestra.run.smithi174.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.CBamI6wQNAxfstests-dev/tests/shared/ install 2023-07-12T02:05:23.627 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-07-12T02:05:23.650 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-07-12T02:05:23.687 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-07-12T02:05:23.710 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-07-12T02:05:23.748 INFO:teuthology.orchestra.run.smithi174.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.CBamI6wQNAxfstests-dev/tests/tmpfs/ install 2023-07-12T02:05:23.751 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-07-12T02:05:23.774 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-07-12T02:05:23.797 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-07-12T02:05:23.820 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-07-12T02:05:23.843 INFO:teuthology.orchestra.run.smithi174.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.CBamI6wQNAxfstests-dev/tests/udf/ install 2023-07-12T02:05:23.846 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-07-12T02:05:23.869 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-07-12T02:05:23.892 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-07-12T02:05:23.914 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-07-12T02:05:23.938 INFO:teuthology.orchestra.run.smithi174.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.CBamI6wQNAxfstests-dev/tests/xfs/ install 2023-07-12T02:05:23.943 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-07-12T02:05:23.966 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-07-12T02:05:28.961 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-07-12T02:05:28.984 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 096.out.internal 033.out.crc 096.out.external 033.out.default 071.out.64 216.out.classic 216.out.64mblog 071.out.32 216.cfg 033.cfg 308.out 737.out 108.out 504.out 404.out 104.out 004.out 377.out 537.out 194.out 158.out 337.out 082.out 237.out 759.out 502.out 088.out 202.out 137.out 102.out 746.out 110.out 586.out 181.out 571.out 567.out 592.out 282.out 266.out 728.out 178.out 528.out 769.out 428.out 507.out 407.out 328.out 171.out 028.out 046.out 273.out 570.out 468.out 474.out 059.out 346.out 732.out 784.out 443.out 411.out 532.out 591.out 064.out 471.out 111.out 432.out 255.out 371.out 319.out 177.out 523.out 119.out 775.out 232.out 363.out 131.out 243.out 183.out 547.out 738.out 260.out 718.out 034.out 465.out 716.out 161.out 246.out 416.out 247.out 116.out 016.out 041.out 358.out 338.out 287.out 099.out 238.out 065.out 566.out 295.out 138.out 765.out 160.out 291.out 274.out 722.out 061.out 239.out 085.out 457.out 025.out 772.out 530.out 258.out 322.out 039.out 498.out 098.out 517.out 573.out 060.out 506.out 406.out 306.out 106.out 006.out 003.out 217.out 120.out 191.out 133.out 455.out 130.out 442.out 188.out 030.out 199.out 595.out 467.out 281.out 242.out 163.out 771.out 324.out 224.out 050.out 764.out 124.out 382.out 278.out 058.out 741.out 384.out 042.out 497.out 466.out 193.out 097.out 392.out 283.out 541.out 770.out 709.out 755.out 309.out 441.out 157.out 740.out 356.out 341.out 494.out 189.out 555.out 241.out 540.out 077.out 412.out 514.out 414.out 314.out 440.out 114.out 316.out 074.out 147.out 012.out 155.out 340.out 793.out 156.out 572.out 568.out 240.out 279.out 180.out 733.out 280.out 434.out 140.out 766.out 185.out 408.out 383.out 066.out 552.out 304.out 204.out 353.out 425.out 069.out 254.out 335.out 531.out 235.out 556.out 253.out 503.out 418.out 275.out 272.out 496.out 751.out 433.out 176.out 134.out 393.out 333.out 476.out 535.out 739.out 233.out 752.out 736.out 107.out 053.out 164.out 587.out 339.out 294.out 521.out 352.out 799.out 489.out 139.out 774.out 267.out 390.out 399.out 781.out 017.out 169.out 593.out 186.out 452.out 252.out 585.out 167.out 724.out 206.out 794.out 348.out 394.out 509.out 248.out 785.out 424.out 750.out 525.out 488.out 040.out 325.out 551.out 225.out 125.out 142.out 715.out 789.out 581.out 152.out 563.out 215.out 436.out 792.out 075.out 472.out 578.out 463.out 550.out 052.out 351.out 430.out 276.out 290.out 094.out 451.out 450.out 744.out 043.out 086.out 349.out 444.out 500.out 487.out 762.out 544.out 305.out 395.out 515.out 415.out 389.out 315.out 344.out 115.out 015.out 542.out 250.out 791.out 464.out 475.out 536.out 228.out 439.out 244.out 128.out 385.out 005.out 336.out 150.out 579.out 236.out 342.out 580.out 136.out 036.out 198.out 723.out 008.out 790.out 505.out 405.out 588.out 205.out 105.out 144.out 768.out 437.out 037.out 044.out 719.out 381.out 721.out 323.out 519.out 562.out 419.out 219.out 123.out 056.out 019.out 577.out 151.out 760.out 574.out 332.out 796.out 027.out 372.out 584.out 462.out 220.out 350.out 312.out 492.out 745.out 076.out 112.out 063.out 561.out 214.out 776.out 014.out 758.out 362.out 387.out 594.out 438.out 265.out 289.out 554.out 516.out 477.out 548.out 560.out 166.out 461.out 445.out 296.out 207.out 493.out 786.out 007.out 251.out 380.out 093.out 526.out 479.out 426.out 192.out 326.out 226.out 454.out 126.out 121.out 447.out 761.out 773.out 460.out 485.out 347.out 035.out 361.out 564.out 788.out 795.out 089.out 747.out 558.out 162.out 743.out 288.out 197.out 396.out 576.out 051.out 354.out 355.out 575.out 148.out 301.out 360.out 543.out 263.out 270.out 261.out 734.out 045.out 292.out 482.out 726.out 729.out 378.out 458.out 062.out 249.out 231.out 343.out 334.out 590.out 368.out 486.out 223.out 132.out 023.out 459.out 032.out 798.out 277.out 748.out 527.out 146.out 398.out 366.out 427.out 190.out 173.out 470.out 484.out 754.out 767.out 749.out 187.out 091.out 201.out 725.out 731.out 782.out 374.out 583.out 285.out 127.out 256.out 501.out 376.out 431.out 068.out 331.out 179.out 713.out 024.out 513.out 413.out 313.out 549.out 213.out 730.out 113.out 013.out 031.out 435.out 182.out 057.out 727.out 078.out 510.out 184.out 797.out 534.out 545.out 210.out 449.out 327.out 330.out 067.out 227.out 010.out 230.out 083.out 473.out 299.out 073.out 370.out 135.out 403.out 303.out 203.out 103.out 345.out 165.out 386.out 055.out 742.out 245.out 026.out 522.out 787.out 422.out 222.out 159.out 539.out 524.out 122.out 448.out 234.out 022.out 174.out 779.out 490.out 565.out 090.out 423.out 154.out 271.out 149.out 518.out 318.out 264.out 218.out 118.out 018.out 329.out 047.out 172.out 168.out 293.out 079.out 469.out 054.out 049.out 208.out 379.out 569.out 456.out 268.out 421.out 712.out 321.out 533.out 512.out 221.out 087.out 212.out 538.out 021.out 195.out 388.out 483.out 397.out 070.out 373.out 720.out 481.out 196.out 520.out 129.out 446.out 420.out 478.out 320.out 499.out 153.out 402.out 302.out 020.out 529.out 002.out 717.out 429.out 417.out 317.out 365.out 092.out 117.out 357.out 072.out 778.out 143.out 229.out 038.out 084.out 369.out 711.out 262.out 511.out 029.out 311.out 211.out 011.out 783.out 170.out 286.out 756.out 175.out 714.out 559.out 710.out 410.out 310.out 401.out 101.out 001.out 141.out 495.out 048.out 589.out 753.out 095.out 297.out 480.out 145.out 257.out 757.out 491.out 081.out 800.out 777.out 400.out 300.out 200.out 100.out 359.out 367.out 269.out 546.out 780.out 553.out 763.out 375.out 298.out 259.out 080.out 708.out 508.out 409.out 307.out 209.out 109.out 009.out 391.out 284.out 557.out 453.out 364.out 582.out 735.out /var/lib/xfstests/tests/xfs 2023-07-12T02:05:34.036 INFO:teuthology.orchestra.run.smithi174.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-07-12T02:05:34.059 INFO:teuthology.orchestra.run.smithi174.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-07-12T02:05:34.082 INFO:teuthology.orchestra.run.smithi174.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-07-12T02:05:34.105 INFO:teuthology.orchestra.run.smithi174.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-07-12T02:05:34.133 DEBUG:teuthology.orchestra.run.smithi174:> (cd /tmp/tmp.MhsN8hlsQwxfsprogs-dev && exec sudo make) 2023-07-12T02:05:34.211 INFO:teuthology.orchestra.run.smithi174.stdout:libtoolize -c -i -f 2023-07-12T02:05:34.492 INFO:teuthology.orchestra.run.smithi174.stdout:libtoolize: putting auxiliary files in AC_CONFIG_AUX_DIR, '.'. 2023-07-12T02:05:34.492 INFO:teuthology.orchestra.run.smithi174.stdout:libtoolize: copying file './config.guess' 2023-07-12T02:05:34.502 INFO:teuthology.orchestra.run.smithi174.stdout:libtoolize: copying file './config.sub' 2023-07-12T02:05:34.512 INFO:teuthology.orchestra.run.smithi174.stdout:libtoolize: copying file './install-sh' 2023-07-12T02:05:34.523 INFO:teuthology.orchestra.run.smithi174.stdout:libtoolize: copying file './ltmain.sh' 2023-07-12T02:05:34.583 INFO:teuthology.orchestra.run.smithi174.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-07-12T02:05:34.584 INFO:teuthology.orchestra.run.smithi174.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-07-12T02:05:34.596 INFO:teuthology.orchestra.run.smithi174.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-07-12T02:05:34.609 INFO:teuthology.orchestra.run.smithi174.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-07-12T02:05:34.621 INFO:teuthology.orchestra.run.smithi174.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-07-12T02:05:34.634 INFO:teuthology.orchestra.run.smithi174.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-07-12T02:05:34.650 INFO:teuthology.orchestra.run.smithi174.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-07-12T02:05:34.654 INFO:teuthology.orchestra.run.smithi174.stdout:cp include/install-sh . 2023-07-12T02:05:34.656 INFO:teuthology.orchestra.run.smithi174.stdout:aclocal -I m4 2023-07-12T02:05:35.916 INFO:teuthology.orchestra.run.smithi174.stdout:autoconf 2023-07-12T02:05:36.341 INFO:teuthology.orchestra.run.smithi174.stdout:./configure $LOCAL_CONFIGURE_OPTIONS 2023-07-12T02:05:36.477 INFO:teuthology.orchestra.run.smithi174.stdout:configure: loading site script /usr/share/config.site 2023-07-12T02:05:36.508 INFO:teuthology.orchestra.run.smithi174.stdout:checking for a BSD-compatible install... /bin/install -c 2023-07-12T02:05:36.603 INFO:teuthology.orchestra.run.smithi174.stdout:checking build system type... x86_64-pc-linux-gnu 2023-07-12T02:05:36.604 INFO:teuthology.orchestra.run.smithi174.stdout:checking host system type... x86_64-pc-linux-gnu 2023-07-12T02:05:36.607 INFO:teuthology.orchestra.run.smithi174.stdout:checking how to print strings... printf 2023-07-12T02:05:36.608 INFO:teuthology.orchestra.run.smithi174.stdout:checking for gcc... gcc 2023-07-12T02:05:36.699 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether the C compiler works... yes 2023-07-12T02:05:36.700 INFO:teuthology.orchestra.run.smithi174.stdout:checking for C compiler default output file name... a.out 2023-07-12T02:05:36.749 INFO:teuthology.orchestra.run.smithi174.stdout:checking for suffix of executables... 2023-07-12T02:05:36.806 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether we are cross compiling... no 2023-07-12T02:05:36.843 INFO:teuthology.orchestra.run.smithi174.stdout:checking for suffix of object files... o 2023-07-12T02:05:36.877 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether we are using the GNU C compiler... yes 2023-07-12T02:05:36.911 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether gcc accepts -g... yes 2023-07-12T02:05:36.958 INFO:teuthology.orchestra.run.smithi174.stdout:checking for gcc option to accept ISO C89... none needed 2023-07-12T02:05:36.965 INFO:teuthology.orchestra.run.smithi174.stdout:checking for a sed that does not truncate output... /bin/sed 2023-07-12T02:05:36.970 INFO:teuthology.orchestra.run.smithi174.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-07-12T02:05:36.973 INFO:teuthology.orchestra.run.smithi174.stdout:checking for egrep... /bin/grep -E 2023-07-12T02:05:36.976 INFO:teuthology.orchestra.run.smithi174.stdout:checking for fgrep... /bin/grep -F 2023-07-12T02:05:36.984 INFO:teuthology.orchestra.run.smithi174.stdout:checking for ld used by gcc... /bin/ld 2023-07-12T02:05:36.988 INFO:teuthology.orchestra.run.smithi174.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-07-12T02:05:36.993 INFO:teuthology.orchestra.run.smithi174.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-07-12T02:05:37.032 INFO:teuthology.orchestra.run.smithi174.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-07-12T02:05:37.033 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether ln -s works... yes 2023-07-12T02:05:37.040 INFO:teuthology.orchestra.run.smithi174.stdout:checking the maximum length of command line arguments... 1572864 2023-07-12T02:05:37.046 INFO:teuthology.orchestra.run.smithi174.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-07-12T02:05:37.046 INFO:teuthology.orchestra.run.smithi174.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-07-12T02:05:37.046 INFO:teuthology.orchestra.run.smithi174.stdout:checking for /bin/ld option to reload object files... -r 2023-07-12T02:05:37.047 INFO:teuthology.orchestra.run.smithi174.stdout:checking for objdump... objdump 2023-07-12T02:05:37.047 INFO:teuthology.orchestra.run.smithi174.stdout:checking how to recognize dependent libraries... pass_all 2023-07-12T02:05:37.048 INFO:teuthology.orchestra.run.smithi174.stdout:checking for dlltool... no 2023-07-12T02:05:37.048 INFO:teuthology.orchestra.run.smithi174.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-07-12T02:05:37.048 INFO:teuthology.orchestra.run.smithi174.stdout:checking for ar... ar 2023-07-12T02:05:37.094 INFO:teuthology.orchestra.run.smithi174.stdout:checking for archiver @FILE support... @ 2023-07-12T02:05:37.094 INFO:teuthology.orchestra.run.smithi174.stdout:checking for strip... strip 2023-07-12T02:05:37.094 INFO:teuthology.orchestra.run.smithi174.stdout:checking for ranlib... ranlib 2023-07-12T02:05:37.095 INFO:teuthology.orchestra.run.smithi174.stdout:checking for gawk... gawk 2023-07-12T02:05:37.204 INFO:teuthology.orchestra.run.smithi174.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-07-12T02:05:37.207 INFO:teuthology.orchestra.run.smithi174.stdout:checking for sysroot... no 2023-07-12T02:05:37.215 INFO:teuthology.orchestra.run.smithi174.stdout:checking for a working dd... /bin/dd 2023-07-12T02:05:37.222 INFO:teuthology.orchestra.run.smithi174.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-07-12T02:05:37.250 INFO:teuthology.orchestra.run.smithi174.stdout:checking for mt... no 2023-07-12T02:05:37.256 INFO:teuthology.orchestra.run.smithi174.stdout:checking if : is a manifest tool... no 2023-07-12T02:05:37.297 INFO:teuthology.orchestra.run.smithi174.stdout:checking how to run the C preprocessor... gcc -E 2023-07-12T02:05:37.487 INFO:teuthology.orchestra.run.smithi174.stdout:checking for ANSI C header files... yes 2023-07-12T02:05:37.530 INFO:teuthology.orchestra.run.smithi174.stdout:checking for sys/types.h... yes 2023-07-12T02:05:37.582 INFO:teuthology.orchestra.run.smithi174.stdout:checking for sys/stat.h... yes 2023-07-12T02:05:37.634 INFO:teuthology.orchestra.run.smithi174.stdout:checking for stdlib.h... yes 2023-07-12T02:05:37.687 INFO:teuthology.orchestra.run.smithi174.stdout:checking for string.h... yes 2023-07-12T02:05:37.739 INFO:teuthology.orchestra.run.smithi174.stdout:checking for memory.h... yes 2023-07-12T02:05:37.792 INFO:teuthology.orchestra.run.smithi174.stdout:checking for strings.h... yes 2023-07-12T02:05:37.846 INFO:teuthology.orchestra.run.smithi174.stdout:checking for inttypes.h... yes 2023-07-12T02:05:37.900 INFO:teuthology.orchestra.run.smithi174.stdout:checking for stdint.h... yes 2023-07-12T02:05:37.956 INFO:teuthology.orchestra.run.smithi174.stdout:checking for unistd.h... yes 2023-07-12T02:05:38.006 INFO:teuthology.orchestra.run.smithi174.stdout:checking for dlfcn.h... yes 2023-07-12T02:05:38.015 INFO:teuthology.orchestra.run.smithi174.stdout:checking for objdir... .libs 2023-07-12T02:05:38.149 INFO:teuthology.orchestra.run.smithi174.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-07-12T02:05:38.149 INFO:teuthology.orchestra.run.smithi174.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-07-12T02:05:38.187 INFO:teuthology.orchestra.run.smithi174.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-07-12T02:05:38.224 INFO:teuthology.orchestra.run.smithi174.stdout:checking if gcc static flag -static works... no 2023-07-12T02:05:38.276 INFO:teuthology.orchestra.run.smithi174.stdout:checking if gcc supports -c -o file.o... yes 2023-07-12T02:05:38.277 INFO:teuthology.orchestra.run.smithi174.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-07-12T02:05:38.291 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-07-12T02:05:38.340 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether -lc should be explicitly linked in... no 2023-07-12T02:05:38.430 INFO:teuthology.orchestra.run.smithi174.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-07-12T02:05:38.430 INFO:teuthology.orchestra.run.smithi174.stdout:checking how to hardcode library paths into programs... immediate 2023-07-12T02:05:38.433 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether stripping libraries is possible... yes 2023-07-12T02:05:38.433 INFO:teuthology.orchestra.run.smithi174.stdout:checking if libtool supports shared libraries... yes 2023-07-12T02:05:38.433 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether to build shared libraries... yes 2023-07-12T02:05:38.434 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether to build static libraries... yes 2023-07-12T02:05:38.434 INFO:teuthology.orchestra.run.smithi174.stdout:checking for gcc... (cached) gcc 2023-07-12T02:05:38.472 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-07-12T02:05:38.473 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether gcc accepts -g... (cached) yes 2023-07-12T02:05:38.473 INFO:teuthology.orchestra.run.smithi174.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-07-12T02:05:38.485 INFO:teuthology.orchestra.run.smithi174.stdout:checking for gcc... (cached) gcc 2023-07-12T02:05:38.524 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-07-12T02:05:38.524 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether gcc accepts -g... (cached) yes 2023-07-12T02:05:38.524 INFO:teuthology.orchestra.run.smithi174.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-07-12T02:05:38.532 INFO:teuthology.orchestra.run.smithi174.stdout:checking for gcc... (cached) gcc 2023-07-12T02:05:38.570 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-07-12T02:05:38.571 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether gcc accepts -g... (cached) yes 2023-07-12T02:05:38.571 INFO:teuthology.orchestra.run.smithi174.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-07-12T02:05:38.571 INFO:teuthology.orchestra.run.smithi174.stdout:checking for gmake... /bin/gmake 2023-07-12T02:05:38.572 INFO:teuthology.orchestra.run.smithi174.stdout:checking for tar... /bin/tar 2023-07-12T02:05:38.572 INFO:teuthology.orchestra.run.smithi174.stdout:checking for gzip... /bin/gzip 2023-07-12T02:05:38.587 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether gcc -MM is supported... yes 2023-07-12T02:05:38.588 INFO:teuthology.orchestra.run.smithi174.stdout:checking for sort... /bin/sort 2023-07-12T02:05:38.588 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether ln -s works... yes 2023-07-12T02:05:38.589 INFO:teuthology.orchestra.run.smithi174.stdout:checking for msgfmt... /bin/msgfmt 2023-07-12T02:05:38.589 INFO:teuthology.orchestra.run.smithi174.stdout:checking for msgmerge... /bin/msgmerge 2023-07-12T02:05:38.589 INFO:teuthology.orchestra.run.smithi174.stdout:checking for xgettext... /bin/xgettext 2023-07-12T02:05:38.590 INFO:teuthology.orchestra.run.smithi174.stdout:checking for rpm... /bin/rpm 2023-07-12T02:05:38.597 INFO:teuthology.orchestra.run.smithi174.stdout:checking for rpmbuild... no 2023-07-12T02:05:38.645 INFO:teuthology.orchestra.run.smithi174.stdout:checking ini.h usability... yes 2023-07-12T02:05:38.662 INFO:teuthology.orchestra.run.smithi174.stdout:checking ini.h presence... yes 2023-07-12T02:05:38.663 INFO:teuthology.orchestra.run.smithi174.stdout:checking for ini.h... yes 2023-07-12T02:05:38.722 INFO:teuthology.orchestra.run.smithi174.stdout:checking for ini_parse in -linih... yes 2023-07-12T02:05:38.773 INFO:teuthology.orchestra.run.smithi174.stdout:checking uuid.h usability... no 2023-07-12T02:05:38.797 INFO:teuthology.orchestra.run.smithi174.stdout:checking uuid.h presence... no 2023-07-12T02:05:38.797 INFO:teuthology.orchestra.run.smithi174.stdout:checking for uuid.h... no 2023-07-12T02:05:38.845 INFO:teuthology.orchestra.run.smithi174.stdout:checking sys/uuid.h usability... no 2023-07-12T02:05:38.869 INFO:teuthology.orchestra.run.smithi174.stdout:checking sys/uuid.h presence... no 2023-07-12T02:05:38.869 INFO:teuthology.orchestra.run.smithi174.stdout:checking for sys/uuid.h... no 2023-07-12T02:05:38.919 INFO:teuthology.orchestra.run.smithi174.stdout:checking uuid/uuid.h usability... yes 2023-07-12T02:05:38.938 INFO:teuthology.orchestra.run.smithi174.stdout:checking uuid/uuid.h presence... yes 2023-07-12T02:05:38.938 INFO:teuthology.orchestra.run.smithi174.stdout:checking for uuid/uuid.h... yes 2023-07-12T02:05:39.013 INFO:teuthology.orchestra.run.smithi174.stdout:checking for uuid_compare... no 2023-07-12T02:05:39.070 INFO:teuthology.orchestra.run.smithi174.stdout:checking for uuid_compare in -luuid... yes 2023-07-12T02:05:39.118 INFO:teuthology.orchestra.run.smithi174.stdout:checking pthread.h usability... yes 2023-07-12T02:05:39.137 INFO:teuthology.orchestra.run.smithi174.stdout:checking pthread.h presence... yes 2023-07-12T02:05:39.137 INFO:teuthology.orchestra.run.smithi174.stdout:checking for pthread.h... yes 2023-07-12T02:05:39.198 INFO:teuthology.orchestra.run.smithi174.stdout:checking for pthread_mutex_init in -lpthread... yes 2023-07-12T02:05:39.250 INFO:teuthology.orchestra.run.smithi174.stdout:checking urcu.h usability... yes 2023-07-12T02:05:39.275 INFO:teuthology.orchestra.run.smithi174.stdout:checking urcu.h presence... yes 2023-07-12T02:05:39.275 INFO:teuthology.orchestra.run.smithi174.stdout:checking for urcu.h... yes 2023-07-12T02:05:39.326 INFO:teuthology.orchestra.run.smithi174.stdout:checking for liburcu... yes 2023-07-12T02:05:39.364 INFO:teuthology.orchestra.run.smithi174.stdout:checking for fadvise ... yes 2023-07-12T02:05:39.402 INFO:teuthology.orchestra.run.smithi174.stdout:checking for madvise ... yes 2023-07-12T02:05:39.441 INFO:teuthology.orchestra.run.smithi174.stdout:checking for mincore ... yes 2023-07-12T02:05:39.481 INFO:teuthology.orchestra.run.smithi174.stdout:checking for sendfile ... yes 2023-07-12T02:05:39.522 INFO:teuthology.orchestra.run.smithi174.stdout:checking for getmntent ... yes 2023-07-12T02:05:39.582 INFO:teuthology.orchestra.run.smithi174.stdout:checking for fallocate... yes 2023-07-12T02:05:39.644 INFO:teuthology.orchestra.run.smithi174.stdout:checking for fiemap... yes 2023-07-12T02:05:39.705 INFO:teuthology.orchestra.run.smithi174.stdout:checking for pwritev2... yes 2023-07-12T02:05:39.766 INFO:teuthology.orchestra.run.smithi174.stdout:checking for preadv... yes 2023-07-12T02:05:39.829 INFO:teuthology.orchestra.run.smithi174.stdout:checking for copy_file_range... yes 2023-07-12T02:05:39.889 INFO:teuthology.orchestra.run.smithi174.stdout:checking for sync_file_range... yes 2023-07-12T02:05:39.951 INFO:teuthology.orchestra.run.smithi174.stdout:checking for syncfs... yes 2023-07-12T02:05:39.996 INFO:teuthology.orchestra.run.smithi174.stdout:checking mntent.h usability... yes 2023-07-12T02:05:40.012 INFO:teuthology.orchestra.run.smithi174.stdout:checking mntent.h presence... yes 2023-07-12T02:05:40.013 INFO:teuthology.orchestra.run.smithi174.stdout:checking for mntent.h... yes 2023-07-12T02:05:40.056 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether fls is declared... no 2023-07-12T02:05:40.113 INFO:teuthology.orchestra.run.smithi174.stdout:checking for readdir... yes 2023-07-12T02:05:40.164 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether fsetxattr is declared... yes 2023-07-12T02:05:40.210 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether mremap is declared... yes 2023-07-12T02:05:40.279 INFO:teuthology.orchestra.run.smithi174.stdout:checking for struct fsxattr... yes 2023-07-12T02:05:40.318 INFO:teuthology.orchestra.run.smithi174.stdout:checking for struct fsxattr.fsx_cowextsize... yes 2023-07-12T02:05:40.349 INFO:teuthology.orchestra.run.smithi174.stdout:checking for struct fscrypt_add_key_arg... no 2023-07-12T02:05:40.417 INFO:teuthology.orchestra.run.smithi174.stdout:checking for GETFSMAP... yes 2023-07-12T02:05:40.486 INFO:teuthology.orchestra.run.smithi174.stdout:checking for struct statfs... yes 2023-07-12T02:05:40.524 INFO:teuthology.orchestra.run.smithi174.stdout:checking for struct statfs.f_flags... yes 2023-07-12T02:05:40.560 INFO:teuthology.orchestra.run.smithi174.stdout:checking for MAP_SYNC... yes 2023-07-12T02:05:40.695 INFO:teuthology.orchestra.run.smithi174.stdout:checking for library containing dm_task_create... -ldevmapper 2023-07-12T02:05:40.734 INFO:teuthology.orchestra.run.smithi174.stdout:checking for mallinfo ... yes 2023-07-12T02:05:40.768 INFO:teuthology.orchestra.run.smithi174.stdout:checking for mallinfo2 ... no 2023-07-12T02:05:40.812 INFO:teuthology.orchestra.run.smithi174.stdout:checking attr/attributes.h usability... yes 2023-07-12T02:05:40.829 INFO:teuthology.orchestra.run.smithi174.stdout:checking attr/attributes.h presence... yes 2023-07-12T02:05:40.829 INFO:teuthology.orchestra.run.smithi174.stdout:checking for attr/attributes.h... yes 2023-07-12T02:05:40.870 INFO:teuthology.orchestra.run.smithi174.stdout:checking for struct attrlist_cursor... yes 2023-07-12T02:05:40.872 INFO:teuthology.orchestra.run.smithi174.stdout:checking for pkg-config... /bin/pkg-config 2023-07-12T02:05:40.888 INFO:teuthology.orchestra.run.smithi174.stdout:checking pkg-config is at least version 0.9.0... yes 2023-07-12T02:05:40.901 INFO:teuthology.orchestra.run.smithi174.stdout:checking for libicu... yes 2023-07-12T02:05:40.950 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether openat is declared... yes 2023-07-12T02:05:41.003 INFO:teuthology.orchestra.run.smithi174.stdout:checking whether fstatat is declared... yes 2023-07-12T02:05:41.054 INFO:teuthology.orchestra.run.smithi174.stdout:checking for struct sg_io_hdr ... yes 2023-07-12T02:05:41.094 INFO:teuthology.orchestra.run.smithi174.stdout:checking for struct hd_geometry ... yes 2023-07-12T02:05:41.127 INFO:teuthology.orchestra.run.smithi174.stdout:checking for systemd... yes 2023-07-12T02:05:41.130 INFO:teuthology.orchestra.run.smithi174.stdout:checking for systemd system unit dir... /usr/lib/systemd/system 2023-07-12T02:05:41.130 INFO:teuthology.orchestra.run.smithi174.stdout:checking for system crontab dir... /etc/cron.d 2023-07-12T02:05:41.265 INFO:teuthology.orchestra.run.smithi174.stdout:checking for library containing blkid_probe_all... -lblkid 2023-07-12T02:05:41.333 INFO:teuthology.orchestra.run.smithi174.stdout:checking for blkid_probe_get_topology... yes 2023-07-12T02:05:41.425 INFO:teuthology.orchestra.run.smithi174.stdout:checking size of long... 8 2023-07-12T02:05:41.515 INFO:teuthology.orchestra.run.smithi174.stdout:checking size of char *... 8 2023-07-12T02:05:41.546 INFO:teuthology.orchestra.run.smithi174.stdout:checking for umode_t... no 2023-07-12T02:05:41.627 INFO:teuthology.orchestra.run.smithi174.stdout:checking for atomic64_t support in liburcu... yes 2023-07-12T02:05:41.660 INFO:teuthology.orchestra.run.smithi174.stdout:configure: creating ./config.status 2023-07-12T02:05:42.575 INFO:teuthology.orchestra.run.smithi174.stdout:config.status: creating include/builddefs 2023-07-12T02:05:42.602 INFO:teuthology.orchestra.run.smithi174.stdout:config.status: creating include/platform_defs.h 2023-07-12T02:05:42.624 INFO:teuthology.orchestra.run.smithi174.stdout:config.status: executing libtool commands 2023-07-12T02:05:42.713 INFO:teuthology.orchestra.run.smithi174.stdout: [HEADERS] include 2023-07-12T02:05:42.728 INFO:teuthology.orchestra.run.smithi174.stdout: [HEADERS] libxfs 2023-07-12T02:05:42.755 INFO:teuthology.orchestra.run.smithi174.stdout:Building include 2023-07-12T02:05:42.765 INFO:teuthology.orchestra.run.smithi174.stdout: [LN] disk 2023-07-12T02:05:42.769 INFO:teuthology.orchestra.run.smithi174.stdout:Building libfrog 2023-07-12T02:05:42.775 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] gen_crc32table 2023-07-12T02:05:42.846 INFO:teuthology.orchestra.run.smithi174.stdout: [GENERATE] crc32table.h 2023-07-12T02:05:43.345 INFO:teuthology.orchestra.run.smithi174.stdout: [TEST] CRC32 2023-07-12T02:05:43.520 INFO:teuthology.orchestra.run.smithi174.stdout:CRC_LE_BITS = 64 2023-07-12T02:05:43.520 INFO:teuthology.orchestra.run.smithi174.stdout:crc32c: tests passed, 225944 bytes in 57 usec 2023-07-12T02:05:43.523 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] avl64.lo 2023-07-12T02:05:44.112 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] bitmap.lo 2023-07-12T02:05:44.567 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] bulkstat.lo 2023-07-12T02:05:45.079 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] convert.lo 2023-07-12T02:05:45.552 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] crc32.lo 2023-07-12T02:05:45.912 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] fsgeom.lo 2023-07-12T02:05:46.359 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] list_sort.lo 2023-07-12T02:05:46.707 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] linux.lo 2023-07-12T02:05:47.161 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] logging.lo 2023-07-12T02:05:47.454 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] paths.lo 2023-07-12T02:05:48.006 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] projects.lo 2023-07-12T02:05:48.434 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] ptvar.lo 2023-07-12T02:05:48.820 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] radix-tree.lo 2023-07-12T02:05:49.460 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] randbytes.lo 2023-07-12T02:05:49.807 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] scrub.lo 2023-07-12T02:05:50.147 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] util.lo 2023-07-12T02:05:50.500 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] workqueue.lo 2023-07-12T02:05:50.910 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:05:50.911 INFO:teuthology.orchestra.run.smithi174.stdout: [LD] libfrog.la 2023-07-12T02:05:50.913 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:05:50.915 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:05:51.051 INFO:teuthology.orchestra.run.smithi174.stdout:Building libxfs 2023-07-12T02:05:52.751 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] cache.lo 2023-07-12T02:05:53.404 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] defer_item.lo 2023-07-12T02:05:53.942 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] init.lo 2023-07-12T02:05:54.756 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] kmem.lo 2023-07-12T02:05:55.178 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] logitem.lo 2023-07-12T02:05:55.607 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] rdwr.lo 2023-07-12T02:05:56.548 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] topology.lo 2023-07-12T02:05:57.049 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] trans.lo 2023-07-12T02:05:57.660 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] util.lo 2023-07-12T02:05:58.285 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_ag.lo 2023-07-12T02:05:59.185 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_ag_resv.lo 2023-07-12T02:05:59.670 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_alloc.lo 2023-07-12T02:06:01.188 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_alloc_btree.lo 2023-07-12T02:06:01.790 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_attr.lo 2023-07-12T02:06:02.511 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_attr_leaf.lo 2023-07-12T02:06:03.977 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_attr_remote.lo 2023-07-12T02:06:04.627 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_bit.lo 2023-07-12T02:06:05.047 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_bmap.lo 2023-07-12T02:06:07.834 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_bmap_btree.lo 2023-07-12T02:06:08.477 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_btree.lo 2023-07-12T02:06:10.629 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_btree_staging.lo 2023-07-12T02:06:11.214 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_da_btree.lo 2023-07-12T02:06:12.544 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_defer.lo 2023-07-12T02:06:13.177 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_dir2.lo 2023-07-12T02:06:13.797 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_dir2_block.lo 2023-07-12T02:06:14.756 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_dir2_data.lo 2023-07-12T02:06:15.667 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_dir2_leaf.lo 2023-07-12T02:06:16.689 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_dir2_node.lo 2023-07-12T02:06:17.829 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_dir2_sf.lo 2023-07-12T02:06:18.710 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_dquot_buf.lo 2023-07-12T02:06:19.225 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_ialloc.lo 2023-07-12T02:06:20.583 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_iext_tree.lo 2023-07-12T02:06:21.013 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:06:21.016 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:06:21.018 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:06:21.444 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_inode_buf.lo 2023-07-12T02:06:22.216 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_inode_fork.lo 2023-07-12T02:06:22.955 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_ialloc_btree.lo 2023-07-12T02:06:23.594 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_log_rlimit.lo 2023-07-12T02:06:24.038 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_refcount.lo 2023-07-12T02:06:24.942 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_refcount_btree.lo 2023-07-12T02:06:25.518 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_rmap.lo 2023-07-12T02:06:26.705 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_rmap_btree.lo 2023-07-12T02:06:27.345 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_rtbitmap.lo 2023-07-12T02:06:28.073 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_sb.lo 2023-07-12T02:06:28.977 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_symlink_remote.lo 2023-07-12T02:06:29.470 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_trans_inode.lo 2023-07-12T02:06:29.912 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_trans_resv.lo 2023-07-12T02:06:30.613 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_types.lo 2023-07-12T02:06:31.099 INFO:teuthology.orchestra.run.smithi174.stdout: [LD] libxfs.la 2023-07-12T02:06:31.362 INFO:teuthology.orchestra.run.smithi174.stdout:Building libxlog 2023-07-12T02:06:31.459 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_log_recover.lo 2023-07-12T02:06:32.361 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] util.lo 2023-07-12T02:06:32.854 INFO:teuthology.orchestra.run.smithi174.stdout: [LD] libxlog.la 2023-07-12T02:06:32.972 INFO:teuthology.orchestra.run.smithi174.stdout:Building libxcmd 2023-07-12T02:06:33.112 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] command.lo 2023-07-12T02:06:33.574 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] input.lo 2023-07-12T02:06:34.009 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] help.lo 2023-07-12T02:06:34.383 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] quit.lo 2023-07-12T02:06:34.736 INFO:teuthology.orchestra.run.smithi174.stdout: [LD] libxcmd.la 2023-07-12T02:06:34.856 INFO:teuthology.orchestra.run.smithi174.stdout:Building libhandle 2023-07-12T02:06:34.940 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] handle.lo 2023-07-12T02:06:35.420 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] jdm.lo 2023-07-12T02:06:35.828 INFO:teuthology.orchestra.run.smithi174.stdout: [LD] libhandle.la 2023-07-12T02:06:35.984 INFO:teuthology.orchestra.run.smithi174.stdout:Building copy 2023-07-12T02:06:36.043 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_copy.o 2023-07-12T02:06:36.477 INFO:teuthology.orchestra.run.smithi174.stdout: [LD] xfs_copy 2023-07-12T02:06:36.697 INFO:teuthology.orchestra.run.smithi174.stdout:Building db 2023-07-12T02:06:38.758 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] addr.o 2023-07-12T02:06:38.879 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] agf.o 2023-07-12T02:06:38.995 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] agfl.o 2023-07-12T02:06:39.112 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] agi.o 2023-07-12T02:06:39.228 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] attr.o 2023-07-12T02:06:39.443 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] attrshort.o 2023-07-12T02:06:39.578 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] bit.o 2023-07-12T02:06:39.715 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] block.o 2023-07-12T02:06:39.869 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] bmap.o 2023-07-12T02:06:40.079 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] btblock.o 2023-07-12T02:06:40.225 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] bmroot.o 2023-07-12T02:06:40.401 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] check.o 2023-07-12T02:06:42.107 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] command.o 2023-07-12T02:06:42.232 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] crc.o 2023-07-12T02:06:42.365 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] debug.o 2023-07-12T02:06:42.473 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] dir2.o 2023-07-12T02:06:42.779 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] dir2sf.o 2023-07-12T02:06:42.934 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] dquot.o 2023-07-12T02:06:43.063 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] echo.o 2023-07-12T02:06:43.169 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] faddr.o 2023-07-12T02:06:43.359 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] field.o 2023-07-12T02:06:43.486 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] flist.o 2023-07-12T02:06:43.683 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] fprint.o 2023-07-12T02:06:43.853 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] frag.o 2023-07-12T02:06:44.099 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] freesp.o 2023-07-12T02:06:44.306 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] hash.o 2023-07-12T02:06:44.415 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] help.o 2023-07-12T02:06:44.531 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] init.o 2023-07-12T02:06:44.669 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] inode.o 2023-07-12T02:06:44.955 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] input.o 2023-07-12T02:06:45.108 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] io.o 2023-07-12T02:06:45.322 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] logformat.o 2023-07-12T02:06:45.455 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] malloc.o 2023-07-12T02:06:45.568 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] metadump.o 2023-07-12T02:06:46.373 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] output.o 2023-07-12T02:06:46.493 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] print.o 2023-07-12T02:06:46.658 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] quit.o 2023-07-12T02:06:46.763 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] sb.o 2023-07-12T02:06:47.040 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] sig.o 2023-07-12T02:06:47.148 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] strvec.o 2023-07-12T02:06:47.268 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] text.o 2023-07-12T02:06:47.385 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] type.o 2023-07-12T02:06:47.519 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] write.o 2023-07-12T02:06:47.759 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] attrset.o 2023-07-12T02:06:47.897 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] symlink.o 2023-07-12T02:06:48.009 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] fsmap.o 2023-07-12T02:06:48.144 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] fuzz.o 2023-07-12T02:06:48.317 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] btdump.o 2023-07-12T02:06:48.501 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] btheight.o 2023-07-12T02:06:48.672 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] convert.o 2023-07-12T02:06:48.823 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] info.o 2023-07-12T02:06:48.954 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] namei.o 2023-07-12T02:06:49.165 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] timelimit.o 2023-07-12T02:06:49.287 INFO:teuthology.orchestra.run.smithi174.stdout: [LD] xfs_db 2023-07-12T02:06:49.588 INFO:teuthology.orchestra.run.smithi174.stdout:Building estimate 2023-07-12T02:06:49.647 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_estimate.o 2023-07-12T02:06:49.790 INFO:teuthology.orchestra.run.smithi174.stdout: [LD] xfs_estimate 2023-07-12T02:06:49.890 INFO:teuthology.orchestra.run.smithi174.stdout:Building fsck 2023-07-12T02:06:49.897 INFO:teuthology.orchestra.run.smithi174.stdout:Building fsr 2023-07-12T02:06:49.957 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_fsr.o 2023-07-12T02:06:50.366 INFO:teuthology.orchestra.run.smithi174.stdout: [LD] xfs_fsr 2023-07-12T02:06:50.511 INFO:teuthology.orchestra.run.smithi174.stdout:Building growfs 2023-07-12T02:06:50.570 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_growfs.o 2023-07-12T02:06:50.755 INFO:teuthology.orchestra.run.smithi174.stdout: [LD] xfs_growfs 2023-07-12T02:06:50.965 INFO:teuthology.orchestra.run.smithi174.stdout:Building io 2023-07-12T02:06:51.125 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:06:51.127 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:06:51.130 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:06:52.390 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] init.o 2023-07-12T02:06:52.507 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] attr.o 2023-07-12T02:06:52.649 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] bmap.o 2023-07-12T02:06:52.824 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] bulkstat.o 2023-07-12T02:06:52.980 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] crc32cselftest.o 2023-07-12T02:06:53.068 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] cowextsize.o 2023-07-12T02:06:53.178 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] encrypt.o 2023-07-12T02:06:53.380 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] file.o 2023-07-12T02:06:53.481 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] freeze.o 2023-07-12T02:06:53.570 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] fsuuid.o 2023-07-12T02:06:53.679 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] fsync.o 2023-07-12T02:06:53.761 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] getrusage.o 2023-07-12T02:06:53.855 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] imap.o 2023-07-12T02:06:53.944 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] inject.o 2023-07-12T02:06:54.045 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] label.o 2023-07-12T02:06:54.162 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] link.o 2023-07-12T02:06:54.244 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] mmap.o 2023-07-12T02:06:54.443 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] open.o 2023-07-12T02:06:54.706 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] parent.o 2023-07-12T02:06:54.860 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] pread.o 2023-07-12T02:06:55.032 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] prealloc.o 2023-07-12T02:06:55.168 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] pwrite.o 2023-07-12T02:06:55.323 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] reflink.o 2023-07-12T02:06:55.449 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] resblks.o 2023-07-12T02:06:55.536 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] scrub.o 2023-07-12T02:06:55.660 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] seek.o 2023-07-12T02:06:55.768 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] shutdown.o 2023-07-12T02:06:55.854 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] stat.o 2023-07-12T02:06:56.047 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] swapext.o 2023-07-12T02:06:56.136 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] sync.o 2023-07-12T02:06:56.216 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] truncate.o 2023-07-12T02:06:56.300 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] utimes.o 2023-07-12T02:06:56.385 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] fadvise.o 2023-07-12T02:06:56.478 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] madvise.o 2023-07-12T02:06:56.569 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] mincore.o 2023-07-12T02:06:56.666 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] sendfile.o 2023-07-12T02:06:56.772 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] fiemap.o 2023-07-12T02:06:56.921 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] copy_file_range.o 2023-07-12T02:06:57.024 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] sync_file_range.o 2023-07-12T02:06:57.113 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] readdir.o 2023-07-12T02:06:57.214 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] log_writes.o 2023-07-12T02:06:57.306 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] fsmap.o 2023-07-12T02:06:57.532 INFO:teuthology.orchestra.run.smithi174.stdout: [LD] xfs_io 2023-07-12T02:06:57.763 INFO:teuthology.orchestra.run.smithi174.stdout:Building logprint 2023-07-12T02:06:58.053 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] logprint.o 2023-07-12T02:06:58.193 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] log_copy.o 2023-07-12T02:06:58.307 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] log_dump.o 2023-07-12T02:06:58.429 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] log_misc.o 2023-07-12T02:06:58.903 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] log_print_all.o 2023-07-12T02:06:59.143 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] log_print_trans.o 2023-07-12T02:06:59.258 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] log_redo.o 2023-07-12T02:06:59.501 INFO:teuthology.orchestra.run.smithi174.stdout: [LD] xfs_logprint 2023-07-12T02:06:59.721 INFO:teuthology.orchestra.run.smithi174.stdout:Building mkfs 2023-07-12T02:06:59.820 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] proto.o 2023-07-12T02:07:00.079 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_mkfs.o 2023-07-12T02:07:00.762 INFO:teuthology.orchestra.run.smithi174.stdout: [LD] mkfs.xfs 2023-07-12T02:07:00.981 INFO:teuthology.orchestra.run.smithi174.stdout:Building quota 2023-07-12T02:07:01.372 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] init.o 2023-07-12T02:07:01.473 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] util.o 2023-07-12T02:07:01.624 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] edit.o 2023-07-12T02:07:01.816 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] free.o 2023-07-12T02:07:01.959 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] linux.o 2023-07-12T02:07:02.037 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] path.o 2023-07-12T02:07:02.148 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] project.o 2023-07-12T02:07:02.283 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] quot.o 2023-07-12T02:07:02.435 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] quota.o 2023-07-12T02:07:02.599 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] report.o 2023-07-12T02:07:02.816 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] state.o 2023-07-12T02:07:02.986 INFO:teuthology.orchestra.run.smithi174.stdout: [LD] xfs_quota 2023-07-12T02:07:03.138 INFO:teuthology.orchestra.run.smithi174.stdout:Building mdrestore 2023-07-12T02:07:03.197 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_mdrestore.o 2023-07-12T02:07:03.360 INFO:teuthology.orchestra.run.smithi174.stdout: [LD] xfs_mdrestore 2023-07-12T02:07:03.550 INFO:teuthology.orchestra.run.smithi174.stdout:Building repair 2023-07-12T02:07:04.924 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] agheader.o 2023-07-12T02:07:05.143 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] agbtree.o 2023-07-12T02:07:05.373 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] attr_repair.o 2023-07-12T02:07:05.722 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] avl.o 2023-07-12T02:07:05.938 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] bulkload.o 2023-07-12T02:07:06.061 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] bmap.o 2023-07-12T02:07:06.215 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] btree.o 2023-07-12T02:07:06.531 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] da_util.o 2023-07-12T02:07:06.751 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] dino_chunks.o 2023-07-12T02:07:07.125 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] dinode.o 2023-07-12T02:07:07.852 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] dir2.o 2023-07-12T02:07:08.252 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] globals.o 2023-07-12T02:07:08.351 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] incore_bmc.o 2023-07-12T02:07:08.461 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] incore.o 2023-07-12T02:07:08.609 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] incore_ext.o 2023-07-12T02:07:08.825 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] incore_ino.o 2023-07-12T02:07:09.084 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] init.o 2023-07-12T02:07:09.220 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] phase1.o 2023-07-12T02:07:09.347 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] phase2.o 2023-07-12T02:07:09.539 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] phase3.o 2023-07-12T02:07:09.679 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] phase4.o 2023-07-12T02:07:09.868 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] phase5.o 2023-07-12T02:07:10.121 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] phase6.o 2023-07-12T02:07:10.969 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] phase7.o 2023-07-12T02:07:11.107 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] prefetch.o 2023-07-12T02:07:11.443 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] progress.o 2023-07-12T02:07:11.637 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] quotacheck.o 2023-07-12T02:07:11.841 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] rmap.o 2023-07-12T02:07:12.218 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] rt.o 2023-07-12T02:07:12.380 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] sb.o 2023-07-12T02:07:12.599 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] scan.o 2023-07-12T02:07:13.332 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] slab.o 2023-07-12T02:07:13.495 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] threads.o 2023-07-12T02:07:13.608 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] versions.o 2023-07-12T02:07:13.739 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_repair.o 2023-07-12T02:07:14.038 INFO:teuthology.orchestra.run.smithi174.stdout: [LD] xfs_repair 2023-07-12T02:07:14.340 INFO:teuthology.orchestra.run.smithi174.stdout:Building rtcp 2023-07-12T02:07:14.398 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_rtcp.o 2023-07-12T02:07:14.570 INFO:teuthology.orchestra.run.smithi174.stdout: [LD] xfs_rtcp 2023-07-12T02:07:14.688 INFO:teuthology.orchestra.run.smithi174.stdout:Building m4 2023-07-12T02:07:14.695 INFO:teuthology.orchestra.run.smithi174.stdout:Building man 2023-07-12T02:07:14.705 INFO:teuthology.orchestra.run.smithi174.stdout:Building man2 2023-07-12T02:07:14.717 INFO:teuthology.orchestra.run.smithi174.stdout:Building man3 2023-07-12T02:07:14.726 INFO:teuthology.orchestra.run.smithi174.stdout:Building man5 2023-07-12T02:07:14.736 INFO:teuthology.orchestra.run.smithi174.stdout:Building man8 2023-07-12T02:07:14.755 INFO:teuthology.orchestra.run.smithi174.stdout: [SED] mkfs.xfs.8 2023-07-12T02:07:14.763 INFO:teuthology.orchestra.run.smithi174.stdout:Building doc 2023-07-12T02:07:14.773 INFO:teuthology.orchestra.run.smithi174.stdout: [ZIP] CHANGES.gz 2023-07-12T02:07:14.786 INFO:teuthology.orchestra.run.smithi174.stdout:Building debian 2023-07-12T02:07:14.794 INFO:teuthology.orchestra.run.smithi174.stdout:Building spaceman 2023-07-12T02:07:15.087 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] info.o 2023-07-12T02:07:15.196 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] init.o 2023-07-12T02:07:15.320 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] file.o 2023-07-12T02:07:15.443 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] health.o 2023-07-12T02:07:15.606 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] prealloc.o 2023-07-12T02:07:15.727 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] trim.o 2023-07-12T02:07:15.852 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] freesp.o 2023-07-12T02:07:16.032 INFO:teuthology.orchestra.run.smithi174.stdout: [LD] xfs_spaceman 2023-07-12T02:07:16.180 INFO:teuthology.orchestra.run.smithi174.stdout:Building scrub 2023-07-12T02:07:16.924 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] common.o 2023-07-12T02:07:17.061 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] counter.o 2023-07-12T02:07:17.134 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] descr.o 2023-07-12T02:07:17.221 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] disk.o 2023-07-12T02:07:17.344 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] filemap.o 2023-07-12T02:07:17.439 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] fscounters.o 2023-07-12T02:07:17.539 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] inodes.o 2023-07-12T02:07:17.690 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] phase1.o 2023-07-12T02:07:17.802 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] phase2.o 2023-07-12T02:07:17.908 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] phase3.o 2023-07-12T02:07:18.027 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] phase4.o 2023-07-12T02:07:18.130 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] phase5.o 2023-07-12T02:07:18.272 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] phase6.o 2023-07-12T02:07:18.456 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] phase7.o 2023-07-12T02:07:18.577 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] progress.o 2023-07-12T02:07:18.687 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] read_verify.o 2023-07-12T02:07:18.813 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] repair.o 2023-07-12T02:07:18.938 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] scrub.o 2023-07-12T02:07:19.141 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] spacemap.o 2023-07-12T02:07:19.259 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] vfs.o 2023-07-12T02:07:19.381 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] xfs_scrub.o 2023-07-12T02:07:19.571 INFO:teuthology.orchestra.run.smithi174.stdout: [CC] unicrash.o 2023-07-12T02:07:19.753 INFO:teuthology.orchestra.run.smithi174.stdout: [LD] xfs_scrub 2023-07-12T02:07:20.086 INFO:teuthology.orchestra.run.smithi174.stdout: [SED] xfs_scrub_all 2023-07-12T02:07:20.095 INFO:teuthology.orchestra.run.smithi174.stdout: [SED] xfs_scrub@.service 2023-07-12T02:07:20.102 INFO:teuthology.orchestra.run.smithi174.stdout: [SED] xfs_scrub_all.service 2023-07-12T02:07:20.110 INFO:teuthology.orchestra.run.smithi174.stdout: [SED] xfs_scrub_fail@.service 2023-07-12T02:07:20.117 INFO:teuthology.orchestra.run.smithi174.stdout: [SED] xfs_scrub_all.cron 2023-07-12T02:07:20.124 INFO:teuthology.orchestra.run.smithi174.stdout:Building po 2023-07-12T02:07:20.152 INFO:teuthology.orchestra.run.smithi174.stdout: [GETTXT] xfsprogs.pot 2023-07-12T02:07:20.349 INFO:teuthology.orchestra.run.smithi174.stdout: [MSGFMT] pl.mo 2023-07-12T02:07:20.400 INFO:teuthology.orchestra.run.smithi174.stderr:3104 translated messages. 2023-07-12T02:07:20.403 INFO:teuthology.orchestra.run.smithi174.stdout: [MSGFMT] de.mo 2023-07-12T02:07:20.439 INFO:teuthology.orchestra.run.smithi174.stderr:2345 translated messages. 2023-07-12T02:07:20.440 INFO:teuthology.orchestra.run.smithi174.stdout:gmake[2]: Nothing to be done for 'include'. 2023-07-12T02:07:20.444 DEBUG:teuthology.orchestra.run.smithi174:> (cd /tmp/tmp.MhsN8hlsQwxfsprogs-dev && exec sudo make install) 2023-07-12T02:07:20.525 INFO:teuthology.orchestra.run.smithi174.stdout:Installing libfrog-install 2023-07-12T02:07:20.973 INFO:teuthology.orchestra.run.smithi174.stdout:Installing libxfs-install 2023-07-12T02:07:21.256 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:07:21.258 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:07:21.260 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:07:22.669 INFO:teuthology.orchestra.run.smithi174.stdout:../install-sh -o root -g root -m 755 -d /usr/include/xfs 2023-07-12T02:07:22.694 INFO:teuthology.orchestra.run.smithi174.stdout:Installing libxlog-install 2023-07-12T02:07:22.787 INFO:teuthology.orchestra.run.smithi174.stdout:Installing libxcmd-install 2023-07-12T02:07:22.921 INFO:teuthology.orchestra.run.smithi174.stdout:Installing libhandle-install 2023-07-12T02:07:22.998 INFO:teuthology.orchestra.run.smithi174.stdout:cd ../libhandle/.libs; ../../install-sh -o root -g root -m 755 -d /lib64; ../../install-sh -o root -g root -m 755 -T so_dot_version libhandle.lai /lib64; ../../install-sh -o root -g root -T so_dot_current libhandle.lai /lib64 2023-07-12T02:07:23.089 INFO:teuthology.orchestra.run.smithi174.stdout:Installing copy-install 2023-07-12T02:07:23.141 INFO:teuthology.orchestra.run.smithi174.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-07-12T02:07:23.164 INFO:teuthology.orchestra.run.smithi174.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_copy /usr/sbin 2023-07-12T02:07:23.231 INFO:teuthology.orchestra.run.smithi174.stdout:Installing db-install 2023-07-12T02:07:25.282 INFO:teuthology.orchestra.run.smithi174.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-07-12T02:07:25.305 INFO:teuthology.orchestra.run.smithi174.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_db /usr/sbin 2023-07-12T02:07:25.376 INFO:teuthology.orchestra.run.smithi174.stdout:../install-sh -o root -g root -m 755 xfs_admin.sh /usr/sbin/xfs_admin 2023-07-12T02:07:25.399 INFO:teuthology.orchestra.run.smithi174.stdout:../install-sh -o root -g root -m 755 xfs_ncheck.sh /usr/sbin/xfs_ncheck 2023-07-12T02:07:25.422 INFO:teuthology.orchestra.run.smithi174.stdout:../install-sh -o root -g root -m 755 xfs_metadump.sh /usr/sbin/xfs_metadump 2023-07-12T02:07:25.447 INFO:teuthology.orchestra.run.smithi174.stdout:Installing estimate-install 2023-07-12T02:07:25.499 INFO:teuthology.orchestra.run.smithi174.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-07-12T02:07:25.522 INFO:teuthology.orchestra.run.smithi174.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_estimate /usr/sbin 2023-07-12T02:07:25.578 INFO:teuthology.orchestra.run.smithi174.stdout:Installing fsck-install 2023-07-12T02:07:25.581 INFO:teuthology.orchestra.run.smithi174.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-07-12T02:07:25.604 INFO:teuthology.orchestra.run.smithi174.stdout:../install-sh -o root -g root -m 755 xfs_fsck.sh /sbin/fsck.xfs 2023-07-12T02:07:25.630 INFO:teuthology.orchestra.run.smithi174.stdout:Installing fsr-install 2023-07-12T02:07:25.682 INFO:teuthology.orchestra.run.smithi174.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-07-12T02:07:25.705 INFO:teuthology.orchestra.run.smithi174.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_fsr /usr/sbin 2023-07-12T02:07:25.763 INFO:teuthology.orchestra.run.smithi174.stdout:Installing growfs-install 2023-07-12T02:07:25.815 INFO:teuthology.orchestra.run.smithi174.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-07-12T02:07:25.837 INFO:teuthology.orchestra.run.smithi174.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_growfs /usr/sbin 2023-07-12T02:07:25.904 INFO:teuthology.orchestra.run.smithi174.stdout:Installing io-install 2023-07-12T02:07:27.317 INFO:teuthology.orchestra.run.smithi174.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-07-12T02:07:27.340 INFO:teuthology.orchestra.run.smithi174.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_io /usr/sbin 2023-07-12T02:07:27.398 INFO:teuthology.orchestra.run.smithi174.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_bmap.sh /usr/sbin/xfs_bmap 2023-07-12T02:07:27.453 INFO:teuthology.orchestra.run.smithi174.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_freeze.sh /usr/sbin/xfs_freeze 2023-07-12T02:07:27.508 INFO:teuthology.orchestra.run.smithi174.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_mkfile.sh /usr/sbin/xfs_mkfile 2023-07-12T02:07:27.566 INFO:teuthology.orchestra.run.smithi174.stdout:Installing logprint-install 2023-07-12T02:07:27.847 INFO:teuthology.orchestra.run.smithi174.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-07-12T02:07:27.871 INFO:teuthology.orchestra.run.smithi174.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_logprint /usr/sbin 2023-07-12T02:07:27.938 INFO:teuthology.orchestra.run.smithi174.stdout:Installing mkfs-install 2023-07-12T02:07:28.031 INFO:teuthology.orchestra.run.smithi174.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-07-12T02:07:28.054 INFO:teuthology.orchestra.run.smithi174.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 mkfs.xfs /sbin 2023-07-12T02:07:28.118 INFO:teuthology.orchestra.run.smithi174.stdout:../install-sh -o root -g root -m 755 -d /usr/share/xfsprogs/mkfs 2023-07-12T02:07:28.141 INFO:teuthology.orchestra.run.smithi174.stdout:../install-sh -o root -g root -m 644 dax_x86_64.conf lts_4.19.conf lts_5.4.conf lts_5.10.conf lts_5.15.conf lts_6.1.conf /usr/share/xfsprogs/mkfs 2023-07-12T02:07:28.202 INFO:teuthology.orchestra.run.smithi174.stdout:Installing quota-install 2023-07-12T02:07:28.574 INFO:teuthology.orchestra.run.smithi174.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-07-12T02:07:28.596 INFO:teuthology.orchestra.run.smithi174.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_quota /usr/sbin 2023-07-12T02:07:28.654 INFO:teuthology.orchestra.run.smithi174.stdout:Installing mdrestore-install 2023-07-12T02:07:28.706 INFO:teuthology.orchestra.run.smithi174.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-07-12T02:07:28.728 INFO:teuthology.orchestra.run.smithi174.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_mdrestore /usr/sbin 2023-07-12T02:07:28.795 INFO:teuthology.orchestra.run.smithi174.stdout:Installing repair-install 2023-07-12T02:07:30.162 INFO:teuthology.orchestra.run.smithi174.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-07-12T02:07:30.185 INFO:teuthology.orchestra.run.smithi174.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_repair /sbin 2023-07-12T02:07:30.257 INFO:teuthology.orchestra.run.smithi174.stdout:Installing rtcp-install 2023-07-12T02:07:30.308 INFO:teuthology.orchestra.run.smithi174.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-07-12T02:07:30.331 INFO:teuthology.orchestra.run.smithi174.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_rtcp /usr/sbin 2023-07-12T02:07:30.388 INFO:teuthology.orchestra.run.smithi174.stdout:Installing m4-install 2023-07-12T02:07:30.391 INFO:teuthology.orchestra.run.smithi174.stdout:gmake[1]: Nothing to be done for 'install'. 2023-07-12T02:07:30.393 INFO:teuthology.orchestra.run.smithi174.stdout:Installing man-install 2023-07-12T02:07:30.401 INFO:teuthology.orchestra.run.smithi174.stdout:gmake[2]: Nothing to be done for 'install'. 2023-07-12T02:07:30.406 INFO:teuthology.orchestra.run.smithi174.stdout:gmake[2]: Nothing to be done for 'install'. 2023-07-12T02:07:30.414 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 755 -d /usr/share/man/man5 2023-07-12T02:07:30.443 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 projects.5 /usr/share/man/man5/projects.5 2023-07-12T02:07:30.472 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 projid.5 /usr/share/man/man5/projid.5 2023-07-12T02:07:30.500 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 xfs.5 /usr/share/man/man5/xfs.5 2023-07-12T02:07:30.534 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 755 -d /usr/share/man/man8 2023-07-12T02:07:30.563 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 fsck.xfs.8 /usr/share/man/man8/fsck.xfs.8 2023-07-12T02:07:30.591 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 mkfs.xfs.8 /usr/share/man/man8/mkfs.xfs.8 2023-07-12T02:07:30.620 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 xfs_admin.8 /usr/share/man/man8/xfs_admin.8 2023-07-12T02:07:30.648 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 xfs_bmap.8 /usr/share/man/man8/xfs_bmap.8 2023-07-12T02:07:30.677 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 xfs_copy.8 /usr/share/man/man8/xfs_copy.8 2023-07-12T02:07:30.705 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 xfs_db.8 /usr/share/man/man8/xfs_db.8 2023-07-12T02:07:30.734 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 xfs_estimate.8 /usr/share/man/man8/xfs_estimate.8 2023-07-12T02:07:30.762 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 xfs_freeze.8 /usr/share/man/man8/xfs_freeze.8 2023-07-12T02:07:30.790 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 xfs_fsr.8 /usr/share/man/man8/xfs_fsr.8 2023-07-12T02:07:30.819 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 xfs_growfs.8 /usr/share/man/man8/xfs_growfs.8 2023-07-12T02:07:30.847 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 xfs_info.8 /usr/share/man/man8/xfs_info.8 2023-07-12T02:07:30.876 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 xfs_io.8 /usr/share/man/man8/xfs_io.8 2023-07-12T02:07:30.904 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 xfs_logprint.8 /usr/share/man/man8/xfs_logprint.8 2023-07-12T02:07:30.933 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 xfs_mdrestore.8 /usr/share/man/man8/xfs_mdrestore.8 2023-07-12T02:07:30.962 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 xfs_metadump.8 /usr/share/man/man8/xfs_metadump.8 2023-07-12T02:07:30.990 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 xfs_mkfile.8 /usr/share/man/man8/xfs_mkfile.8 2023-07-12T02:07:31.018 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 xfs_ncheck.8 /usr/share/man/man8/xfs_ncheck.8 2023-07-12T02:07:31.047 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 xfs_quota.8 /usr/share/man/man8/xfs_quota.8 2023-07-12T02:07:31.076 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 xfs_repair.8 /usr/share/man/man8/xfs_repair.8 2023-07-12T02:07:31.104 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 xfs_rtcp.8 /usr/share/man/man8/xfs_rtcp.8 2023-07-12T02:07:31.132 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 xfs_scrub.8 /usr/share/man/man8/xfs_scrub.8 2023-07-12T02:07:31.161 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 xfs_scrub_all.8 /usr/share/man/man8/xfs_scrub_all.8 2023-07-12T02:07:31.189 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 xfs_spaceman.8 /usr/share/man/man8/xfs_spaceman.8 2023-07-12T02:07:31.217 INFO:teuthology.orchestra.run.smithi174.stdout:../../install-sh -o root -g root -m 644 mkfs.xfs.8 /usr/share/man/man8/mkfs.xfs.8 2023-07-12T02:07:31.244 INFO:teuthology.orchestra.run.smithi174.stdout:Installing doc-install 2023-07-12T02:07:31.247 INFO:teuthology.orchestra.run.smithi174.stdout:../install-sh -o root -g root -m 755 -d /usr/share/doc/xfsprogs 2023-07-12T02:07:31.270 INFO:teuthology.orchestra.run.smithi174.stdout:../install-sh -o root -g root -m 644 CHANGES.gz CREDITS /usr/share/doc/xfsprogs 2023-07-12T02:07:31.303 INFO:teuthology.orchestra.run.smithi174.stdout:Installing debian-install 2023-07-12T02:07:31.306 INFO:teuthology.orchestra.run.smithi174.stdout:gmake[1]: Nothing to be done for 'install'. 2023-07-12T02:07:31.308 INFO:teuthology.orchestra.run.smithi174.stdout:Installing spaceman-install 2023-07-12T02:07:31.593 INFO:teuthology.orchestra.run.smithi174.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-07-12T02:07:31.615 INFO:teuthology.orchestra.run.smithi174.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_spaceman /usr/sbin 2023-07-12T02:07:31.671 INFO:teuthology.orchestra.run.smithi174.stdout:../install-sh -o root -g root -m 755 xfs_info.sh /usr/sbin/xfs_info 2023-07-12T02:07:31.696 INFO:teuthology.orchestra.run.smithi174.stdout:Installing scrub-install 2023-07-12T02:07:32.433 INFO:teuthology.orchestra.run.smithi174.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-07-12T02:07:32.455 INFO:teuthology.orchestra.run.smithi174.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_scrub /usr/sbin 2023-07-12T02:07:32.512 INFO:teuthology.orchestra.run.smithi174.stdout:../install-sh -o root -g root -m 755 xfs_scrub_all /usr/sbin 2023-07-12T02:07:32.535 INFO:teuthology.orchestra.run.smithi174.stdout:../install-sh -o root -g root -m 755 -d /usr/lib/systemd/system 2023-07-12T02:07:32.558 INFO:teuthology.orchestra.run.smithi174.stdout:../install-sh -o root -g root -m 644 xfs_scrub@.service xfs_scrub_all.service xfs_scrub_all.timer xfs_scrub_fail@.service /usr/lib/systemd/system 2023-07-12T02:07:32.602 INFO:teuthology.orchestra.run.smithi174.stdout:../install-sh -o root -g root -m 755 -d /usr/lib64/xfsprogs 2023-07-12T02:07:32.625 INFO:teuthology.orchestra.run.smithi174.stdout:../install-sh -o root -g root -m 755 xfs_scrub_fail /usr/lib64/xfsprogs 2023-07-12T02:07:32.648 INFO:teuthology.orchestra.run.smithi174.stdout:../install-sh -o root -g root -m 755 -d /usr/lib64/xfsprogs 2023-07-12T02:07:32.671 INFO:teuthology.orchestra.run.smithi174.stdout:../install-sh -o root -g root -m 644 xfs_scrub_all.cron /usr/lib64/xfsprogs 2023-07-12T02:07:32.696 INFO:teuthology.orchestra.run.smithi174.stdout:Installing po-install 2023-07-12T02:07:32.808 INFO:teuthology.orchestra.run.smithi174.stdout:Installing include-install 2023-07-12T02:07:32.811 INFO:teuthology.orchestra.run.smithi174.stdout:../install-sh -o root -g root -m 755 -d /usr/include/xfs 2023-07-12T02:07:32.834 INFO:teuthology.orchestra.run.smithi174.stdout:./install-sh -o root -g root -m 755 -d /usr/share/doc/xfsprogs 2023-07-12T02:07:32.857 INFO:teuthology.orchestra.run.smithi174.stdout:./install-sh -o root -g root -m 644 README /usr/share/doc/xfsprogs 2023-07-12T02:07:32.883 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-07-12T02:07:33.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.021+0000 7f994c5c2700 1 Processor -- start 2023-07-12T02:07:33.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.021+0000 7f994c5c2700 1 -- start start 2023-07-12T02:07:33.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.022+0000 7f994c5c2700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9944071910 0x7f994414b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:07:33.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.022+0000 7f994c5c2700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f994406bce0 0x7f99441551e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:07:33.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.022+0000 7f994c5c2700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9944070130 con 0x7f9944070da0 2023-07-12T02:07:33.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.022+0000 7f994c5c2700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9944071540 con 0x7f994406bce0 2023-07-12T02:07:33.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.022+0000 7f994c5c2700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f994406ced0 con 0x7f9944071910 2023-07-12T02:07:33.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.022+0000 7f994a35e700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9944071910 0x7f994414b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:07:33.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.022+0000 7f994ab5f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f994406bce0 0x7f99441551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:07:33.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.022+0000 7f9949b5d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f9944070da0 0x7f994406c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.60:35910/0 (socket says 172.21.15.60:35910) 2023-07-12T02:07:33.027 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.022+0000 7f9949b5d700 1 -- 172.21.15.60:0/3401558563 learned_addr learned my addr 172.21.15.60:0/3401558563 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:07:33.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.022+0000 7f994935c700 1 -- 172.21.15.60:0/3401558563 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2859877688 0 0) 0x7f9944070130 con 0x7f9944070da0 2023-07-12T02:07:33.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.023+0000 7f994935c700 1 -- 172.21.15.60:0/3401558563 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99300035b0 con 0x7f9944070da0 2023-07-12T02:07:33.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.023+0000 7f994a35e700 1 -- 172.21.15.60:0/3401558563 >> v2:172.21.15.79:3300/0 conn(0x7f994406bce0 msgr2=0x7f99441551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:07:33.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.023+0000 7f994a35e700 1 --2- 172.21.15.60:0/3401558563 >> v2:172.21.15.79:3300/0 conn(0x7f994406bce0 0x7f99441551e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:07:33.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.023+0000 7f994a35e700 1 -- 172.21.15.60:0/3401558563 >> v1:172.21.15.79:6789/0 conn(0x7f9944070da0 legacy=0x7f994406c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:07:33.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.023+0000 7f994a35e700 1 -- 172.21.15.60:0/3401558563 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9944071260 con 0x7f9944071910 2023-07-12T02:07:33.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.023+0000 7f994ab5f700 1 --2- 172.21.15.60:0/3401558563 >> v2:172.21.15.79:3300/0 conn(0x7f994406bce0 0x7f99441551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-12T02:07:33.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.023+0000 7f994a35e700 1 --2- 172.21.15.60:0/3401558563 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9944071910 0x7f994414b260 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9938009840 tx=0x7f9938009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b6c6228e391c5d2 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:07:33.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.023+0000 7f994935c700 1 -- 172.21.15.60:0/3401558563 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9938011830 con 0x7f9944071910 2023-07-12T02:07:33.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.023+0000 7f994935c700 1 -- 172.21.15.60:0/3401558563 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9938011990 con 0x7f9944071910 2023-07-12T02:07:33.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.023+0000 7f994935c700 1 -- 172.21.15.60:0/3401558563 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9938011d20 con 0x7f9944071910 2023-07-12T02:07:33.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.023+0000 7f994c5c2700 1 -- 172.21.15.60:0/3401558563 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9944071910 msgr2=0x7f994414b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:07:33.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.023+0000 7f994c5c2700 1 --2- 172.21.15.60:0/3401558563 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9944071910 0x7f994414b260 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9938009840 tx=0x7f9938009b50 comp rx=0 tx=0).stop 2023-07-12T02:07:33.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.024+0000 7f994c5c2700 1 -- 172.21.15.60:0/3401558563 shutdown_connections 2023-07-12T02:07:33.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.024+0000 7f994c5c2700 1 --2- 172.21.15.60:0/3401558563 >> v2:172.21.15.79:3300/0 conn(0x7f994406bce0 0x7f99441551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:07:33.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.024+0000 7f994c5c2700 1 --2- 172.21.15.60:0/3401558563 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9944071910 0x7f994414b260 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:07:33.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.024+0000 7f994c5c2700 1 -- 172.21.15.60:0/3401558563 >> 172.21.15.60:0/3401558563 conn(0x7f99440be670 msgr2=0x7f99440bea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:07:33.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.024+0000 7f994c5c2700 1 -- 172.21.15.60:0/3401558563 shutdown_connections 2023-07-12T02:07:33.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.024+0000 7f994c5c2700 1 -- 172.21.15.60:0/3401558563 wait complete. 2023-07-12T02:07:33.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.025+0000 7f994c5c2700 1 Processor -- start 2023-07-12T02:07:33.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.025+0000 7f994c5c2700 1 -- start start 2023-07-12T02:07:33.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.025+0000 7f994c5c2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f994406bce0 0x7f99440b9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:07:33.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.025+0000 7f994c5c2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9944070da0 0x7f99441dfd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:07:33.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.025+0000 7f994c5c2700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9944071910 0x7f99440b0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:07:33.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.025+0000 7f994c5c2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99440ba1e0 con 0x7f994406bce0 2023-07-12T02:07:33.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.025+0000 7f994c5c2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99440b4790 con 0x7f9944070da0 2023-07-12T02:07:33.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.025+0000 7f994c5c2700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99440b43e0 con 0x7f9944071910 2023-07-12T02:07:33.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.025+0000 7f994a35e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f994406bce0 0x7f99440b9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:07:33.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.026+0000 7f994a35e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f994406bce0 0x7f99440b9ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55634/0 (socket says 172.21.15.60:55634) 2023-07-12T02:07:33.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.026+0000 7f994a35e700 1 -- 172.21.15.60:0/869378714 learned_addr learned my addr 172.21.15.60:0/869378714 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:07:33.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.026+0000 7f994ab5f700 1 --2- 172.21.15.60:0/869378714 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9944071910 0x7f99440b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:07:33.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.026+0000 7f9949b5d700 1 --2- 172.21.15.60:0/869378714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9944070da0 0x7f99441dfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:07:33.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.026+0000 7f994a35e700 1 -- 172.21.15.60:0/869378714 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9944071910 msgr2=0x7f99440b0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:07:33.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.026+0000 7f994a35e700 1 --2- 172.21.15.60:0/869378714 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9944071910 0x7f99440b0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:07:33.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.026+0000 7f994a35e700 1 -- 172.21.15.60:0/869378714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9944070da0 msgr2=0x7f99441dfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:07:33.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.026+0000 7f994a35e700 1 --2- 172.21.15.60:0/869378714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9944070da0 0x7f99441dfd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:07:33.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.026+0000 7f994a35e700 1 -- 172.21.15.60:0/869378714 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f993c009a70 con 0x7f994406bce0 2023-07-12T02:07:33.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.026+0000 7f994a35e700 1 --2- 172.21.15.60:0/869378714 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f994406bce0 0x7f99440b9ca0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9938014040 tx=0x7f9938004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:07:33.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.026+0000 7f9936ffd700 1 -- 172.21.15.60:0/869378714 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99380038a0 con 0x7f994406bce0 2023-07-12T02:07:33.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.026+0000 7f9936ffd700 1 -- 172.21.15.60:0/869378714 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993801f070 con 0x7f994406bce0 2023-07-12T02:07:33.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.026+0000 7f994c5c2700 1 -- 172.21.15.60:0/869378714 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99380094a0 con 0x7f994406bce0 2023-07-12T02:07:33.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.026+0000 7f9936ffd700 1 -- 172.21.15.60:0/869378714 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9938003c00 con 0x7f994406bce0 2023-07-12T02:07:33.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.026+0000 7f994c5c2700 1 -- 172.21.15.60:0/869378714 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99441e3470 con 0x7f994406bce0 2023-07-12T02:07:33.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.027+0000 7f994c5c2700 1 -- 172.21.15.60:0/869378714 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99440b5460 con 0x7f994406bce0 2023-07-12T02:07:33.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.028+0000 7f9936ffd700 1 -- 172.21.15.60:0/869378714 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f993801a430 con 0x7f994406bce0 2023-07-12T02:07:33.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.028+0000 7f9936ffd700 1 --2- 172.21.15.60:0/869378714 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f992806ace0 0x7f992806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:07:33.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.028+0000 7f9936ffd700 1 -- 172.21.15.60:0/869378714 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f9938021070 con 0x7f994406bce0 2023-07-12T02:07:33.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.028+0000 7f9949b5d700 1 --2- 172.21.15.60:0/869378714 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f992806ace0 0x7f992806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:07:33.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.029+0000 7f9949b5d700 1 --2- 172.21.15.60:0/869378714 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f992806ace0 0x7f992806d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f99440b5650 tx=0x7f9940009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:07:33.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.033+0000 7f9936ffd700 1 -- 172.21.15.60:0/869378714 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f9938055d80 con 0x7f994406bce0 2023-07-12T02:07:33.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.314+0000 7f994c5c2700 1 -- 172.21.15.60:0/869378714 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f9944074360 con 0x7f994406bce0 2023-07-12T02:07:33.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.314+0000 7f9936ffd700 1 -- 172.21.15.60:0/869378714 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1268 (secure 0 0 0) 0x7f9938015090 con 0x7f994406bce0 2023-07-12T02:07:33.319 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:07:33.319 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":1,"fsid":"97e7c909-e567-472e-a5aa-72fde15171f2","modified":"2023-07-12T02:01:21.993079Z","created":"2023-07-12T02:01:21.993079Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:3300","nonce":0},{"type":"v1","addr":"172.21.15.79:6789","nonce":0}]},"addr":"172.21.15.79:6789/0","public_addr":"172.21.15.79:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:3301","nonce":0},{"type":"v1","addr":"172.21.15.79:6790","nonce":0}]},"addr":"172.21.15.79:6790/0","public_addr":"172.21.15.79:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-07-12T02:07:33.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.316+0000 7f994c5c2700 1 -- 172.21.15.60:0/869378714 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f992806ace0 msgr2=0x7f992806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:07:33.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.316+0000 7f994c5c2700 1 --2- 172.21.15.60:0/869378714 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f992806ace0 0x7f992806d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f99440b5650 tx=0x7f9940009040 comp rx=0 tx=0).stop 2023-07-12T02:07:33.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.316+0000 7f994c5c2700 1 -- 172.21.15.60:0/869378714 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f994406bce0 msgr2=0x7f99440b9ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:07:33.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.316+0000 7f994c5c2700 1 --2- 172.21.15.60:0/869378714 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f994406bce0 0x7f99440b9ca0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9938014040 tx=0x7f9938004750 comp rx=0 tx=0).stop 2023-07-12T02:07:33.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.316+0000 7f994c5c2700 1 -- 172.21.15.60:0/869378714 shutdown_connections 2023-07-12T02:07:33.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.316+0000 7f994c5c2700 1 --2- 172.21.15.60:0/869378714 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f992806ace0 0x7f992806d190 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:07:33.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.316+0000 7f994c5c2700 1 --2- 172.21.15.60:0/869378714 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f994406bce0 0x7f99440b9ca0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:07:33.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.316+0000 7f994c5c2700 1 --2- 172.21.15.60:0/869378714 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9944071910 0x7f99440b0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:07:33.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.316+0000 7f994c5c2700 1 --2- 172.21.15.60:0/869378714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9944070da0 0x7f99441dfd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:07:33.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.316+0000 7f994c5c2700 1 -- 172.21.15.60:0/869378714 >> 172.21.15.60:0/869378714 conn(0x7f99440be670 msgr2=0x7f99441496c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:07:33.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.316+0000 7f994c5c2700 1 -- 172.21.15.60:0/869378714 shutdown_connections 2023-07-12T02:07:33.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.316+0000 7f994c5c2700 1 -- 172.21.15.60:0/869378714 wait complete. 2023-07-12T02:07:33.322 INFO:teuthology.orchestra.run.smithi060.stderr:dumped monmap epoch 1 2023-07-12T02:07:33.332 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-07-12T02:07:33.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.455+0000 7eff2007f700 1 Processor -- start 2023-07-12T02:07:33.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.455+0000 7eff2007f700 1 -- start start 2023-07-12T02:07:33.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.456+0000 7eff2007f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7eff180bc810 0x7eff180ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:07:33.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.456+0000 7eff2007f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7eff180b8d90 0x7eff1806ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:07:33.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.456+0000 7eff2007f700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff180b8620 con 0x7eff181449d0 2023-07-12T02:07:33.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.456+0000 7eff2007f700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff180b97a0 con 0x7eff180bc810 2023-07-12T02:07:33.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.456+0000 7eff2007f700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff18144da0 con 0x7eff180b8d90 2023-07-12T02:07:33.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.456+0000 7eff1d61a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7eff180bc810 0x7eff180ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:07:33.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.456+0000 7eff1de1b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7eff181449d0 0x7eff1814db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:39638/0 (socket says 172.21.15.60:39638) 2023-07-12T02:07:33.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.456+0000 7eff1de1b700 1 -- 172.21.15.60:0/3527115750 learned_addr learned my addr 172.21.15.60:0/3527115750 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:07:33.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.456+0000 7eff1e61c700 1 --2- 172.21.15.60:0/3527115750 >> v2:172.21.15.79:3300/0 conn(0x7eff180b8d90 0x7eff1806ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:07:33.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.456+0000 7eff1d61a700 1 -- 172.21.15.60:0/3527115750 >> v2:172.21.15.79:3300/0 conn(0x7eff180b8d90 msgr2=0x7eff1806ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:07:33.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.456+0000 7eff1d61a700 1 --2- 172.21.15.60:0/3527115750 >> v2:172.21.15.79:3300/0 conn(0x7eff180b8d90 0x7eff1806ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:07:33.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.456+0000 7eff1d61a700 1 -- 172.21.15.60:0/3527115750 >> v1:172.21.15.60:6789/0 conn(0x7eff181449d0 legacy=0x7eff1814db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:07:33.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.456+0000 7eff1d61a700 1 -- 172.21.15.60:0/3527115750 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff180b8900 con 0x7eff180bc810 2023-07-12T02:07:33.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.456+0000 7eff1ce19700 1 -- 172.21.15.60:0/3527115750 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3742406395 0 0) 0x7eff180b8620 con 0x7eff181449d0 2023-07-12T02:07:33.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.456+0000 7eff1e61c700 1 --2- 172.21.15.60:0/3527115750 >> v2:172.21.15.79:3300/0 conn(0x7eff180b8d90 0x7eff1806ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:07:33.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.457+0000 7eff1d61a700 1 --2- 172.21.15.60:0/3527115750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff180bc810 0x7eff180ba530 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7eff180be710 tx=0x7eff14009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=941ab20bf8d5feee server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:07:33.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.457+0000 7eff1ce19700 1 -- 172.21.15.60:0/3527115750 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff14011830 con 0x7eff180bc810 2023-07-12T02:07:33.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.457+0000 7eff1ce19700 1 -- 172.21.15.60:0/3527115750 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff14011990 con 0x7eff180bc810 2023-07-12T02:07:33.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.457+0000 7eff1ce19700 1 -- 172.21.15.60:0/3527115750 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff14011d20 con 0x7eff180bc810 2023-07-12T02:07:33.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.457+0000 7eff2007f700 1 -- 172.21.15.60:0/3527115750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff180bc810 msgr2=0x7eff180ba530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:07:33.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.457+0000 7eff2007f700 1 --2- 172.21.15.60:0/3527115750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff180bc810 0x7eff180ba530 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7eff180be710 tx=0x7eff14009b20 comp rx=0 tx=0).stop 2023-07-12T02:07:33.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.457+0000 7eff2007f700 1 -- 172.21.15.60:0/3527115750 shutdown_connections 2023-07-12T02:07:33.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.457+0000 7eff2007f700 1 --2- 172.21.15.60:0/3527115750 >> v2:172.21.15.79:3300/0 conn(0x7eff180b8d90 0x7eff1806ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:07:33.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.457+0000 7eff2007f700 1 --2- 172.21.15.60:0/3527115750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff180bc810 0x7eff180ba530 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:07:33.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.457+0000 7eff2007f700 1 -- 172.21.15.60:0/3527115750 >> 172.21.15.60:0/3527115750 conn(0x7eff180c0860 msgr2=0x7eff180c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:07:33.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.457+0000 7eff2007f700 1 -- 172.21.15.60:0/3527115750 shutdown_connections 2023-07-12T02:07:33.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.457+0000 7eff2007f700 1 -- 172.21.15.60:0/3527115750 wait complete. 2023-07-12T02:07:33.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.458+0000 7eff2007f700 1 Processor -- start 2023-07-12T02:07:33.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.458+0000 7eff2007f700 1 -- start start 2023-07-12T02:07:33.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.459+0000 7eff2007f700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7eff180b8d90 0x7eff1814a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:07:33.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.459+0000 7eff2007f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff180bc810 0x7eff18149d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:07:33.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.459+0000 7eff2007f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff181449d0 0x7eff1814d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:07:33.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.459+0000 7eff2007f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1814add0 con 0x7eff180bc810 2023-07-12T02:07:33.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.459+0000 7eff2007f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff18148ce0 con 0x7eff181449d0 2023-07-12T02:07:33.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.459+0000 7eff2007f700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff18149850 con 0x7eff180b8d90 2023-07-12T02:07:33.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.459+0000 7eff1d61a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff180bc810 0x7eff18149d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:07:33.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.459+0000 7eff1d61a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff180bc810 0x7eff18149d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55646/0 (socket says 172.21.15.60:55646) 2023-07-12T02:07:33.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.459+0000 7eff1d61a700 1 -- 172.21.15.60:0/4217331213 learned_addr learned my addr 172.21.15.60:0/4217331213 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:07:33.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.459+0000 7eff1e61c700 1 --2- 172.21.15.60:0/4217331213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff181449d0 0x7eff1814d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:07:33.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.459+0000 7eff1de1b700 1 --2- 172.21.15.60:0/4217331213 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7eff180b8d90 0x7eff1814a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:07:33.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.459+0000 7eff1d61a700 1 -- 172.21.15.60:0/4217331213 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7eff180b8d90 msgr2=0x7eff1814a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:07:33.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.459+0000 7eff1d61a700 1 --2- 172.21.15.60:0/4217331213 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7eff180b8d90 0x7eff1814a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:07:33.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.459+0000 7eff1d61a700 1 -- 172.21.15.60:0/4217331213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff181449d0 msgr2=0x7eff1814d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:07:33.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.459+0000 7eff1d61a700 1 --2- 172.21.15.60:0/4217331213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff181449d0 0x7eff1814d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:07:33.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.459+0000 7eff1d61a700 1 -- 172.21.15.60:0/4217331213 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff140094a0 con 0x7eff180bc810 2023-07-12T02:07:33.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.459+0000 7eff1e61c700 1 --2- 172.21.15.60:0/4217331213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff181449d0 0x7eff1814d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-12T02:07:33.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.460+0000 7eff1d61a700 1 --2- 172.21.15.60:0/4217331213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff180bc810 0x7eff18149d30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7eff14000c00 tx=0x7eff14004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:07:33.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.460+0000 7eff0e7fc700 1 -- 172.21.15.60:0/4217331213 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff140036a0 con 0x7eff180bc810 2023-07-12T02:07:33.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.460+0000 7eff0e7fc700 1 -- 172.21.15.60:0/4217331213 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1401f070 con 0x7eff180bc810 2023-07-12T02:07:33.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.460+0000 7eff2007f700 1 -- 172.21.15.60:0/4217331213 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff1814b050 con 0x7eff180bc810 2023-07-12T02:07:33.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.460+0000 7eff0e7fc700 1 -- 172.21.15.60:0/4217331213 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff14003a60 con 0x7eff180bc810 2023-07-12T02:07:33.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.460+0000 7eff2007f700 1 -- 172.21.15.60:0/4217331213 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff18148f80 con 0x7eff180bc810 2023-07-12T02:07:33.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.461+0000 7eff2007f700 1 -- 172.21.15.60:0/4217331213 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff180bfe80 con 0x7eff180bc810 2023-07-12T02:07:33.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.461+0000 7eff0e7fc700 1 -- 172.21.15.60:0/4217331213 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7eff14003bc0 con 0x7eff180bc810 2023-07-12T02:07:33.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.462+0000 7eff0e7fc700 1 --2- 172.21.15.60:0/4217331213 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7efefc06ace0 0x7efefc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:07:33.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.462+0000 7eff0e7fc700 1 -- 172.21.15.60:0/4217331213 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6091+0+0 (secure 0 0 0) 0x7eff14021070 con 0x7eff180bc810 2023-07-12T02:07:33.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.462+0000 7eff1de1b700 1 --2- 172.21.15.60:0/4217331213 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7efefc06ace0 0x7efefc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:07:33.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.462+0000 7eff1de1b700 1 --2- 172.21.15.60:0/4217331213 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7efefc06ace0 0x7efefc06d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7eff08000f60 tx=0x7eff08007c90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:07:33.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.466+0000 7eff0e7fc700 1 -- 172.21.15.60:0/4217331213 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7eff14055f60 con 0x7eff180bc810 2023-07-12T02:07:33.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.748+0000 7eff2007f700 1 -- 172.21.15.60:0/4217331213 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7eff18074360 con 0x7eff180bc810 2023-07-12T02:07:33.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.748+0000 7eff0e7fc700 1 -- 172.21.15.60:0/4217331213 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v15) v1 ==== 92+0+63 (secure 0 0 0) 0x7eff14015050 con 0x7eff180bc810 2023-07-12T02:07:33.753 INFO:teuthology.orchestra.run.smithi060.stdout:[client.admin] 2023-07-12T02:07:33.753 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQByCa5ke/CcDxAAY+pvZk+ZKWFzmiAdhJKT1w== 2023-07-12T02:07:33.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.750+0000 7eff2007f700 1 -- 172.21.15.60:0/4217331213 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7efefc06ace0 msgr2=0x7efefc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:07:33.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.750+0000 7eff2007f700 1 --2- 172.21.15.60:0/4217331213 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7efefc06ace0 0x7efefc06d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7eff08000f60 tx=0x7eff08007c90 comp rx=0 tx=0).stop 2023-07-12T02:07:33.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.750+0000 7eff2007f700 1 -- 172.21.15.60:0/4217331213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff180bc810 msgr2=0x7eff18149d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:07:33.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.750+0000 7eff2007f700 1 --2- 172.21.15.60:0/4217331213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff180bc810 0x7eff18149d30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7eff14000c00 tx=0x7eff14004750 comp rx=0 tx=0).stop 2023-07-12T02:07:33.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.750+0000 7eff2007f700 1 -- 172.21.15.60:0/4217331213 shutdown_connections 2023-07-12T02:07:33.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.750+0000 7eff2007f700 1 --2- 172.21.15.60:0/4217331213 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7efefc06ace0 0x7efefc06d190 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:07:33.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.750+0000 7eff2007f700 1 --2- 172.21.15.60:0/4217331213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff181449d0 0x7eff1814d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:07:33.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.750+0000 7eff2007f700 1 --2- 172.21.15.60:0/4217331213 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7eff180b8d90 0x7eff1814a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:07:33.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.750+0000 7eff2007f700 1 --2- 172.21.15.60:0/4217331213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff180bc810 0x7eff18149d30 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:07:33.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.750+0000 7eff2007f700 1 -- 172.21.15.60:0/4217331213 >> 172.21.15.60:0/4217331213 conn(0x7eff180c0860 msgr2=0x7eff180bf770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:07:33.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.750+0000 7eff2007f700 1 -- 172.21.15.60:0/4217331213 shutdown_connections 2023-07-12T02:07:33.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:07:33.750+0000 7eff2007f700 1 -- 172.21.15.60:0/4217331213 wait complete. 2023-07-12T02:07:33.766 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-07-12T02:07:33.767 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/tmp/tmp.CBamI6wQNAxfstests-dev/local.config 2023-07-12T02:07:33.842 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.60:6789:/test export TEST_DIR=/tmp/tmp.bp3K5ctJhDtest export SCRATCH_DEV=172.21.15.60:6789:/scratch export SCRATCH_MNT=/tmp/tmp.3EzHOaP1bIscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQByCa5ke/CcDxAAY+pvZk+ZKWFzmiAdhJKT1w==,test_dummy_encryption" 2023-07-12T02:07:33.842 INFO:teuthology.orchestra.run:Running command with timeout 10800 2023-07-12T02:07:33.842 DEBUG:teuthology.orchestra.run.smithi174:running tests for dummy_encryption from xfstests-dev> (cd /tmp/tmp.CBamI6wQNAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check -g quick -E ./ceph.exclude) 2023-07-12T02:07:35.684 INFO:teuthology.orchestra.run.smithi174.stdout:FSTYP -- ceph 2023-07-12T02:07:35.696 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM -- Linux/x86_64 smithi174 6.4.0-g84139c18d56f #1 SMP PREEMPT_DYNAMIC Fri Jun 30 10:58:11 UTC 2023 2023-07-12T02:07:35.697 INFO:teuthology.orchestra.run.smithi174.stdout:MKFS_OPTIONS -- 172.21.15.60:6789:/scratch 2023-07-12T02:07:35.700 INFO:teuthology.orchestra.run.smithi174.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQByCa5ke/CcDxAAY+pvZk+ZKWFzmiAdhJKT1w==,test_dummy_encryption -o context=system_u:object_r:root_t:s0 172.21.15.60:6789:/scratch /tmp/tmp.3EzHOaP1bIscratch 2023-07-12T02:07:35.700 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-07-12T02:07:35.909 INFO:teuthology.orchestra.run.smithi174.stdout:ceph/001 [expunged] 2023-07-12T02:07:36.277 INFO:teuthology.orchestra.run.smithi174.stdout:ceph/002 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-07-12T02:07:36.628 INFO:teuthology.orchestra.run.smithi174.stdout:ceph/003 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-07-12T02:07:37.083 INFO:teuthology.orchestra.run.smithi174.stdout:ceph/004 1s 2023-07-12T02:07:37.401 INFO:teuthology.orchestra.run.smithi174.stdout:ceph/005 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-07-12T02:07:44.788 INFO:teuthology.orchestra.run.smithi174.stdout:generic/001 7s 2023-07-12T02:07:45.443 INFO:teuthology.orchestra.run.smithi174.stdout:generic/002 1s 2023-07-12T02:07:45.463 INFO:teuthology.orchestra.run.smithi174.stdout:generic/003 [expunged] 2023-07-12T02:07:45.794 INFO:teuthology.orchestra.run.smithi174.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-07-12T02:07:46.418 INFO:teuthology.orchestra.run.smithi174.stdout:generic/005 1s 2023-07-12T02:07:51.356 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:07:51.358 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:07:51.361 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:08:11.145 INFO:teuthology.orchestra.run.smithi174.stdout:generic/006 25s 2023-07-12T02:08:21.523 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:08:21.525 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:08:21.527 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:08:51.820 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:08:51.823 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:08:51.825 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:09:02.795 INFO:teuthology.orchestra.run.smithi174.stdout:generic/007 51s 2023-07-12T02:09:05.536 INFO:teuthology.orchestra.run.smithi174.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-07-12T02:09:07.508 INFO:teuthology.orchestra.run.smithi174.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-07-12T02:09:22.017 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:09:22.019 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:09:22.022 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:09:39.703 INFO:teuthology.orchestra.run.smithi174.stdout:generic/011 32s 2023-07-12T02:09:41.723 INFO:teuthology.orchestra.run.smithi174.stdout:generic/012 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-07-12T02:09:52.392 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:09:52.394 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:09:52.396 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:10:22.543 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:10:22.546 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:10:22.548 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:10:52.661 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:10:52.663 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:10:52.666 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:10:53.033 INFO:tasks.ceph.mds.a.smithi060.stderr:2023-07-12T02:10:53.029+0000 7fb6786e1700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 159192) UID: 0 2023-07-12T02:10:53.034 INFO:tasks.ceph.mds.c.smithi060.stderr:2023-07-12T02:10:53.029+0000 7f9891307700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 159192) UID: 0 2023-07-12T02:11:16.844 INFO:teuthology.orchestra.run.smithi174.stdout:generic/013 95s 2023-07-12T02:13:36.975 INFO:teuthology.orchestra.run.smithi174.stdout:generic/014 140s 2023-07-12T02:13:37.295 INFO:teuthology.orchestra.run.smithi174.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-12T02:13:42.262 INFO:teuthology.orchestra.run.smithi174.stdout:generic/016 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-07-12T02:13:42.742 INFO:teuthology.orchestra.run.smithi174.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2023-07-12T02:13:47.834 INFO:teuthology.orchestra.run.smithi174.stdout:generic/020 5s 2023-07-12T02:13:52.630 INFO:teuthology.orchestra.run.smithi174.stdout:generic/021 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-07-12T02:13:59.738 INFO:teuthology.orchestra.run.smithi174.stdout:generic/022 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-07-12T02:14:25.738 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:14:25.741 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:14:25.743 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:14:46.797 INFO:teuthology.orchestra.run.smithi174.stdout:generic/023 47s 2023-07-12T02:14:47.136 INFO:teuthology.orchestra.run.smithi174.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-07-12T02:14:47.483 INFO:teuthology.orchestra.run.smithi174.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-07-12T02:14:47.878 INFO:teuthology.orchestra.run.smithi174.stdout:generic/026 [not run] ceph does not define maximum ACL count 2023-07-12T02:14:53.234 INFO:teuthology.orchestra.run.smithi174.stdout:generic/028 6s 2023-07-12T02:14:54.423 INFO:teuthology.orchestra.run.smithi174.stdout:generic/029 1s 2023-07-12T02:14:55.929 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:14:55.931 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:14:55.933 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:15:03.449 INFO:teuthology.orchestra.run.smithi174.stdout:generic/030 9s 2023-07-12T02:15:07.516 INFO:teuthology.orchestra.run.smithi174.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-07-12T02:15:07.848 INFO:teuthology.orchestra.run.smithi174.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-12T02:15:12.817 INFO:teuthology.orchestra.run.smithi174.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-07-12T02:15:13.165 INFO:teuthology.orchestra.run.smithi174.stdout:generic/034 [not run] require 172.21.15.60:6789:/scratch to be valid block disk 2023-07-12T02:15:13.578 INFO:teuthology.orchestra.run.smithi174.stdout:generic/035 0s 2023-07-12T02:15:20.657 INFO:teuthology.orchestra.run.smithi174.stdout:generic/037 7s 2023-07-12T02:15:21.087 INFO:teuthology.orchestra.run.smithi174.stdout:generic/039 [not run] require 172.21.15.60:6789:/scratch to be valid block disk 2023-07-12T02:15:21.448 INFO:teuthology.orchestra.run.smithi174.stdout:generic/040 [not run] require 172.21.15.60:6789:/scratch to be valid block disk 2023-07-12T02:15:21.805 INFO:teuthology.orchestra.run.smithi174.stdout:generic/041 [not run] require 172.21.15.60:6789:/scratch to be valid block disk 2023-07-12T02:15:22.289 INFO:teuthology.orchestra.run.smithi174.stdout:generic/042 [not run] ceph does not support shutdown 2023-07-12T02:15:22.790 INFO:teuthology.orchestra.run.smithi174.stdout:generic/050 [not run] ceph does not support shutdown 2023-07-12T02:15:23.297 INFO:teuthology.orchestra.run.smithi174.stdout:generic/052 [not run] ceph does not support shutdown 2023-07-12T02:15:24.315 INFO:teuthology.orchestra.run.smithi174.stdout:generic/053 1s 2023-07-12T02:15:24.739 INFO:teuthology.orchestra.run.smithi174.stdout:generic/056 [not run] require 172.21.15.60:6789:/scratch to be valid block disk 2023-07-12T02:15:25.101 INFO:teuthology.orchestra.run.smithi174.stdout:generic/057 [not run] require 172.21.15.60:6789:/scratch to be valid block disk 2023-07-12T02:15:26.034 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:15:26.041 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:15:26.043 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:15:29.114 INFO:teuthology.orchestra.run.smithi174.stdout:generic/058 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-07-12T02:15:29.463 INFO:teuthology.orchestra.run.smithi174.stdout:generic/059 [not run] require 172.21.15.60:6789:/scratch to be valid block disk 2023-07-12T02:15:34.544 INFO:teuthology.orchestra.run.smithi174.stdout:generic/060 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-07-12T02:15:39.622 INFO:teuthology.orchestra.run.smithi174.stdout:generic/061 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-07-12T02:15:41.846 INFO:teuthology.orchestra.run.smithi174.stdout:generic/062 2s 2023-07-12T02:15:47.434 INFO:teuthology.orchestra.run.smithi174.stdout:generic/063 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-07-12T02:15:47.792 INFO:teuthology.orchestra.run.smithi174.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-12T02:15:48.156 INFO:teuthology.orchestra.run.smithi174.stdout:generic/065 [not run] require 172.21.15.60:6789:/scratch to be valid block disk 2023-07-12T02:15:48.502 INFO:teuthology.orchestra.run.smithi174.stdout:generic/066 [not run] require 172.21.15.60:6789:/scratch to be valid block disk 2023-07-12T02:15:48.896 INFO:teuthology.orchestra.run.smithi174.stdout:generic/067 [not run] require 172.21.15.60:6789:/scratch to be valid block disk 2023-07-12T02:15:56.140 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:15:56.143 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:15:56.145 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:16:10.604 INFO:teuthology.orchestra.run.smithi174.stdout:generic/069 22s 2023-07-12T02:16:21.928 INFO:teuthology.orchestra.run.smithi174.stdout:generic/070 11s 2023-07-12T02:16:22.259 INFO:teuthology.orchestra.run.smithi174.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-07-12T02:16:22.600 INFO:teuthology.orchestra.run.smithi174.stdout:generic/073 [not run] require 172.21.15.60:6789:/scratch to be valid block disk 2023-07-12T02:16:22.625 INFO:teuthology.orchestra.run.smithi174.stdout:generic/075 [expunged] 2023-07-12T02:16:22.941 INFO:teuthology.orchestra.run.smithi174.stdout:generic/076 [not run] require 172.21.15.60:6789:/scratch to be local device 2023-07-12T02:16:23.332 INFO:teuthology.orchestra.run.smithi174.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-07-12T02:16:23.667 INFO:teuthology.orchestra.run.smithi174.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-07-12T02:16:26.055 INFO:teuthology.orchestra.run.smithi174.stdout:generic/080 3s 2023-07-12T02:16:26.322 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:16:26.324 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:16:26.327 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:16:26.438 INFO:teuthology.orchestra.run.smithi174.stdout:generic/081 [not run] require 172.21.15.60:6789:/scratch to be valid block disk 2023-07-12T02:16:26.770 INFO:teuthology.orchestra.run.smithi174.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-12T02:16:28.492 INFO:tasks.ceph.mds.a.smithi060.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4828-gb5891ed6/rpm/el8/BUILD/ceph-18.0.0-4828-gb5891ed6/src/mds/SimpleLock.h: In function 'void SimpleLock::put_xlock()' thread 7fb670ed2700 time 2023-07-12T02:16:28.489691+0000 2023-07-12T02:16:28.493 INFO:tasks.ceph.mds.a.smithi060.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4828-gb5891ed6/rpm/el8/BUILD/ceph-18.0.0-4828-gb5891ed6/src/mds/SimpleLock.h: 417: FAILED ceph_assert(state == LOCK_XLOCK || state == LOCK_XLOCKDONE || state == LOCK_XLOCKSNAP || state == LOCK_LOCK_XLOCK || state == LOCK_LOCK || is_locallock()) 2023-07-12T02:16:28.493 INFO:tasks.ceph.mds.a.smithi060.stderr: ceph version 18.0.0-4828-gb5891ed6 (b5891ed62e7aba6227aed8ab09a4dd0853a1caf2) reef (dev) 2023-07-12T02:16:28.494 INFO:tasks.ceph.mds.a.smithi060.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fb6827aadbf] 2023-07-12T02:16:28.494 INFO:tasks.ceph.mds.a.smithi060.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2a8f85) [0x7fb6827aaf85] 2023-07-12T02:16:28.494 INFO:tasks.ceph.mds.a.smithi060.stderr: 3: (SimpleLock::put_xlock()+0x332) [0x5587f0ce3bc2] 2023-07-12T02:16:28.494 INFO:tasks.ceph.mds.a.smithi060.stderr: 4: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x5587f0ccbe5c] 2023-07-12T02:16:28.494 INFO:tasks.ceph.mds.a.smithi060.stderr: 5: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x5587f0cd4a37] 2023-07-12T02:16:28.494 INFO:tasks.ceph.mds.a.smithi060.stderr: 6: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x5587f0cd92af] 2023-07-12T02:16:28.494 INFO:tasks.ceph.mds.a.smithi060.stderr: 7: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x5587f0b2b137] 2023-07-12T02:16:28.495 INFO:tasks.ceph.mds.a.smithi060.stderr: 8: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x5587f0b2bfe0] 2023-07-12T02:16:28.495 INFO:tasks.ceph.mds.a.smithi060.stderr: 9: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x5587f0b2dee5] 2023-07-12T02:16:28.495 INFO:tasks.ceph.mds.a.smithi060.stderr: 10: (C_MDS_link_local_finish::finish(int)+0x35) [0x5587f0bb4585] 2023-07-12T02:16:28.495 INFO:tasks.ceph.mds.a.smithi060.stderr: 11: (MDSContext::complete(int)+0x5f) [0x5587f0e1279f] 2023-07-12T02:16:28.495 INFO:tasks.ceph.mds.a.smithi060.stderr: 12: (MDSIOContextBase::complete(int)+0x524) [0x5587f0e12f24] 2023-07-12T02:16:28.495 INFO:tasks.ceph.mds.a.smithi060.stderr: 13: (MDSLogContextBase::complete(int)+0x5b) [0x5587f0e132db] 2023-07-12T02:16:28.495 INFO:tasks.ceph.mds.a.smithi060.stderr: 14: (Finisher::finisher_thread_entry()+0x18d) [0x7fb68284e93d] 2023-07-12T02:16:28.496 INFO:tasks.ceph.mds.a.smithi060.stderr: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fb6815521ca] 2023-07-12T02:16:28.496 INFO:tasks.ceph.mds.a.smithi060.stderr: 16: clone() 2023-07-12T02:16:28.496 INFO:tasks.ceph.mds.a.smithi060.stderr:*** Caught signal (Aborted) ** 2023-07-12T02:16:28.496 INFO:tasks.ceph.mds.a.smithi060.stderr: in thread 7fb670ed2700 thread_name:MR_Finisher 2023-07-12T02:16:28.496 INFO:tasks.ceph.mds.a.smithi060.stderr:2023-07-12T02:16:28.490+0000 7fb670ed2700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4828-gb5891ed6/rpm/el8/BUILD/ceph-18.0.0-4828-gb5891ed6/src/mds/SimpleLock.h: In function 'void SimpleLock::put_xlock()' thread 7fb670ed2700 time 2023-07-12T02:16:28.489691+0000 2023-07-12T02:16:28.496 INFO:tasks.ceph.mds.a.smithi060.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4828-gb5891ed6/rpm/el8/BUILD/ceph-18.0.0-4828-gb5891ed6/src/mds/SimpleLock.h: 417: FAILED ceph_assert(state == LOCK_XLOCK || state == LOCK_XLOCKDONE || state == LOCK_XLOCKSNAP || state == LOCK_LOCK_XLOCK || state == LOCK_LOCK || is_locallock()) 2023-07-12T02:16:28.496 INFO:tasks.ceph.mds.a.smithi060.stderr: 2023-07-12T02:16:28.497 INFO:tasks.ceph.mds.a.smithi060.stderr: ceph version 18.0.0-4828-gb5891ed6 (b5891ed62e7aba6227aed8ab09a4dd0853a1caf2) reef (dev) 2023-07-12T02:16:28.497 INFO:tasks.ceph.mds.a.smithi060.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fb6827aadbf] 2023-07-12T02:16:28.497 INFO:tasks.ceph.mds.a.smithi060.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2a8f85) [0x7fb6827aaf85] 2023-07-12T02:16:28.497 INFO:tasks.ceph.mds.a.smithi060.stderr: 3: (SimpleLock::put_xlock()+0x332) [0x5587f0ce3bc2] 2023-07-12T02:16:28.497 INFO:tasks.ceph.mds.a.smithi060.stderr: 4: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x5587f0ccbe5c] 2023-07-12T02:16:28.497 INFO:tasks.ceph.mds.a.smithi060.stderr: 5: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x5587f0cd4a37] 2023-07-12T02:16:28.497 INFO:tasks.ceph.mds.a.smithi060.stderr: 6: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x5587f0cd92af] 2023-07-12T02:16:28.497 INFO:tasks.ceph.mds.a.smithi060.stderr: 7: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x5587f0b2b137] 2023-07-12T02:16:28.498 INFO:tasks.ceph.mds.a.smithi060.stderr: 8: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x5587f0b2bfe0] 2023-07-12T02:16:28.498 INFO:tasks.ceph.mds.a.smithi060.stderr: 9: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x5587f0b2dee5] 2023-07-12T02:16:28.498 INFO:tasks.ceph.mds.a.smithi060.stderr: 10: (C_MDS_link_local_finish::finish(int)+0x35) [0x5587f0bb4585] 2023-07-12T02:16:28.498 INFO:tasks.ceph.mds.a.smithi060.stderr: 11: (MDSContext::complete(int)+0x5f) [0x5587f0e1279f] 2023-07-12T02:16:28.498 INFO:tasks.ceph.mds.a.smithi060.stderr: 12: (MDSIOContextBase::complete(int)+0x524) [0x5587f0e12f24] 2023-07-12T02:16:28.498 INFO:tasks.ceph.mds.a.smithi060.stderr: 13: (MDSLogContextBase::complete(int)+0x5b) [0x5587f0e132db] 2023-07-12T02:16:28.498 INFO:tasks.ceph.mds.a.smithi060.stderr: 14: (Finisher::finisher_thread_entry()+0x18d) [0x7fb68284e93d] 2023-07-12T02:16:28.498 INFO:tasks.ceph.mds.a.smithi060.stderr: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fb6815521ca] 2023-07-12T02:16:28.499 INFO:tasks.ceph.mds.a.smithi060.stderr: 16: clone() 2023-07-12T02:16:28.499 INFO:tasks.ceph.mds.a.smithi060.stderr: 2023-07-12T02:16:28.499 INFO:tasks.ceph.mds.a.smithi060.stderr: ceph version 18.0.0-4828-gb5891ed6 (b5891ed62e7aba6227aed8ab09a4dd0853a1caf2) reef (dev) 2023-07-12T02:16:28.500 INFO:tasks.ceph.mds.a.smithi060.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7fb68155ccf0] 2023-07-12T02:16:28.500 INFO:tasks.ceph.mds.a.smithi060.stderr: 2: gsignal() 2023-07-12T02:16:28.500 INFO:tasks.ceph.mds.a.smithi060.stderr: 3: abort() 2023-07-12T02:16:28.500 INFO:tasks.ceph.mds.a.smithi060.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fb6827aae19] 2023-07-12T02:16:28.500 INFO:tasks.ceph.mds.a.smithi060.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2a8f85) [0x7fb6827aaf85] 2023-07-12T02:16:28.500 INFO:tasks.ceph.mds.a.smithi060.stderr: 6: (SimpleLock::put_xlock()+0x332) [0x5587f0ce3bc2] 2023-07-12T02:16:28.500 INFO:tasks.ceph.mds.a.smithi060.stderr: 7: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x5587f0ccbe5c] 2023-07-12T02:16:28.500 INFO:tasks.ceph.mds.a.smithi060.stderr: 8: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x5587f0cd4a37] 2023-07-12T02:16:28.501 INFO:tasks.ceph.mds.a.smithi060.stderr: 9: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x5587f0cd92af] 2023-07-12T02:16:28.501 INFO:tasks.ceph.mds.a.smithi060.stderr: 10: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x5587f0b2b137] 2023-07-12T02:16:28.501 INFO:tasks.ceph.mds.a.smithi060.stderr: 11: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x5587f0b2bfe0] 2023-07-12T02:16:28.501 INFO:tasks.ceph.mds.a.smithi060.stderr: 12: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x5587f0b2dee5] 2023-07-12T02:16:28.501 INFO:tasks.ceph.mds.a.smithi060.stderr: 13: (C_MDS_link_local_finish::finish(int)+0x35) [0x5587f0bb4585] 2023-07-12T02:16:28.501 INFO:tasks.ceph.mds.a.smithi060.stderr: 14: (MDSContext::complete(int)+0x5f) [0x5587f0e1279f] 2023-07-12T02:16:28.501 INFO:tasks.ceph.mds.a.smithi060.stderr: 15: (MDSIOContextBase::complete(int)+0x524) [0x5587f0e12f24] 2023-07-12T02:16:28.502 INFO:tasks.ceph.mds.a.smithi060.stderr: 16: (MDSLogContextBase::complete(int)+0x5b) [0x5587f0e132db] 2023-07-12T02:16:28.502 INFO:tasks.ceph.mds.a.smithi060.stderr: 17: (Finisher::finisher_thread_entry()+0x18d) [0x7fb68284e93d] 2023-07-12T02:16:28.502 INFO:tasks.ceph.mds.a.smithi060.stderr: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fb6815521ca] 2023-07-12T02:16:28.502 INFO:tasks.ceph.mds.a.smithi060.stderr: 19: clone() 2023-07-12T02:16:28.502 INFO:tasks.ceph.mds.a.smithi060.stderr:2023-07-12T02:16:28.492+0000 7fb670ed2700 -1 *** Caught signal (Aborted) ** 2023-07-12T02:16:28.502 INFO:tasks.ceph.mds.a.smithi060.stderr: in thread 7fb670ed2700 thread_name:MR_Finisher 2023-07-12T02:16:28.503 INFO:tasks.ceph.mds.a.smithi060.stderr: 2023-07-12T02:16:28.503 INFO:tasks.ceph.mds.a.smithi060.stderr: ceph version 18.0.0-4828-gb5891ed6 (b5891ed62e7aba6227aed8ab09a4dd0853a1caf2) reef (dev) 2023-07-12T02:16:28.503 INFO:tasks.ceph.mds.a.smithi060.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7fb68155ccf0] 2023-07-12T02:16:28.503 INFO:tasks.ceph.mds.a.smithi060.stderr: 2: gsignal() 2023-07-12T02:16:28.503 INFO:tasks.ceph.mds.a.smithi060.stderr: 3: abort() 2023-07-12T02:16:28.503 INFO:tasks.ceph.mds.a.smithi060.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fb6827aae19] 2023-07-12T02:16:28.504 INFO:tasks.ceph.mds.a.smithi060.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2a8f85) [0x7fb6827aaf85] 2023-07-12T02:16:28.504 INFO:tasks.ceph.mds.a.smithi060.stderr: 6: (SimpleLock::put_xlock()+0x332) [0x5587f0ce3bc2] 2023-07-12T02:16:28.504 INFO:tasks.ceph.mds.a.smithi060.stderr: 7: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x5587f0ccbe5c] 2023-07-12T02:16:28.504 INFO:tasks.ceph.mds.a.smithi060.stderr: 8: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x5587f0cd4a37] 2023-07-12T02:16:28.504 INFO:tasks.ceph.mds.a.smithi060.stderr: 9: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x5587f0cd92af] 2023-07-12T02:16:28.504 INFO:tasks.ceph.mds.a.smithi060.stderr: 10: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x5587f0b2b137] 2023-07-12T02:16:28.504 INFO:tasks.ceph.mds.a.smithi060.stderr: 11: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x5587f0b2bfe0] 2023-07-12T02:16:28.505 INFO:tasks.ceph.mds.a.smithi060.stderr: 12: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x5587f0b2dee5] 2023-07-12T02:16:28.505 INFO:tasks.ceph.mds.a.smithi060.stderr: 13: (C_MDS_link_local_finish::finish(int)+0x35) [0x5587f0bb4585] 2023-07-12T02:16:28.505 INFO:tasks.ceph.mds.a.smithi060.stderr: 14: (MDSContext::complete(int)+0x5f) [0x5587f0e1279f] 2023-07-12T02:16:28.505 INFO:tasks.ceph.mds.a.smithi060.stderr: 15: (MDSIOContextBase::complete(int)+0x524) [0x5587f0e12f24] 2023-07-12T02:16:28.505 INFO:tasks.ceph.mds.a.smithi060.stderr: 16: (MDSLogContextBase::complete(int)+0x5b) [0x5587f0e132db] 2023-07-12T02:16:28.505 INFO:tasks.ceph.mds.a.smithi060.stderr: 17: (Finisher::finisher_thread_entry()+0x18d) [0x7fb68284e93d] 2023-07-12T02:16:28.505 INFO:tasks.ceph.mds.a.smithi060.stderr: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fb6815521ca] 2023-07-12T02:16:28.505 INFO:tasks.ceph.mds.a.smithi060.stderr: 19: clone() 2023-07-12T02:16:28.506 INFO:tasks.ceph.mds.a.smithi060.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-07-12T02:16:28.506 INFO:tasks.ceph.mds.a.smithi060.stderr: 2023-07-12T02:16:28.511 INFO:tasks.ceph.mds.a.smithi060.stderr: -1> 2023-07-12T02:16:28.490+0000 7fb670ed2700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4828-gb5891ed6/rpm/el8/BUILD/ceph-18.0.0-4828-gb5891ed6/src/mds/SimpleLock.h: In function 'void SimpleLock::put_xlock()' thread 7fb670ed2700 time 2023-07-12T02:16:28.489691+0000 2023-07-12T02:16:28.511 INFO:tasks.ceph.mds.a.smithi060.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4828-gb5891ed6/rpm/el8/BUILD/ceph-18.0.0-4828-gb5891ed6/src/mds/SimpleLock.h: 417: FAILED ceph_assert(state == LOCK_XLOCK || state == LOCK_XLOCKDONE || state == LOCK_XLOCKSNAP || state == LOCK_LOCK_XLOCK || state == LOCK_LOCK || is_locallock()) 2023-07-12T02:16:28.511 INFO:tasks.ceph.mds.a.smithi060.stderr: 2023-07-12T02:16:28.511 INFO:tasks.ceph.mds.a.smithi060.stderr: ceph version 18.0.0-4828-gb5891ed6 (b5891ed62e7aba6227aed8ab09a4dd0853a1caf2) reef (dev) 2023-07-12T02:16:28.511 INFO:tasks.ceph.mds.a.smithi060.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fb6827aadbf] 2023-07-12T02:16:28.511 INFO:tasks.ceph.mds.a.smithi060.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2a8f85) [0x7fb6827aaf85] 2023-07-12T02:16:28.511 INFO:tasks.ceph.mds.a.smithi060.stderr: 3: (SimpleLock::put_xlock()+0x332) [0x5587f0ce3bc2] 2023-07-12T02:16:28.512 INFO:tasks.ceph.mds.a.smithi060.stderr: 4: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x5587f0ccbe5c] 2023-07-12T02:16:28.512 INFO:tasks.ceph.mds.a.smithi060.stderr: 5: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x5587f0cd4a37] 2023-07-12T02:16:28.512 INFO:tasks.ceph.mds.a.smithi060.stderr: 6: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x5587f0cd92af] 2023-07-12T02:16:28.512 INFO:tasks.ceph.mds.a.smithi060.stderr: 7: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x5587f0b2b137] 2023-07-12T02:16:28.512 INFO:tasks.ceph.mds.a.smithi060.stderr: 8: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x5587f0b2bfe0] 2023-07-12T02:16:28.512 INFO:tasks.ceph.mds.a.smithi060.stderr: 9: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x5587f0b2dee5] 2023-07-12T02:16:28.512 INFO:tasks.ceph.mds.a.smithi060.stderr: 10: (C_MDS_link_local_finish::finish(int)+0x35) [0x5587f0bb4585] 2023-07-12T02:16:28.513 INFO:tasks.ceph.mds.a.smithi060.stderr: 11: (MDSContext::complete(int)+0x5f) [0x5587f0e1279f] 2023-07-12T02:16:28.513 INFO:tasks.ceph.mds.a.smithi060.stderr: 12: (MDSIOContextBase::complete(int)+0x524) [0x5587f0e12f24] 2023-07-12T02:16:28.513 INFO:tasks.ceph.mds.a.smithi060.stderr: 13: (MDSLogContextBase::complete(int)+0x5b) [0x5587f0e132db] 2023-07-12T02:16:28.513 INFO:tasks.ceph.mds.a.smithi060.stderr: 14: (Finisher::finisher_thread_entry()+0x18d) [0x7fb68284e93d] 2023-07-12T02:16:28.513 INFO:tasks.ceph.mds.a.smithi060.stderr: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fb6815521ca] 2023-07-12T02:16:28.513 INFO:tasks.ceph.mds.a.smithi060.stderr: 16: clone() 2023-07-12T02:16:28.513 INFO:tasks.ceph.mds.a.smithi060.stderr: 2023-07-12T02:16:28.513 INFO:tasks.ceph.mds.a.smithi060.stderr: 0> 2023-07-12T02:16:28.492+0000 7fb670ed2700 -1 *** Caught signal (Aborted) ** 2023-07-12T02:16:28.514 INFO:tasks.ceph.mds.a.smithi060.stderr: in thread 7fb670ed2700 thread_name:MR_Finisher 2023-07-12T02:16:28.514 INFO:tasks.ceph.mds.a.smithi060.stderr: 2023-07-12T02:16:28.514 INFO:tasks.ceph.mds.a.smithi060.stderr: ceph version 18.0.0-4828-gb5891ed6 (b5891ed62e7aba6227aed8ab09a4dd0853a1caf2) reef (dev) 2023-07-12T02:16:28.514 INFO:tasks.ceph.mds.a.smithi060.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7fb68155ccf0] 2023-07-12T02:16:28.514 INFO:tasks.ceph.mds.a.smithi060.stderr: 2: gsignal() 2023-07-12T02:16:28.514 INFO:tasks.ceph.mds.a.smithi060.stderr: 3: abort() 2023-07-12T02:16:28.514 INFO:tasks.ceph.mds.a.smithi060.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fb6827aae19] 2023-07-12T02:16:28.514 INFO:tasks.ceph.mds.a.smithi060.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2a8f85) [0x7fb6827aaf85] 2023-07-12T02:16:28.515 INFO:tasks.ceph.mds.a.smithi060.stderr: 6: (SimpleLock::put_xlock()+0x332) [0x5587f0ce3bc2] 2023-07-12T02:16:28.515 INFO:tasks.ceph.mds.a.smithi060.stderr: 7: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x5587f0ccbe5c] 2023-07-12T02:16:28.515 INFO:tasks.ceph.mds.a.smithi060.stderr: 8: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x5587f0cd4a37] 2023-07-12T02:16:28.515 INFO:tasks.ceph.mds.a.smithi060.stderr: 9: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x5587f0cd92af] 2023-07-12T02:16:28.515 INFO:tasks.ceph.mds.a.smithi060.stderr: 10: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x5587f0b2b137] 2023-07-12T02:16:28.515 INFO:tasks.ceph.mds.a.smithi060.stderr: 11: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x5587f0b2bfe0] 2023-07-12T02:16:28.515 INFO:tasks.ceph.mds.a.smithi060.stderr: 12: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x5587f0b2dee5] 2023-07-12T02:16:28.515 INFO:tasks.ceph.mds.a.smithi060.stderr: 13: (C_MDS_link_local_finish::finish(int)+0x35) [0x5587f0bb4585] 2023-07-12T02:16:28.516 INFO:tasks.ceph.mds.a.smithi060.stderr: 14: (MDSContext::complete(int)+0x5f) [0x5587f0e1279f] 2023-07-12T02:16:28.516 INFO:tasks.ceph.mds.a.smithi060.stderr: 15: (MDSIOContextBase::complete(int)+0x524) [0x5587f0e12f24] 2023-07-12T02:16:28.516 INFO:tasks.ceph.mds.a.smithi060.stderr: 16: (MDSLogContextBase::complete(int)+0x5b) [0x5587f0e132db] 2023-07-12T02:16:28.516 INFO:tasks.ceph.mds.a.smithi060.stderr: 17: (Finisher::finisher_thread_entry()+0x18d) [0x7fb68284e93d] 2023-07-12T02:16:28.516 INFO:tasks.ceph.mds.a.smithi060.stderr: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fb6815521ca] 2023-07-12T02:16:28.516 INFO:tasks.ceph.mds.a.smithi060.stderr: 19: clone() 2023-07-12T02:16:28.516 INFO:tasks.ceph.mds.a.smithi060.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-07-12T02:16:28.516 INFO:tasks.ceph.mds.a.smithi060.stderr: 2023-07-12T02:16:28.522 INFO:tasks.ceph.mds.a.smithi060.stderr: -1> 2023-07-12T02:16:28.490+0000 7fb670ed2700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4828-gb5891ed6/rpm/el8/BUILD/ceph-18.0.0-4828-gb5891ed6/src/mds/SimpleLock.h: In function 'void SimpleLock::put_xlock()' thread 7fb670ed2700 time 2023-07-12T02:16:28.489691+0000 2023-07-12T02:16:28.522 INFO:tasks.ceph.mds.a.smithi060.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4828-gb5891ed6/rpm/el8/BUILD/ceph-18.0.0-4828-gb5891ed6/src/mds/SimpleLock.h: 417: FAILED ceph_assert(state == LOCK_XLOCK || state == LOCK_XLOCKDONE || state == LOCK_XLOCKSNAP || state == LOCK_LOCK_XLOCK || state == LOCK_LOCK || is_locallock()) 2023-07-12T02:16:28.522 INFO:tasks.ceph.mds.a.smithi060.stderr: 2023-07-12T02:16:28.522 INFO:tasks.ceph.mds.a.smithi060.stderr: ceph version 18.0.0-4828-gb5891ed6 (b5891ed62e7aba6227aed8ab09a4dd0853a1caf2) reef (dev) 2023-07-12T02:16:28.522 INFO:tasks.ceph.mds.a.smithi060.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fb6827aadbf] 2023-07-12T02:16:28.522 INFO:tasks.ceph.mds.a.smithi060.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2a8f85) [0x7fb6827aaf85] 2023-07-12T02:16:28.522 INFO:tasks.ceph.mds.a.smithi060.stderr: 3: (SimpleLock::put_xlock()+0x332) [0x5587f0ce3bc2] 2023-07-12T02:16:28.523 INFO:tasks.ceph.mds.a.smithi060.stderr: 4: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x5587f0ccbe5c] 2023-07-12T02:16:28.523 INFO:tasks.ceph.mds.a.smithi060.stderr: 5: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x5587f0cd4a37] 2023-07-12T02:16:28.523 INFO:tasks.ceph.mds.a.smithi060.stderr: 6: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x5587f0cd92af] 2023-07-12T02:16:28.523 INFO:tasks.ceph.mds.a.smithi060.stderr: 7: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x5587f0b2b137] 2023-07-12T02:16:28.523 INFO:tasks.ceph.mds.a.smithi060.stderr: 8: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x5587f0b2bfe0] 2023-07-12T02:16:28.523 INFO:tasks.ceph.mds.a.smithi060.stderr: 9: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x5587f0b2dee5] 2023-07-12T02:16:28.523 INFO:tasks.ceph.mds.a.smithi060.stderr: 10: (C_MDS_link_local_finish::finish(int)+0x35) [0x5587f0bb4585] 2023-07-12T02:16:28.524 INFO:tasks.ceph.mds.a.smithi060.stderr: 11: (MDSContext::complete(int)+0x5f) [0x5587f0e1279f] 2023-07-12T02:16:28.524 INFO:tasks.ceph.mds.a.smithi060.stderr: 12: (MDSIOContextBase::complete(int)+0x524) [0x5587f0e12f24] 2023-07-12T02:16:28.524 INFO:tasks.ceph.mds.a.smithi060.stderr: 13: (MDSLogContextBase::complete(int)+0x5b) [0x5587f0e132db] 2023-07-12T02:16:28.524 INFO:tasks.ceph.mds.a.smithi060.stderr: 14: (Finisher::finisher_thread_entry()+0x18d) [0x7fb68284e93d] 2023-07-12T02:16:28.524 INFO:tasks.ceph.mds.a.smithi060.stderr: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fb6815521ca] 2023-07-12T02:16:28.524 INFO:tasks.ceph.mds.a.smithi060.stderr: 16: clone() 2023-07-12T02:16:28.524 INFO:tasks.ceph.mds.a.smithi060.stderr: 2023-07-12T02:16:28.524 INFO:tasks.ceph.mds.a.smithi060.stderr: 0> 2023-07-12T02:16:28.492+0000 7fb670ed2700 -1 *** Caught signal (Aborted) ** 2023-07-12T02:16:28.525 INFO:tasks.ceph.mds.a.smithi060.stderr: in thread 7fb670ed2700 thread_name:MR_Finisher 2023-07-12T02:16:28.525 INFO:tasks.ceph.mds.a.smithi060.stderr: 2023-07-12T02:16:28.525 INFO:tasks.ceph.mds.a.smithi060.stderr: ceph version 18.0.0-4828-gb5891ed6 (b5891ed62e7aba6227aed8ab09a4dd0853a1caf2) reef (dev) 2023-07-12T02:16:28.525 INFO:tasks.ceph.mds.a.smithi060.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7fb68155ccf0] 2023-07-12T02:16:28.525 INFO:tasks.ceph.mds.a.smithi060.stderr: 2: gsignal() 2023-07-12T02:16:28.525 INFO:tasks.ceph.mds.a.smithi060.stderr: 3: abort() 2023-07-12T02:16:28.525 INFO:tasks.ceph.mds.a.smithi060.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fb6827aae19] 2023-07-12T02:16:28.525 INFO:tasks.ceph.mds.a.smithi060.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2a8f85) [0x7fb6827aaf85] 2023-07-12T02:16:28.526 INFO:tasks.ceph.mds.a.smithi060.stderr: 6: (SimpleLock::put_xlock()+0x332) [0x5587f0ce3bc2] 2023-07-12T02:16:28.526 INFO:tasks.ceph.mds.a.smithi060.stderr: 7: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x5587f0ccbe5c] 2023-07-12T02:16:28.526 INFO:tasks.ceph.mds.a.smithi060.stderr: 8: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x5587f0cd4a37] 2023-07-12T02:16:28.526 INFO:tasks.ceph.mds.a.smithi060.stderr: 9: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x5587f0cd92af] 2023-07-12T02:16:28.526 INFO:tasks.ceph.mds.a.smithi060.stderr: 10: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x5587f0b2b137] 2023-07-12T02:16:28.526 INFO:tasks.ceph.mds.a.smithi060.stderr: 11: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x5587f0b2bfe0] 2023-07-12T02:16:28.526 INFO:tasks.ceph.mds.a.smithi060.stderr: 12: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x5587f0b2dee5] 2023-07-12T02:16:28.526 INFO:tasks.ceph.mds.a.smithi060.stderr: 13: (C_MDS_link_local_finish::finish(int)+0x35) [0x5587f0bb4585] 2023-07-12T02:16:28.527 INFO:tasks.ceph.mds.a.smithi060.stderr: 14: (MDSContext::complete(int)+0x5f) [0x5587f0e1279f] 2023-07-12T02:16:28.527 INFO:tasks.ceph.mds.a.smithi060.stderr: 15: (MDSIOContextBase::complete(int)+0x524) [0x5587f0e12f24] 2023-07-12T02:16:28.527 INFO:tasks.ceph.mds.a.smithi060.stderr: 16: (MDSLogContextBase::complete(int)+0x5b) [0x5587f0e132db] 2023-07-12T02:16:28.527 INFO:tasks.ceph.mds.a.smithi060.stderr: 17: (Finisher::finisher_thread_entry()+0x18d) [0x7fb68284e93d] 2023-07-12T02:16:28.527 INFO:tasks.ceph.mds.a.smithi060.stderr: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fb6815521ca] 2023-07-12T02:16:28.527 INFO:tasks.ceph.mds.a.smithi060.stderr: 19: clone() 2023-07-12T02:16:28.527 INFO:tasks.ceph.mds.a.smithi060.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-07-12T02:16:28.527 INFO:tasks.ceph.mds.a.smithi060.stderr: 2023-07-12T02:16:30.050 INFO:tasks.ceph.mds.a.smithi060.stderr:daemon-helper: command crashed with signal 6 2023-07-12T02:16:31.971 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-07-12T02:16:38.481 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~7s 2023-07-12T02:16:44.989 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~13s 2023-07-12T02:16:51.499 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~20s 2023-07-12T02:16:56.420 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:16:56.422 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:16:56.424 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:16:57.505 INFO:tasks.ceph.mds.c.smithi060.stderr:2023-07-12T02:16:57.501+0000 7f988d2ff700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-12T02:16:58.007 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~26s 2023-07-12T02:17:01.735 INFO:teuthology.orchestra.run.smithi174.stdout:generic/084 35s 2023-07-12T02:17:02.164 INFO:teuthology.orchestra.run.smithi174.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-12T02:17:02.604 INFO:teuthology.orchestra.run.smithi174.stdout:generic/087 0s 2023-07-12T02:17:02.968 INFO:teuthology.orchestra.run.smithi174.stdout:generic/088 0s 2023-07-12T02:17:03.325 INFO:teuthology.orchestra.run.smithi174.stdout:generic/090 [not run] require 172.21.15.60:6789:/scratch to be valid block disk 2023-07-12T02:17:04.515 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~33s 2023-07-12T02:17:11.024 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~39s 2023-07-12T02:17:17.534 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~46s 2023-07-12T02:17:24.043 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~52s 2023-07-12T02:17:26.625 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:17:26.627 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:17:26.629 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:17:30.551 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~59s 2023-07-12T02:17:37.060 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~65s 2023-07-12T02:17:43.568 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~72s 2023-07-12T02:17:50.079 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~78s 2023-07-12T02:17:56.590 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~85s 2023-07-12T02:17:56.739 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:17:56.741 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:17:56.743 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:18:02.868 INFO:teuthology.orchestra.run.smithi174.stdout:generic/091 59s 2023-07-12T02:18:03.099 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~91s 2023-07-12T02:18:03.206 INFO:teuthology.orchestra.run.smithi174.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-12T02:18:03.590 INFO:teuthology.orchestra.run.smithi174.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-12T02:18:07.073 INFO:teuthology.orchestra.run.smithi174.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-07-12T02:18:07.756 INFO:teuthology.orchestra.run.smithi174.stdout:generic/097 0s 2023-07-12T02:18:08.895 INFO:teuthology.orchestra.run.smithi174.stdout:generic/098 1s 2023-07-12T02:18:09.607 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~98s 2023-07-12T02:18:10.148 INFO:teuthology.orchestra.run.smithi174.stdout:generic/099 2s 2023-07-12T02:18:10.490 INFO:teuthology.orchestra.run.smithi174.stdout:generic/101 [not run] require 172.21.15.60:6789:/scratch to be valid block disk 2023-07-12T02:18:10.832 INFO:teuthology.orchestra.run.smithi174.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-12T02:18:11.189 INFO:teuthology.orchestra.run.smithi174.stdout:generic/104 [not run] require 172.21.15.60:6789:/scratch to be valid block disk 2023-07-12T02:18:12.040 INFO:teuthology.orchestra.run.smithi174.stdout:generic/105 1s 2023-07-12T02:18:12.463 INFO:teuthology.orchestra.run.smithi174.stdout:generic/106 [not run] require 172.21.15.60:6789:/scratch to be valid block disk 2023-07-12T02:18:12.825 INFO:teuthology.orchestra.run.smithi174.stdout:generic/107 [not run] require 172.21.15.60:6789:/scratch to be valid block disk 2023-07-12T02:18:13.298 INFO:teuthology.orchestra.run.smithi174.stdout:generic/108 [not run] require 172.21.15.60:6789:/scratch to be valid block disk 2023-07-12T02:18:13.670 INFO:teuthology.orchestra.run.smithi174.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2023-07-12T02:18:14.045 INFO:teuthology.orchestra.run.smithi174.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2023-07-12T02:18:16.116 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~104s 2023-07-12T02:18:22.625 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~111s 2023-07-12T02:18:27.091 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:18:27.093 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:18:27.095 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:18:29.134 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~117s 2023-07-12T02:18:35.642 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~124s 2023-07-12T02:18:38.600 INFO:teuthology.orchestra.run.smithi174.stdout:generic/112 24s 2023-07-12T02:18:42.150 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~130s 2023-07-12T02:18:48.659 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~137s 2023-07-12T02:18:55.169 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~143s 2023-07-12T02:18:57.201 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:18:57.204 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:18:57.206 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:19:01.679 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~150s 2023-07-12T02:19:08.187 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~156s 2023-07-12T02:19:14.694 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~163s 2023-07-12T02:19:21.204 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~169s 2023-07-12T02:19:27.331 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:19:27.344 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:19:27.384 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:19:27.713 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~176s 2023-07-12T02:19:34.221 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~182s 2023-07-12T02:19:40.728 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~189s 2023-07-12T02:19:47.236 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~195s 2023-07-12T02:19:53.746 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~202s 2023-07-12T02:19:57.684 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:19:57.687 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:19:57.696 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:20:00.255 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~208s 2023-07-12T02:20:06.763 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~215s 2023-07-12T02:20:13.275 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~221s 2023-07-12T02:20:19.785 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~228s 2023-07-12T02:20:26.298 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~234s 2023-07-12T02:20:26.504 INFO:teuthology.orchestra.run.smithi174.stdout:generic/113 108s 2023-07-12T02:20:26.899 INFO:teuthology.orchestra.run.smithi174.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-07-12T02:20:27.264 INFO:teuthology.orchestra.run.smithi174.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2023-07-12T02:20:27.627 INFO:teuthology.orchestra.run.smithi174.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2023-07-12T02:20:28.192 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:20:28.195 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:20:28.197 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:20:32.807 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~241s 2023-07-12T02:20:34.231 INFO:teuthology.orchestra.run.smithi174.stdout:generic/117 7s 2023-07-12T02:20:34.672 INFO:teuthology.orchestra.run.smithi174.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2023-07-12T02:20:35.036 INFO:teuthology.orchestra.run.smithi174.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2023-07-12T02:20:35.361 INFO:teuthology.orchestra.run.smithi174.stdout:generic/120 [not run] atime not maintained by ceph 2023-07-12T02:20:35.728 INFO:teuthology.orchestra.run.smithi174.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2023-07-12T02:20:36.101 INFO:teuthology.orchestra.run.smithi174.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2023-07-12T02:20:36.862 INFO:teuthology.orchestra.run.smithi174.stdout:generic/123 0s 2023-07-12T02:20:39.317 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~247s 2023-07-12T02:20:45.827 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~254s 2023-07-12T02:20:52.336 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~260s 2023-07-12T02:20:58.294 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:20:58.308 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:20:58.329 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:20:58.844 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~267s 2023-07-12T02:21:05.354 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~273s 2023-07-12T02:21:11.861 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~280s 2023-07-12T02:21:18.369 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~286s 2023-07-12T02:21:19.190 INFO:teuthology.orchestra.run.smithi174.stdout:generic/124 43s 2023-07-12T02:21:19.783 INFO:teuthology.orchestra.run.smithi174.stdout:generic/126 0s 2023-07-12T02:21:21.192 INFO:teuthology.orchestra.run.smithi174.stdout:generic/128 2s 2023-07-12T02:21:24.879 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~293s 2023-07-12T02:21:28.812 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:21:28.819 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:21:28.858 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:21:31.388 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~299s 2023-07-12T02:21:37.898 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~306s 2023-07-12T02:21:37.898 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-07-12T02:21:37.898 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-07-12T02:21:37.899 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-12T02:21:37.950 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2023-07-12T02:21:37.950 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-12T02:21:37.998 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-12T02:21:38.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:38.863+0000 7fcf49661700 1 Processor -- start 2023-07-12T02:21:38.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:38.877+0000 7fcf49661700 1 -- start start 2023-07-12T02:21:38.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:38.878+0000 7fcf49661700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf4414bc00 0x7fcf440b9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:21:38.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:38.878+0000 7fcf49661700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcf440b9ad0 0x7fcf441484a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:21:38.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:38.878+0000 7fcf49661700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf440b7360 con 0x7fcf441489e0 2023-07-12T02:21:38.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:38.878+0000 7fcf49661700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf440b9170 con 0x7fcf440b9ad0 2023-07-12T02:21:38.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:38.878+0000 7fcf49661700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf440b8bc0 con 0x7fcf4414bc00 2023-07-12T02:21:38.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:38.880+0000 7fcf427fc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcf440b9ad0 0x7fcf441484a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:21:38.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:38.880+0000 7fcf427fc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcf440b9ad0 0x7fcf441484a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.60:56810/0 (socket says 172.21.15.60:56810) 2023-07-12T02:21:38.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:38.880+0000 7fcf427fc700 1 -- 172.21.15.60:0/1537843106 learned_addr learned my addr 172.21.15.60:0/1537843106 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:21:38.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:38.884+0000 7fcf42ffd700 1 --2- 172.21.15.60:0/1537843106 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf4414bc00 0x7fcf440b9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:21:38.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:38.887+0000 7fcf427fc700 1 -- 172.21.15.60:0/1537843106 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf4414bc00 msgr2=0x7fcf440b9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:21:38.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:38.887+0000 7fcf427fc700 1 --2- 172.21.15.60:0/1537843106 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf4414bc00 0x7fcf440b9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:38.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:38.887+0000 7fcf427fc700 1 -- 172.21.15.60:0/1537843106 >> v1:172.21.15.60:6789/0 conn(0x7fcf441489e0 legacy=0x7fcf4413faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:21:38.896 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:38.887+0000 7fcf427fc700 1 -- 172.21.15.60:0/1537843106 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf44072060 con 0x7fcf440b9ad0 2023-07-12T02:21:38.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:38.891+0000 7fcf427fc700 1 --2- 172.21.15.60:0/1537843106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf440b9ad0 0x7fcf441484a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcf38006fd0 tx=0x7fcf38009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=994ae3eaa2498bb7 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:21:38.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:38.907+0000 7fcf41ffb700 1 -- 172.21.15.60:0/1537843106 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf38005e30 con 0x7fcf440b9ad0 2023-07-12T02:21:38.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:38.907+0000 7fcf41ffb700 1 -- 172.21.15.60:0/1537843106 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf38006030 con 0x7fcf440b9ad0 2023-07-12T02:21:38.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:38.907+0000 7fcf41ffb700 1 -- 172.21.15.60:0/1537843106 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf380063c0 con 0x7fcf440b9ad0 2023-07-12T02:21:38.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:38.908+0000 7fcf49661700 1 -- 172.21.15.60:0/1537843106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf440b9ad0 msgr2=0x7fcf441484a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:21:38.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:38.908+0000 7fcf49661700 1 --2- 172.21.15.60:0/1537843106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf440b9ad0 0x7fcf441484a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcf38006fd0 tx=0x7fcf38009bd0 comp rx=0 tx=0).stop 2023-07-12T02:21:38.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:38.938+0000 7fcf49661700 1 -- 172.21.15.60:0/1537843106 shutdown_connections 2023-07-12T02:21:38.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:38.938+0000 7fcf49661700 1 --2- 172.21.15.60:0/1537843106 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf4414bc00 0x7fcf440b9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:38.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:38.938+0000 7fcf49661700 1 --2- 172.21.15.60:0/1537843106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf440b9ad0 0x7fcf441484a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:38.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:38.938+0000 7fcf49661700 1 -- 172.21.15.60:0/1537843106 >> 172.21.15.60:0/1537843106 conn(0x7fcf44069f30 msgr2=0x7fcf4406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:21:38.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:38.949+0000 7fcf49661700 1 -- 172.21.15.60:0/1537843106 shutdown_connections 2023-07-12T02:21:38.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:38.950+0000 7fcf49661700 1 -- 172.21.15.60:0/1537843106 wait complete. 2023-07-12T02:21:38.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:38.952+0000 7fcf49661700 1 Processor -- start 2023-07-12T02:21:38.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:38.967+0000 7fcf49661700 1 -- start start 2023-07-12T02:21:38.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:38.968+0000 7fcf49661700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf440b9ad0 0x7fcf440ba2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:21:38.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:38.968+0000 7fcf49661700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf441489e0 0x7fcf440bc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:21:38.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:38.968+0000 7fcf49661700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf4414bc00 0x7fcf44143e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:21:38.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:38.968+0000 7fcf49661700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf44143a00 con 0x7fcf440b9ad0 2023-07-12T02:21:38.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:38.968+0000 7fcf49661700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf440bcf00 con 0x7fcf441489e0 2023-07-12T02:21:38.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:38.968+0000 7fcf49661700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf440b67f0 con 0x7fcf4414bc00 2023-07-12T02:21:38.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:38.968+0000 7fcf437fe700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf4414bc00 0x7fcf44143e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:21:38.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:38.968+0000 7fcf437fe700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf4414bc00 0x7fcf44143e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.60:39510/0 (socket says 172.21.15.60:39510) 2023-07-12T02:21:38.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:38.968+0000 7fcf437fe700 1 -- 172.21.15.60:0/3646917709 learned_addr learned my addr 172.21.15.60:0/3646917709 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:21:38.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:38.968+0000 7fcf437fe700 1 -- 172.21.15.60:0/3646917709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf441489e0 msgr2=0x7fcf440bc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:21:38.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:38.968+0000 7fcf437fe700 1 --2- 172.21.15.60:0/3646917709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf441489e0 0x7fcf440bc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:38.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:38.968+0000 7fcf437fe700 1 -- 172.21.15.60:0/3646917709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf440b9ad0 msgr2=0x7fcf440ba2d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-12T02:21:38.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:38.968+0000 7fcf437fe700 1 --2- 172.21.15.60:0/3646917709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf440b9ad0 0x7fcf440ba2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:38.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:38.969+0000 7fcf437fe700 1 -- 172.21.15.60:0/3646917709 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf38009500 con 0x7fcf4414bc00 2023-07-12T02:21:38.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:38.969+0000 7fcf437fe700 1 --2- 172.21.15.60:0/3646917709 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf4414bc00 0x7fcf44143e90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcf3400c4c0 tx=0x7fcf34001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:21:39.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:39.029+0000 7fcf337fe700 1 -- 172.21.15.60:0/3646917709 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf340054e0 con 0x7fcf4414bc00 2023-07-12T02:21:39.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:39.029+0000 7fcf337fe700 1 -- 172.21.15.60:0/3646917709 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf34003680 con 0x7fcf4414bc00 2023-07-12T02:21:39.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:39.029+0000 7fcf337fe700 1 -- 172.21.15.60:0/3646917709 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf34003a30 con 0x7fcf4414bc00 2023-07-12T02:21:39.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:39.029+0000 7fcf49661700 1 -- 172.21.15.60:0/3646917709 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf441443d0 con 0x7fcf4414bc00 2023-07-12T02:21:39.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:39.030+0000 7fcf49661700 1 -- 172.21.15.60:0/3646917709 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf440bd170 con 0x7fcf4414bc00 2023-07-12T02:21:39.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:39.038+0000 7fcf337fe700 1 -- 172.21.15.60:0/3646917709 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcf34003b90 con 0x7fcf4414bc00 2023-07-12T02:21:39.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:39.039+0000 7fcf337fe700 1 --2- 172.21.15.60:0/3646917709 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fcf2806ad80 0x7fcf2806d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:21:39.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:39.039+0000 7fcf337fe700 1 -- 172.21.15.60:0/3646917709 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fcf34088880 con 0x7fcf4414bc00 2023-07-12T02:21:39.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:39.043+0000 7fcf42ffd700 1 --2- 172.21.15.60:0/3646917709 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fcf2806ad80 0x7fcf2806d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:21:39.058 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:39.054+0000 7fcf42ffd700 1 --2- 172.21.15.60:0/3646917709 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fcf2806ad80 0x7fcf2806d230 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c009e70 tx=0x7fcf3c009830 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:21:39.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:39.080+0000 7fcf49661700 1 -- 172.21.15.60:0/3646917709 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf200052f0 con 0x7fcf4414bc00 2023-07-12T02:21:39.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:39.106+0000 7fcf337fe700 1 -- 172.21.15.60:0/3646917709 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fcf340539d0 con 0x7fcf4414bc00 2023-07-12T02:21:40.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.165+0000 7fcf49661700 1 -- 172.21.15.60:0/3646917709 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf200055a0 con 0x7fcf4414bc00 2023-07-12T02:21:40.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.168+0000 7fcf337fe700 1 -- 172.21.15.60:0/3646917709 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+18421 (secure 0 0 0) 0x7fcf34017020 con 0x7fcf4414bc00 2023-07-12T02:21:40.176 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-12T02:21:40.176 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":34,"fsid":"97e7c909-e567-472e-a5aa-72fde15171f2","created":"2023-07-12T02:01:53.987086+0000","modified":"2023-07-12T02:16:43.943952+0000","last_up_change":"2023-07-12T02:02:04.031780+0000","last_in_change":"2023-07-12T02:01:56.538621+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-12T02:02:05.375042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-12T02:02:05.857441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-12T02:02:57.318080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-12T02:02:57.932207+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ed8b71c2-3895-4952-a118-16ede0b4a98c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6801","nonce":2818935979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6803","nonce":2818935979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6807","nonce":2818935979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2818935979},{"type":"v1","addr":"172.21.15.60:6805","nonce":2818935979}]},"public_addr":"172.21.15.60:6801/2818935979","cluster_addr":"172.21.15.60:6803/2818935979","heartbeat_back_addr":"172.21.15.60:6807/2818935979","heartbeat_front_addr":"172.21.15.60:6805/2818935979","state":["exists","up"]},{"osd":1,"uuid":"7cf4d354-78e0-43ce-8c09-4a7d2a0b57a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6817","nonce":1678864191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6819","nonce":1678864191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6823","nonce":1678864191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1678864191},{"type":"v1","addr":"172.21.15.60:6821","nonce":1678864191}]},"public_addr":"172.21.15.60:6817/1678864191","cluster_addr":"172.21.15.60:6819/1678864191","heartbeat_back_addr":"172.21.15.60:6823/1678864191","heartbeat_front_addr":"172.21.15.60:6821/1678864191","state":["exists","up"]},{"osd":2,"uuid":"02c958b8-9599-4470-92cb-8f7018ec0189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6809","nonce":1459480680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6811","nonce":1459480680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6815","nonce":1459480680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1459480680},{"type":"v1","addr":"172.21.15.60:6813","nonce":1459480680}]},"public_addr":"172.21.15.60:6809/1459480680","cluster_addr":"172.21.15.60:6811/1459480680","heartbeat_back_addr":"172.21.15.60:6815/1459480680","heartbeat_front_addr":"172.21.15.60:6813/1459480680","state":["exists","up"]},{"osd":3,"uuid":"bc300432-a228-4257-be5c-e42dd5f2015f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6825","nonce":3295100060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6827","nonce":3295100060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6831","nonce":3295100060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3295100060},{"type":"v1","addr":"172.21.15.60:6829","nonce":3295100060}]},"public_addr":"172.21.15.60:6825/3295100060","cluster_addr":"172.21.15.60:6827/3295100060","heartbeat_back_addr":"172.21.15.60:6831/3295100060","heartbeat_front_addr":"172.21.15.60:6829/3295100060","state":["exists","up"]},{"osd":4,"uuid":"ad9f7dc4-7126-466d-a656-2844880c6060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6809","nonce":4127109138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6811","nonce":4127109138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6815","nonce":4127109138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":4127109138},{"type":"v1","addr":"172.21.15.79:6813","nonce":4127109138}]},"public_addr":"172.21.15.79:6809/4127109138","cluster_addr":"172.21.15.79:6811/4127109138","heartbeat_back_addr":"172.21.15.79:6815/4127109138","heartbeat_front_addr":"172.21.15.79:6813/4127109138","state":["exists","up"]},{"osd":5,"uuid":"e88d16ca-0b01-4ab9-8aa8-c4aff7f210f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6801","nonce":421449406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6803","nonce":421449406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6807","nonce":421449406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":421449406},{"type":"v1","addr":"172.21.15.79:6805","nonce":421449406}]},"public_addr":"172.21.15.79:6801/421449406","cluster_addr":"172.21.15.79:6803/421449406","heartbeat_back_addr":"172.21.15.79:6807/421449406","heartbeat_front_addr":"172.21.15.79:6805/421449406","state":["exists","up"]},{"osd":6,"uuid":"6898cb84-56d1-48a9-bd45-97e4668e2fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6825","nonce":4144355139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6827","nonce":4144355139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6831","nonce":4144355139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":4144355139},{"type":"v1","addr":"172.21.15.79:6829","nonce":4144355139}]},"public_addr":"172.21.15.79:6825/4144355139","cluster_addr":"172.21.15.79:6827/4144355139","heartbeat_back_addr":"172.21.15.79:6831/4144355139","heartbeat_front_addr":"172.21.15.79:6829/4144355139","state":["exists","up"]},{"osd":7,"uuid":"65c10882-371e-4762-b384-9c3a48f332ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6817","nonce":2845223299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6819","nonce":2845223299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6823","nonce":2845223299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2845223299},{"type":"v1","addr":"172.21.15.79:6821","nonce":2845223299}]},"public_addr":"172.21.15.79:6817/2845223299","cluster_addr":"172.21.15.79:6819/2845223299","heartbeat_back_addr":"172.21.15.79:6823/2845223299","heartbeat_front_addr":"172.21.15.79:6821/2845223299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.634716+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.758349+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.728366+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.777395+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707262+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.649705+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.693021+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-12T02:02:01.707263+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.38","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:6834/646133464":"2023-07-13T02:16:43.943891+0000","172.21.15.60:6832/646133464":"2023-07-13T02:16:43.943891+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-12T02:21:40.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.198+0000 7fcf49661700 1 -- 172.21.15.60:0/3646917709 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fcf2806ad80 msgr2=0x7fcf2806d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:21:40.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.198+0000 7fcf49661700 1 --2- 172.21.15.60:0/3646917709 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fcf2806ad80 0x7fcf2806d230 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c009e70 tx=0x7fcf3c009830 comp rx=0 tx=0).stop 2023-07-12T02:21:40.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.198+0000 7fcf49661700 1 -- 172.21.15.60:0/3646917709 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf4414bc00 msgr2=0x7fcf44143e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:21:40.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.198+0000 7fcf49661700 1 --2- 172.21.15.60:0/3646917709 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf4414bc00 0x7fcf44143e90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcf3400c4c0 tx=0x7fcf34001e70 comp rx=0 tx=0).stop 2023-07-12T02:21:40.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.202+0000 7fcf49661700 1 -- 172.21.15.60:0/3646917709 shutdown_connections 2023-07-12T02:21:40.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.202+0000 7fcf49661700 1 --2- 172.21.15.60:0/3646917709 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fcf2806ad80 0x7fcf2806d230 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:40.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.202+0000 7fcf49661700 1 --2- 172.21.15.60:0/3646917709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf440b9ad0 0x7fcf440ba2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:40.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.202+0000 7fcf49661700 1 --2- 172.21.15.60:0/3646917709 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcf4414bc00 0x7fcf44143e90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:40.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.202+0000 7fcf49661700 1 --2- 172.21.15.60:0/3646917709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf441489e0 0x7fcf440bc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:40.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.202+0000 7fcf49661700 1 -- 172.21.15.60:0/3646917709 >> 172.21.15.60:0/3646917709 conn(0x7fcf44069f30 msgr2=0x7fcf4406a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:21:40.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.208+0000 7fcf49661700 1 -- 172.21.15.60:0/3646917709 shutdown_connections 2023-07-12T02:21:40.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.213+0000 7fcf49661700 1 -- 172.21.15.60:0/3646917709 wait complete. 2023-07-12T02:21:40.270 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-12T02:02:05.375042+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-12T02:02:05.857441+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-12T02:02:57.318080+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-07-12T02:02:57.932207+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-12T02:21:40.271 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-12T02:21:40.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.820+0000 7f0ce6f5f700 1 Processor -- start 2023-07-12T02:21:40.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.820+0000 7f0ce6f5f700 1 -- start start 2023-07-12T02:21:40.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.821+0000 7f0ce6f5f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0ce0071c50 0x7f0ce00b42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:21:40.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.821+0000 7f0ce6f5f700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ce00b4e70 con 0x7f0ce00b4830 2023-07-12T02:21:40.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.821+0000 7f0ce6f5f700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ce0146440 con 0x7f0ce0140640 2023-07-12T02:21:40.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.821+0000 7f0ce6f5f700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce00b5540 con 0x7f0ce0071c50 2023-07-12T02:21:40.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.822+0000 7f0ce575c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0ce0071c50 0x7f0ce00b42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:21:40.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.822+0000 7f0ce575c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0ce0071c50 0x7f0ce00b42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35644/0 (socket says 172.21.15.60:35644) 2023-07-12T02:21:40.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.822+0000 7f0ce575c700 1 -- 172.21.15.60:0/3701186864 learned_addr learned my addr 172.21.15.60:0/3701186864 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:21:40.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.822+0000 7f0ce575c700 1 -- 172.21.15.60:0/3701186864 >> v1:172.21.15.79:6789/0 conn(0x7f0ce0140640 legacy=0x7f0ce00b82d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-12T02:21:40.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.822+0000 7f0ce575c700 1 -- 172.21.15.60:0/3701186864 >> v1:172.21.15.60:6789/0 conn(0x7f0ce00b4830 legacy=0x7f0ce0150d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:21:40.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.822+0000 7f0ce575c700 1 -- 172.21.15.60:0/3701186864 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce0146720 con 0x7f0ce0071c50 2023-07-12T02:21:40.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.823+0000 7f0ce575c700 1 --2- 172.21.15.60:0/3701186864 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ce0071c50 0x7f0ce00b42f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0cd00088f0 tx=0x7f0cd000d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3010fde696d74e7 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:21:40.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.825+0000 7f0ce4f5b700 1 -- 172.21.15.60:0/3701186864 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0010070 con 0x7f0ce0071c50 2023-07-12T02:21:40.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.825+0000 7f0ce4f5b700 1 -- 172.21.15.60:0/3701186864 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd000da00 con 0x7f0ce0071c50 2023-07-12T02:21:40.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.825+0000 7f0ce4f5b700 1 -- 172.21.15.60:0/3701186864 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd000dd90 con 0x7f0ce0071c50 2023-07-12T02:21:40.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.826+0000 7f0ce6f5f700 1 -- 172.21.15.60:0/3701186864 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ce0071c50 msgr2=0x7f0ce00b42f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:21:40.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.826+0000 7f0ce6f5f700 1 --2- 172.21.15.60:0/3701186864 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ce0071c50 0x7f0ce00b42f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0cd00088f0 tx=0x7f0cd000d330 comp rx=0 tx=0).stop 2023-07-12T02:21:40.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.828+0000 7f0ce6f5f700 1 -- 172.21.15.60:0/3701186864 shutdown_connections 2023-07-12T02:21:40.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.828+0000 7f0ce6f5f700 1 --2- 172.21.15.60:0/3701186864 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ce0071c50 0x7f0ce00b42f0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:40.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.828+0000 7f0ce6f5f700 1 -- 172.21.15.60:0/3701186864 >> 172.21.15.60:0/3701186864 conn(0x7f0ce0069f30 msgr2=0x7f0ce006a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:21:40.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.835+0000 7f0ce6f5f700 1 -- 172.21.15.60:0/3701186864 shutdown_connections 2023-07-12T02:21:40.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.841+0000 7f0ce6f5f700 1 -- 172.21.15.60:0/3701186864 wait complete. 2023-07-12T02:21:40.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.842+0000 7f0ce6f5f700 1 Processor -- start 2023-07-12T02:21:40.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.854+0000 7f0ce6f5f700 1 -- start start 2023-07-12T02:21:40.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.855+0000 7f0ce6f5f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ce0071c50 0x7f0ce01e0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:21:40.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.855+0000 7f0ce6f5f700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0ce00b4830 0x7f0ce01ddf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:21:40.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.855+0000 7f0ce6f5f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ce0140640 0x7f0ce01dfa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:21:40.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.855+0000 7f0ce6f5f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce01ed800 con 0x7f0ce0140640 2023-07-12T02:21:40.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.855+0000 7f0ce6f5f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce01eca40 con 0x7f0ce0071c50 2023-07-12T02:21:40.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.855+0000 7f0ce6f5f700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce01ecd20 con 0x7f0ce00b4830 2023-07-12T02:21:40.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.855+0000 7f0ce675e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ce0140640 0x7f0ce01dfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:21:40.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.855+0000 7f0ce675e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ce0140640 0x7f0ce01dfa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35656/0 (socket says 172.21.15.60:35656) 2023-07-12T02:21:40.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.855+0000 7f0ce675e700 1 -- 172.21.15.60:0/3885830357 learned_addr learned my addr 172.21.15.60:0/3885830357 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:21:40.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.855+0000 7f0ce575c700 1 --2- 172.21.15.60:0/3885830357 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0ce00b4830 0x7f0ce01ddf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:21:40.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.855+0000 7f0ce675e700 1 -- 172.21.15.60:0/3885830357 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0ce00b4830 msgr2=0x7f0ce01ddf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:21:40.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.855+0000 7f0ce675e700 1 --2- 172.21.15.60:0/3885830357 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0ce00b4830 0x7f0ce01ddf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:40.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.855+0000 7f0ce675e700 1 -- 172.21.15.60:0/3885830357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ce0071c50 msgr2=0x7f0ce01e0a30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-12T02:21:40.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.855+0000 7f0ce675e700 1 --2- 172.21.15.60:0/3885830357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ce0071c50 0x7f0ce01e0a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:40.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.855+0000 7f0ce675e700 1 -- 172.21.15.60:0/3885830357 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd00085d0 con 0x7f0ce0140640 2023-07-12T02:21:40.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.856+0000 7f0ce675e700 1 --2- 172.21.15.60:0/3885830357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ce0140640 0x7f0ce01dfa30 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0cd800cba0 tx=0x7f0cd800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:21:40.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.878+0000 7f0cd67fc700 1 -- 172.21.15.60:0/3885830357 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd800ab80 con 0x7f0ce0140640 2023-07-12T02:21:40.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.878+0000 7f0cd67fc700 1 -- 172.21.15.60:0/3885830357 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd800ace0 con 0x7f0ce0140640 2023-07-12T02:21:40.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.878+0000 7f0cd67fc700 1 -- 172.21.15.60:0/3885830357 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd8012620 con 0x7f0ce0140640 2023-07-12T02:21:40.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.878+0000 7f0ce6f5f700 1 -- 172.21.15.60:0/3885830357 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ce01ed000 con 0x7f0ce0140640 2023-07-12T02:21:40.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.878+0000 7f0ce6f5f700 1 -- 172.21.15.60:0/3885830357 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ce01dacc0 con 0x7f0ce0140640 2023-07-12T02:21:40.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.884+0000 7f0cd67fc700 1 -- 172.21.15.60:0/3885830357 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0cd8012780 con 0x7f0ce0140640 2023-07-12T02:21:40.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.884+0000 7f0cd67fc700 1 --2- 172.21.15.60:0/3885830357 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f0cc406ad00 0x7f0cc406d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:21:40.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.884+0000 7f0cd67fc700 1 -- 172.21.15.60:0/3885830357 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f0cd8089ba0 con 0x7f0ce0140640 2023-07-12T02:21:40.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.885+0000 7f0ce5f5d700 1 --2- 172.21.15.60:0/3885830357 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f0cc406ad00 0x7f0cc406d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:21:40.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.886+0000 7f0ce5f5d700 1 --2- 172.21.15.60:0/3885830357 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f0cc406ad00 0x7f0cc406d1b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc006fd0 tx=0x7f0cdc006bc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:21:40.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.892+0000 7f0ce6f5f700 1 -- 172.21.15.60:0/3885830357 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cc80052f0 con 0x7f0ce0140640 2023-07-12T02:21:40.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:40.913+0000 7f0cd67fc700 1 -- 172.21.15.60:0/3885830357 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f0cd8016080 con 0x7f0ce0140640 2023-07-12T02:21:41.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:41.524+0000 7f0ce6f5f700 1 -- 172.21.15.60:0/3885830357 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0cc8005b20 con 0x7f0ce0140640 2023-07-12T02:21:41.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:41.537+0000 7f0cd67fc700 1 -- 172.21.15.60:0/3885830357 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v34) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0cd8054cb0 con 0x7f0ce0140640 2023-07-12T02:21:41.545 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2023-07-12T02:21:41.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:41.550+0000 7f0ce6f5f700 1 -- 172.21.15.60:0/3885830357 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f0cc406ad00 msgr2=0x7f0cc406d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:21:41.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:41.550+0000 7f0ce6f5f700 1 --2- 172.21.15.60:0/3885830357 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f0cc406ad00 0x7f0cc406d1b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc006fd0 tx=0x7f0cdc006bc0 comp rx=0 tx=0).stop 2023-07-12T02:21:41.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:41.550+0000 7f0ce6f5f700 1 -- 172.21.15.60:0/3885830357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ce0140640 msgr2=0x7f0ce01dfa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:21:41.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:41.550+0000 7f0ce6f5f700 1 --2- 172.21.15.60:0/3885830357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ce0140640 0x7f0ce01dfa30 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0cd800cba0 tx=0x7f0cd800cf60 comp rx=0 tx=0).stop 2023-07-12T02:21:41.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:41.551+0000 7f0ce6f5f700 1 -- 172.21.15.60:0/3885830357 shutdown_connections 2023-07-12T02:21:41.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:41.551+0000 7f0ce6f5f700 1 --2- 172.21.15.60:0/3885830357 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f0cc406ad00 0x7f0cc406d1b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:41.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:41.551+0000 7f0ce6f5f700 1 --2- 172.21.15.60:0/3885830357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ce0140640 0x7f0ce01dfa30 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:41.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:41.551+0000 7f0ce6f5f700 1 --2- 172.21.15.60:0/3885830357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ce0071c50 0x7f0ce01e0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:41.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:41.551+0000 7f0ce6f5f700 1 --2- 172.21.15.60:0/3885830357 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0ce00b4830 0x7f0ce01ddf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:41.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:41.551+0000 7f0ce6f5f700 1 -- 172.21.15.60:0/3885830357 >> 172.21.15.60:0/3885830357 conn(0x7f0ce0069f30 msgr2=0x7f0ce00b40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:21:41.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:41.560+0000 7f0ce6f5f700 1 -- 172.21.15.60:0/3885830357 shutdown_connections 2023-07-12T02:21:41.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:41.561+0000 7f0ce6f5f700 1 -- 172.21.15.60:0/3885830357 wait complete. 2023-07-12T02:21:41.634 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-12T02:21:42.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.208+0000 7f90a5549700 1 Processor -- start 2023-07-12T02:21:42.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.213+0000 7f90a5549700 1 -- start start 2023-07-12T02:21:42.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.214+0000 7f90a5549700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f90a00b9580 0x7f90a014ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:21:42.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.214+0000 7f90a5549700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f90a00b9950 0x7f90a00b7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:21:42.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.214+0000 7f90a5549700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90a00b8430 0x7f90a00bc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:21:42.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.214+0000 7f90a5549700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90a014fa00 con 0x7f90a00b9580 2023-07-12T02:21:42.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.214+0000 7f90a5549700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90a00b75b0 con 0x7f90a00b9950 2023-07-12T02:21:42.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.214+0000 7f90a5549700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a00b9dd0 con 0x7f90a00b8430 2023-07-12T02:21:42.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.214+0000 7f909ffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f90a00b9580 0x7f90a014ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:21:42.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.214+0000 7f909ffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f90a00b9580 0x7f90a014ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35664/0 (socket says 172.21.15.60:35664) 2023-07-12T02:21:42.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.214+0000 7f909ffff700 1 -- 172.21.15.60:0/1888335212 learned_addr learned my addr 172.21.15.60:0/1888335212 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:21:42.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.215+0000 7f909ffff700 1 -- 172.21.15.60:0/1888335212 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90a00b8430 msgr2=0x7f90a00bc2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-12T02:21:42.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.215+0000 7f909ffff700 1 --2- 172.21.15.60:0/1888335212 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90a00b8430 0x7f90a00bc2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:42.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.215+0000 7f909ffff700 1 -- 172.21.15.60:0/1888335212 >> v2:172.21.15.79:3300/0 conn(0x7f90a00b9950 msgr2=0x7f90a00b7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:21:42.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.215+0000 7f909ffff700 1 --2- 172.21.15.60:0/1888335212 >> v2:172.21.15.79:3300/0 conn(0x7f90a00b9950 0x7f90a00b7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:42.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.215+0000 7f909ffff700 1 -- 172.21.15.60:0/1888335212 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a00b8870 con 0x7f90a00b9580 2023-07-12T02:21:42.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.216+0000 7f909ffff700 1 --2- 172.21.15.60:0/1888335212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90a00b9580 0x7f90a014ea60 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f90a0067270 tx=0x7f9094009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=708d90bef9ff4fe8 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:21:42.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.222+0000 7f909effd700 1 -- 172.21.15.60:0/1888335212 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909400b870 con 0x7f90a00b9580 2023-07-12T02:21:42.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.222+0000 7f909effd700 1 -- 172.21.15.60:0/1888335212 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909400b9d0 con 0x7f90a00b9580 2023-07-12T02:21:42.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.222+0000 7f909effd700 1 -- 172.21.15.60:0/1888335212 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909400bd40 con 0x7f90a00b9580 2023-07-12T02:21:42.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.225+0000 7f90a5549700 1 -- 172.21.15.60:0/1888335212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90a00b9580 msgr2=0x7f90a014ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:21:42.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.225+0000 7f90a5549700 1 --2- 172.21.15.60:0/1888335212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90a00b9580 0x7f90a014ea60 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f90a0067270 tx=0x7f9094009bd0 comp rx=0 tx=0).stop 2023-07-12T02:21:42.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.228+0000 7f90a5549700 1 -- 172.21.15.60:0/1888335212 shutdown_connections 2023-07-12T02:21:42.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.228+0000 7f90a5549700 1 --2- 172.21.15.60:0/1888335212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90a00b9580 0x7f90a014ea60 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:42.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.228+0000 7f90a5549700 1 --2- 172.21.15.60:0/1888335212 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90a00b8430 0x7f90a00bc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:42.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.228+0000 7f90a5549700 1 --2- 172.21.15.60:0/1888335212 >> v2:172.21.15.79:3300/0 conn(0x7f90a00b9950 0x7f90a00b7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:42.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.228+0000 7f90a5549700 1 -- 172.21.15.60:0/1888335212 >> 172.21.15.60:0/1888335212 conn(0x7f90a00bd190 msgr2=0x7f90a00bd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:21:42.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.251+0000 7f90a5549700 1 -- 172.21.15.60:0/1888335212 shutdown_connections 2023-07-12T02:21:42.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.255+0000 7f90a5549700 1 -- 172.21.15.60:0/1888335212 wait complete. 2023-07-12T02:21:42.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.256+0000 7f90a5549700 1 Processor -- start 2023-07-12T02:21:42.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.257+0000 7f90a5549700 1 -- start start 2023-07-12T02:21:42.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.258+0000 7f90a5549700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90a00b8430 0x7f90a01d81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:21:42.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.258+0000 7f90a5549700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90a00b9580 0x7f90a01e4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:21:42.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.258+0000 7f90a5549700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90a00b9950 0x7f90a00a5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:21:42.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.258+0000 7f90a5549700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a01e43f0 con 0x7f90a00b9950 2023-07-12T02:21:42.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.258+0000 7f90a5549700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a01d8dd0 con 0x7f90a00b8430 2023-07-12T02:21:42.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.258+0000 7f90a5549700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a01d9b80 con 0x7f90a00b9580 2023-07-12T02:21:42.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.258+0000 7f90a4d48700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90a00b9950 0x7f90a00a5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:21:42.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.258+0000 7f90a4d48700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90a00b9950 0x7f90a00a5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35672/0 (socket says 172.21.15.60:35672) 2023-07-12T02:21:42.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.258+0000 7f90a4d48700 1 -- 172.21.15.60:0/3740603939 learned_addr learned my addr 172.21.15.60:0/3740603939 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:21:42.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.259+0000 7f90a4d48700 1 -- 172.21.15.60:0/3740603939 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90a00b9580 msgr2=0x7f90a01e4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:21:42.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.259+0000 7f90a4d48700 1 --2- 172.21.15.60:0/3740603939 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90a00b9580 0x7f90a01e4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:42.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.259+0000 7f90a4d48700 1 -- 172.21.15.60:0/3740603939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90a00b8430 msgr2=0x7f90a01d81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:21:42.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.259+0000 7f90a4d48700 1 --2- 172.21.15.60:0/3740603939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90a00b8430 0x7f90a01d81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:42.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.259+0000 7f90a4d48700 1 -- 172.21.15.60:0/3740603939 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9094009550 con 0x7f90a00b9950 2023-07-12T02:21:42.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.259+0000 7f90a4d48700 1 --2- 172.21.15.60:0/3740603939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90a00b9950 0x7f90a00a5de0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f909800b7b0 tx=0x7f909800bb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:21:42.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.260+0000 7f909cff9700 1 -- 172.21.15.60:0/3740603939 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9098010880 con 0x7f90a00b9950 2023-07-12T02:21:42.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.261+0000 7f909cff9700 1 -- 172.21.15.60:0/3740603939 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90980109e0 con 0x7f90a00b9950 2023-07-12T02:21:42.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.261+0000 7f909cff9700 1 -- 172.21.15.60:0/3740603939 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9098010d90 con 0x7f90a00b9950 2023-07-12T02:21:42.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.261+0000 7f90a5549700 1 -- 172.21.15.60:0/3740603939 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90a01da1f0 con 0x7f90a00b9950 2023-07-12T02:21:42.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.261+0000 7f90a5549700 1 -- 172.21.15.60:0/3740603939 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a01d9dd0 con 0x7f90a00b9950 2023-07-12T02:21:42.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.266+0000 7f909cff9700 1 -- 172.21.15.60:0/3740603939 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f909800f3d0 con 0x7f90a00b9950 2023-07-12T02:21:42.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.266+0000 7f90a5549700 1 -- 172.21.15.60:0/3740603939 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f908c005320 con 0x7f90a00b9950 2023-07-12T02:21:42.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.266+0000 7f909cff9700 1 --2- 172.21.15.60:0/3740603939 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f908806af10 0x7f908806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:21:42.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.266+0000 7f909cff9700 1 -- 172.21.15.60:0/3740603939 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f9098089910 con 0x7f90a00b9950 2023-07-12T02:21:42.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.277+0000 7f909cff9700 1 -- 172.21.15.60:0/3740603939 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f9098058440 con 0x7f90a00b9950 2023-07-12T02:21:42.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.281+0000 7f909ffff700 1 --2- 172.21.15.60:0/3740603939 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f908806af10 0x7f908806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:21:42.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.286+0000 7f909ffff700 1 --2- 172.21.15.60:0/3740603939 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f908806af10 0x7f908806d3c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9094009c10 tx=0x7f9094010000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:21:42.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.714+0000 7f90a5549700 1 -- 172.21.15.60:0/3740603939 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f908c005b50 con 0x7f90a00b9950 2023-07-12T02:21:42.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.717+0000 7f909cff9700 1 -- 172.21.15.60:0/3740603939 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7f909801e020 con 0x7f90a00b9950 2023-07-12T02:21:42.732 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-07-12T02:21:42.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.727+0000 7f90a5549700 1 -- 172.21.15.60:0/3740603939 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f908806af10 msgr2=0x7f908806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:21:42.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.727+0000 7f90a5549700 1 --2- 172.21.15.60:0/3740603939 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f908806af10 0x7f908806d3c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9094009c10 tx=0x7f9094010000 comp rx=0 tx=0).stop 2023-07-12T02:21:42.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.727+0000 7f90a5549700 1 -- 172.21.15.60:0/3740603939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90a00b9950 msgr2=0x7f90a00a5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:21:42.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.727+0000 7f90a5549700 1 --2- 172.21.15.60:0/3740603939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90a00b9950 0x7f90a00a5de0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f909800b7b0 tx=0x7f909800bb70 comp rx=0 tx=0).stop 2023-07-12T02:21:42.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.728+0000 7f90a5549700 1 -- 172.21.15.60:0/3740603939 shutdown_connections 2023-07-12T02:21:42.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.728+0000 7f90a5549700 1 --2- 172.21.15.60:0/3740603939 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f908806af10 0x7f908806d3c0 secure :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9094009c10 tx=0x7f9094010000 comp rx=0 tx=0).stop 2023-07-12T02:21:42.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.728+0000 7f90a5549700 1 --2- 172.21.15.60:0/3740603939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90a00b9950 0x7f90a00a5de0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:42.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.728+0000 7f90a5549700 1 --2- 172.21.15.60:0/3740603939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90a00b8430 0x7f90a01d81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:42.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.728+0000 7f90a5549700 1 --2- 172.21.15.60:0/3740603939 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90a00b9580 0x7f90a01e4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:42.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.728+0000 7f90a5549700 1 -- 172.21.15.60:0/3740603939 >> 172.21.15.60:0/3740603939 conn(0x7f90a00bd190 msgr2=0x7f90a014a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:21:42.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.743+0000 7f90a5549700 1 -- 172.21.15.60:0/3740603939 shutdown_connections 2023-07-12T02:21:42.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:42.751+0000 7f90a5549700 1 -- 172.21.15.60:0/3740603939 wait complete. 2023-07-12T02:21:42.805 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-12T02:21:43.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.217+0000 7ff6da294700 1 Processor -- start 2023-07-12T02:21:43.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.217+0000 7ff6da294700 1 -- start start 2023-07-12T02:21:43.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.219+0000 7ff6da294700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff6d40b8ee0 0x7ff6d40b5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:21:43.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.219+0000 7ff6da294700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6d40b7cc0 0x7ff6d41483c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:21:43.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.219+0000 7ff6da294700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff6d40b8140 0x7ff6d4148900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:21:43.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.219+0000 7ff6da294700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6d40b4210 con 0x7ff6d40b8ee0 2023-07-12T02:21:43.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.219+0000 7ff6da294700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6d40b49d0 con 0x7ff6d40b8140 2023-07-12T02:21:43.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.219+0000 7ff6da294700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d40b3680 con 0x7ff6d40b7cc0 2023-07-12T02:21:43.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.219+0000 7ff6d9a93700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff6d40b8140 0x7ff6d4148900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:21:43.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.219+0000 7ff6d9a93700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff6d40b8140 0x7ff6d4148900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.60:56856/0 (socket says 172.21.15.60:56856) 2023-07-12T02:21:43.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.219+0000 7ff6d9a93700 1 -- 172.21.15.60:0/3287212162 learned_addr learned my addr 172.21.15.60:0/3287212162 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:21:43.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.220+0000 7ff6d9a93700 1 -- 172.21.15.60:0/3287212162 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6d40b7cc0 msgr2=0x7ff6d41483c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-12T02:21:43.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.220+0000 7ff6d9a93700 1 --2- 172.21.15.60:0/3287212162 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6d40b7cc0 0x7ff6d41483c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:43.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.220+0000 7ff6d9a93700 1 -- 172.21.15.60:0/3287212162 >> v2:172.21.15.60:3300/0 conn(0x7ff6d40b8ee0 msgr2=0x7ff6d40b5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:21:43.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.220+0000 7ff6d9a93700 1 --2- 172.21.15.60:0/3287212162 >> v2:172.21.15.60:3300/0 conn(0x7ff6d40b8ee0 0x7ff6d40b5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:43.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.220+0000 7ff6d9a93700 1 -- 172.21.15.60:0/3287212162 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d40b3960 con 0x7ff6d40b8140 2023-07-12T02:21:43.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.229+0000 7ff6d9a93700 1 --2- 172.21.15.60:0/3287212162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6d40b8140 0x7ff6d4148900 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff6d40b4e60 tx=0x7ff6d0009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d223b3590333627 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:21:43.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.247+0000 7ff6cbfff700 1 -- 172.21.15.60:0/3287212162 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d000b870 con 0x7ff6d40b8140 2023-07-12T02:21:43.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.247+0000 7ff6cbfff700 1 -- 172.21.15.60:0/3287212162 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d000b9d0 con 0x7ff6d40b8140 2023-07-12T02:21:43.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.247+0000 7ff6cbfff700 1 -- 172.21.15.60:0/3287212162 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d000bd60 con 0x7ff6d40b8140 2023-07-12T02:21:43.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.248+0000 7ff6da294700 1 -- 172.21.15.60:0/3287212162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6d40b8140 msgr2=0x7ff6d4148900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:21:43.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.248+0000 7ff6da294700 1 --2- 172.21.15.60:0/3287212162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6d40b8140 0x7ff6d4148900 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff6d40b4e60 tx=0x7ff6d0009bd0 comp rx=0 tx=0).stop 2023-07-12T02:21:43.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.251+0000 7ff6da294700 1 -- 172.21.15.60:0/3287212162 shutdown_connections 2023-07-12T02:21:43.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.251+0000 7ff6da294700 1 --2- 172.21.15.60:0/3287212162 >> v2:172.21.15.60:3300/0 conn(0x7ff6d40b8ee0 0x7ff6d40b5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:43.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.251+0000 7ff6da294700 1 --2- 172.21.15.60:0/3287212162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6d40b8140 0x7ff6d4148900 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:43.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.251+0000 7ff6da294700 1 --2- 172.21.15.60:0/3287212162 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6d40b7cc0 0x7ff6d41483c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:43.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.251+0000 7ff6da294700 1 -- 172.21.15.60:0/3287212162 >> 172.21.15.60:0/3287212162 conn(0x7ff6d4069f30 msgr2=0x7ff6d406a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:21:43.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.287+0000 7ff6da294700 1 -- 172.21.15.60:0/3287212162 shutdown_connections 2023-07-12T02:21:43.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.288+0000 7ff6da294700 1 -- 172.21.15.60:0/3287212162 wait complete. 2023-07-12T02:21:43.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.289+0000 7ff6da294700 1 Processor -- start 2023-07-12T02:21:43.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.294+0000 7ff6da294700 1 -- start start 2023-07-12T02:21:43.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.295+0000 7ff6da294700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6d40b7cc0 0x7ff6d414f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:21:43.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.295+0000 7ff6da294700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6d40b8140 0x7ff6d4128400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:21:43.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.295+0000 7ff6da294700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6d40b8ee0 0x7ff6d414c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:21:43.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.295+0000 7ff6da294700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d4136430 con 0x7ff6d40b8140 2023-07-12T02:21:43.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.295+0000 7ff6da294700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d414f780 con 0x7ff6d40b8ee0 2023-07-12T02:21:43.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.295+0000 7ff6da294700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d40bb250 con 0x7ff6d40b7cc0 2023-07-12T02:21:43.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.296+0000 7ff6d8a91700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6d40b8140 0x7ff6d4128400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:21:43.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.296+0000 7ff6d8a91700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6d40b8140 0x7ff6d4128400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35700/0 (socket says 172.21.15.60:35700) 2023-07-12T02:21:43.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.296+0000 7ff6d8a91700 1 -- 172.21.15.60:0/3750793191 learned_addr learned my addr 172.21.15.60:0/3750793191 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:21:43.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.296+0000 7ff6d8a91700 1 -- 172.21.15.60:0/3750793191 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6d40b7cc0 msgr2=0x7ff6d414f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:21:43.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.296+0000 7ff6d8a91700 1 --2- 172.21.15.60:0/3750793191 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6d40b7cc0 0x7ff6d414f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:43.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.296+0000 7ff6d8a91700 1 -- 172.21.15.60:0/3750793191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6d40b8ee0 msgr2=0x7ff6d414c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:21:43.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.296+0000 7ff6d8a91700 1 --2- 172.21.15.60:0/3750793191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6d40b8ee0 0x7ff6d414c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:43.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.296+0000 7ff6d8a91700 1 -- 172.21.15.60:0/3750793191 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d0009550 con 0x7ff6d40b8140 2023-07-12T02:21:43.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.297+0000 7ff6d8a91700 1 --2- 172.21.15.60:0/3750793191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6d40b8140 0x7ff6d4128400 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc00ba50 tx=0x7ff6cc00be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:21:43.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.315+0000 7ff6c9ffb700 1 -- 172.21.15.60:0/3750793191 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc00cab0 con 0x7ff6d40b8140 2023-07-12T02:21:43.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.315+0000 7ff6c9ffb700 1 -- 172.21.15.60:0/3750793191 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6cc00cc30 con 0x7ff6d40b8140 2023-07-12T02:21:43.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.315+0000 7ff6c9ffb700 1 -- 172.21.15.60:0/3750793191 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc014440 con 0x7ff6d40b8140 2023-07-12T02:21:43.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.315+0000 7ff6da294700 1 -- 172.21.15.60:0/3750793191 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6d414ea40 con 0x7ff6d40b8140 2023-07-12T02:21:43.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.316+0000 7ff6da294700 1 -- 172.21.15.60:0/3750793191 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6d414da00 con 0x7ff6d40b8140 2023-07-12T02:21:43.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.331+0000 7ff6c9ffb700 1 -- 172.21.15.60:0/3750793191 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff6cc0145a0 con 0x7ff6d40b8140 2023-07-12T02:21:43.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.332+0000 7ff6c9ffb700 1 --2- 172.21.15.60:0/3750793191 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ff6c006af10 0x7ff6c006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:21:43.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.332+0000 7ff6c9ffb700 1 -- 172.21.15.60:0/3750793191 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6177+0+0 (secure 0 0 0) 0x7ff6cc0891a0 con 0x7ff6d40b8140 2023-07-12T02:21:43.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.336+0000 7ff6d9292700 1 --2- 172.21.15.60:0/3750793191 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ff6c006af10 0x7ff6c006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:21:43.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.338+0000 7ff6d9292700 1 --2- 172.21.15.60:0/3750793191 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ff6c006af10 0x7ff6c006d3c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4009710 tx=0x7ff6c4006c80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:21:43.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.368+0000 7ff6da294700 1 -- 172.21.15.60:0/3750793191 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6b40052f0 con 0x7ff6d40b8140 2023-07-12T02:21:43.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:43.383+0000 7ff6c9ffb700 1 -- 172.21.15.60:0/3750793191 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7ff6cc0542f0 con 0x7ff6d40b8140 2023-07-12T02:21:44.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.057+0000 7ff6da294700 1 -- 172.21.15.60:0/3750793191 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff6b4005b20 con 0x7ff6d40b8140 2023-07-12T02:21:44.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.062+0000 7ff6c9ffb700 1 -- 172.21.15.60:0/3750793191 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff6cc019070 con 0x7ff6d40b8140 2023-07-12T02:21:44.083 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-07-12T02:21:44.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.101+0000 7ff6da294700 1 -- 172.21.15.60:0/3750793191 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ff6c006af10 msgr2=0x7ff6c006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:21:44.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.101+0000 7ff6da294700 1 --2- 172.21.15.60:0/3750793191 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ff6c006af10 0x7ff6c006d3c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4009710 tx=0x7ff6c4006c80 comp rx=0 tx=0).stop 2023-07-12T02:21:44.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.101+0000 7ff6da294700 1 -- 172.21.15.60:0/3750793191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6d40b8140 msgr2=0x7ff6d4128400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:21:44.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.101+0000 7ff6da294700 1 --2- 172.21.15.60:0/3750793191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6d40b8140 0x7ff6d4128400 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc00ba50 tx=0x7ff6cc00be10 comp rx=0 tx=0).stop 2023-07-12T02:21:44.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.112+0000 7ff6da294700 1 -- 172.21.15.60:0/3750793191 shutdown_connections 2023-07-12T02:21:44.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.112+0000 7ff6da294700 1 --2- 172.21.15.60:0/3750793191 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7ff6c006af10 0x7ff6c006d3c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:44.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.112+0000 7ff6da294700 1 --2- 172.21.15.60:0/3750793191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6d40b8ee0 0x7ff6d414c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:44.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.112+0000 7ff6da294700 1 --2- 172.21.15.60:0/3750793191 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6d40b7cc0 0x7ff6d414f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:44.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.112+0000 7ff6da294700 1 --2- 172.21.15.60:0/3750793191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6d40b8140 0x7ff6d4128400 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:44.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.112+0000 7ff6da294700 1 -- 172.21.15.60:0/3750793191 >> 172.21.15.60:0/3750793191 conn(0x7ff6d4069f30 msgr2=0x7ff6d4137470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:21:44.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.117+0000 7ff6da294700 1 -- 172.21.15.60:0/3750793191 shutdown_connections 2023-07-12T02:21:44.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.117+0000 7ff6da294700 1 -- 172.21.15.60:0/3750793191 wait complete. 2023-07-12T02:21:44.227 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-12T02:21:44.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.722+0000 7fa12c091700 1 Processor -- start 2023-07-12T02:21:44.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.723+0000 7fa12c091700 1 -- start start 2023-07-12T02:21:44.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.724+0000 7fa12c091700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa12414bf30 0x7fa1240b8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:21:44.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.724+0000 7fa12c091700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa124145fc0 0x7fa124153080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:21:44.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.724+0000 7fa12c091700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa124070130 con 0x7fa124071d20 2023-07-12T02:21:44.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.724+0000 7fa12c091700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa124070f80 con 0x7fa12414bf30 2023-07-12T02:21:44.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.724+0000 7fa12c091700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa124071260 con 0x7fa124145fc0 2023-07-12T02:21:44.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.724+0000 7fa12a62e700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa124145fc0 0x7fa124153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:21:44.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.724+0000 7fa12a62e700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa124145fc0 0x7fa124153080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.60:39562/0 (socket says 172.21.15.60:39562) 2023-07-12T02:21:44.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.724+0000 7fa12a62e700 1 -- 172.21.15.60:0/2285364171 learned_addr learned my addr 172.21.15.60:0/2285364171 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:21:44.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.727+0000 7fa129e2d700 1 --2- 172.21.15.60:0/2285364171 >> v2:172.21.15.60:3300/0 conn(0x7fa12414bf30 0x7fa1240b8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:21:44.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.727+0000 7fa129e2d700 1 -- 172.21.15.60:0/2285364171 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa124145fc0 msgr2=0x7fa124153080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:21:44.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.727+0000 7fa129e2d700 1 --2- 172.21.15.60:0/2285364171 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa124145fc0 0x7fa124153080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:44.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.727+0000 7fa129e2d700 1 -- 172.21.15.60:0/2285364171 >> v1:172.21.15.79:6789/0 conn(0x7fa124071d20 legacy=0x7fa1241458b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:21:44.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.727+0000 7fa129e2d700 1 -- 172.21.15.60:0/2285364171 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa124071540 con 0x7fa12414bf30 2023-07-12T02:21:44.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.744+0000 7fa129e2d700 1 --2- 172.21.15.60:0/2285364171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa12414bf30 0x7fa1240b8ff0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa120009840 tx=0x7fa120009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d08ae416dae11a0d server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:21:44.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.775+0000 7fa128e2b700 1 -- 172.21.15.60:0/2285364171 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa120004230 con 0x7fa12414bf30 2023-07-12T02:21:44.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.775+0000 7fa128e2b700 1 -- 172.21.15.60:0/2285364171 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa120004390 con 0x7fa12414bf30 2023-07-12T02:21:44.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.775+0000 7fa128e2b700 1 -- 172.21.15.60:0/2285364171 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1200036a0 con 0x7fa12414bf30 2023-07-12T02:21:44.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.776+0000 7fa12c091700 1 -- 172.21.15.60:0/2285364171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa12414bf30 msgr2=0x7fa1240b8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:21:44.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.776+0000 7fa12c091700 1 --2- 172.21.15.60:0/2285364171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa12414bf30 0x7fa1240b8ff0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa120009840 tx=0x7fa120009b50 comp rx=0 tx=0).stop 2023-07-12T02:21:44.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.777+0000 7fa12c091700 1 -- 172.21.15.60:0/2285364171 shutdown_connections 2023-07-12T02:21:44.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.777+0000 7fa12c091700 1 --2- 172.21.15.60:0/2285364171 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa124145fc0 0x7fa124153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:44.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.777+0000 7fa12c091700 1 --2- 172.21.15.60:0/2285364171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa12414bf30 0x7fa1240b8ff0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:44.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.777+0000 7fa12c091700 1 -- 172.21.15.60:0/2285364171 >> 172.21.15.60:0/2285364171 conn(0x7fa1240be670 msgr2=0x7fa1240bea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:21:44.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.777+0000 7fa12c091700 1 -- 172.21.15.60:0/2285364171 shutdown_connections 2023-07-12T02:21:44.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.777+0000 7fa12c091700 1 -- 172.21.15.60:0/2285364171 wait complete. 2023-07-12T02:21:44.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.779+0000 7fa12c091700 1 Processor -- start 2023-07-12T02:21:44.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.791+0000 7fa12c091700 1 -- start start 2023-07-12T02:21:44.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.792+0000 7fa12c091700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa124071d20 0x7fa1240b83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:21:44.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.792+0000 7fa12c091700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa124145fc0 0x7fa1240b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:21:44.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.792+0000 7fa12c091700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa12414bf30 0x7fa1240b76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:21:44.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.792+0000 7fa12c091700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1240b8910 con 0x7fa124071d20 2023-07-12T02:21:44.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.792+0000 7fa12c091700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1241d40b0 con 0x7fa12414bf30 2023-07-12T02:21:44.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.792+0000 7fa12c091700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1241d3a60 con 0x7fa124145fc0 2023-07-12T02:21:44.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.793+0000 7fa129e2d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa124071d20 0x7fa1240b83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:21:44.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.793+0000 7fa129e2d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa124071d20 0x7fa1240b83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35722/0 (socket says 172.21.15.60:35722) 2023-07-12T02:21:44.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.793+0000 7fa129e2d700 1 -- 172.21.15.60:0/2540399075 learned_addr learned my addr 172.21.15.60:0/2540399075 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:21:44.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.794+0000 7fa129e2d700 1 -- 172.21.15.60:0/2540399075 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa124145fc0 msgr2=0x7fa1240b71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:21:44.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.794+0000 7fa129e2d700 1 --2- 172.21.15.60:0/2540399075 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa124145fc0 0x7fa1240b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:44.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.794+0000 7fa129e2d700 1 -- 172.21.15.60:0/2540399075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa12414bf30 msgr2=0x7fa1240b76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:21:44.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.794+0000 7fa129e2d700 1 --2- 172.21.15.60:0/2540399075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa12414bf30 0x7fa1240b76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:44.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.794+0000 7fa129e2d700 1 -- 172.21.15.60:0/2540399075 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1200094a0 con 0x7fa124071d20 2023-07-12T02:21:44.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.794+0000 7fa129e2d700 1 --2- 172.21.15.60:0/2540399075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa124071d20 0x7fa1240b83d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa124073c50 tx=0x7fa1200047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:21:44.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.797+0000 7fa11a7fc700 1 -- 172.21.15.60:0/2540399075 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa120011830 con 0x7fa124071d20 2023-07-12T02:21:44.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.797+0000 7fa11a7fc700 1 -- 172.21.15.60:0/2540399075 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa120011990 con 0x7fa124071d20 2023-07-12T02:21:44.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.797+0000 7fa11a7fc700 1 -- 172.21.15.60:0/2540399075 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa120011d40 con 0x7fa124071d20 2023-07-12T02:21:44.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.797+0000 7fa12c091700 1 -- 172.21.15.60:0/2540399075 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1241d3d40 con 0x7fa124071d20 2023-07-12T02:21:44.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.797+0000 7fa12c091700 1 -- 172.21.15.60:0/2540399075 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1241d4800 con 0x7fa124071d20 2023-07-12T02:21:44.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.803+0000 7fa11a7fc700 1 -- 172.21.15.60:0/2540399075 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa12001b440 con 0x7fa124071d20 2023-07-12T02:21:44.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.803+0000 7fa11a7fc700 1 --2- 172.21.15.60:0/2540399075 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fa11006af10 0x7fa11006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:21:44.808 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.804+0000 7fa11a7fc700 1 -- 172.21.15.60:0/2540399075 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fa12008ad40 con 0x7fa124071d20 2023-07-12T02:21:44.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.804+0000 7fa12c091700 1 -- 172.21.15.60:0/2540399075 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa124074360 con 0x7fa124071d20 2023-07-12T02:21:44.809 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.804+0000 7fa12962c700 1 --2- 172.21.15.60:0/2540399075 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fa11006af10 0x7fa11006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:21:44.812 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.808+0000 7fa12962c700 1 --2- 172.21.15.60:0/2540399075 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fa11006af10 0x7fa11006d3c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa124141430 tx=0x7fa114007a20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:21:44.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:44.832+0000 7fa11a7fc700 1 -- 172.21.15.60:0/2540399075 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7fa120055de0 con 0x7fa124071d20 2023-07-12T02:21:45.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.538+0000 7fa12c091700 1 -- 172.21.15.60:0/2540399075 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa1240b6010 con 0x7fa124071d20 2023-07-12T02:21:45.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.539+0000 7fa11a7fc700 1 -- 172.21.15.60:0/2540399075 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa120059400 con 0x7fa124071d20 2023-07-12T02:21:45.547 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-07-12T02:21:45.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.542+0000 7fa12c091700 1 -- 172.21.15.60:0/2540399075 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fa11006af10 msgr2=0x7fa11006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:21:45.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.542+0000 7fa12c091700 1 --2- 172.21.15.60:0/2540399075 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fa11006af10 0x7fa11006d3c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa124141430 tx=0x7fa114007a20 comp rx=0 tx=0).stop 2023-07-12T02:21:45.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.542+0000 7fa12c091700 1 -- 172.21.15.60:0/2540399075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa124071d20 msgr2=0x7fa1240b83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:21:45.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.542+0000 7fa12c091700 1 --2- 172.21.15.60:0/2540399075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa124071d20 0x7fa1240b83d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa124073c50 tx=0x7fa1200047c0 comp rx=0 tx=0).stop 2023-07-12T02:21:45.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.543+0000 7fa12c091700 1 -- 172.21.15.60:0/2540399075 shutdown_connections 2023-07-12T02:21:45.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.543+0000 7fa12c091700 1 --2- 172.21.15.60:0/2540399075 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7fa11006af10 0x7fa11006d3c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:45.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.543+0000 7fa12c091700 1 --2- 172.21.15.60:0/2540399075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa124071d20 0x7fa1240b83d0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:45.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.543+0000 7fa12c091700 1 --2- 172.21.15.60:0/2540399075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa12414bf30 0x7fa1240b76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:45.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.543+0000 7fa12c091700 1 --2- 172.21.15.60:0/2540399075 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa124145fc0 0x7fa1240b71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:45.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.543+0000 7fa12c091700 1 -- 172.21.15.60:0/2540399075 >> 172.21.15.60:0/2540399075 conn(0x7fa1240be670 msgr2=0x7fa1240bcd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:21:45.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.543+0000 7fa12c091700 1 -- 172.21.15.60:0/2540399075 shutdown_connections 2023-07-12T02:21:45.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.543+0000 7fa12c091700 1 -- 172.21.15.60:0/2540399075 wait complete. 2023-07-12T02:21:45.589 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-12T02:21:45.950 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.946+0000 7f9c71e0a700 1 Processor -- start 2023-07-12T02:21:45.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.946+0000 7f9c71e0a700 1 -- start start 2023-07-12T02:21:45.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.947+0000 7f9c71e0a700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c6c148e60 0x7f9c6c15a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:21:45.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.947+0000 7f9c71e0a700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c6c0b3a20 con 0x7f9c6c152040 2023-07-12T02:21:45.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.947+0000 7f9c71e0a700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c6c0b3d00 con 0x7f9c6c0b4810 2023-07-12T02:21:45.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.947+0000 7f9c71e0a700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c0b3fe0 con 0x7f9c6c148e60 2023-07-12T02:21:45.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.952+0000 7f9c6bfff700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c6c148e60 0x7f9c6c15a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:21:45.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.954+0000 7f9c6b7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f9c6c0b4810 0x7f9c6c0b8690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.60:50012/0 (socket says 172.21.15.60:50012) 2023-07-12T02:21:45.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.954+0000 7f9c6b7fe700 1 -- 172.21.15.60:0/1154915273 learned_addr learned my addr 172.21.15.60:0/1154915273 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-07-12T02:21:45.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.960+0000 7f9c6a7fc700 1 -- 172.21.15.60:0/1154915273 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1195600568 0 0) 0x7f9c6c0b3d00 con 0x7f9c6c0b4810 2023-07-12T02:21:45.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.960+0000 7f9c6a7fc700 1 -- 172.21.15.60:0/1154915273 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c540035b0 con 0x7f9c6c0b4810 2023-07-12T02:21:45.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.960+0000 7f9c6a7fc700 1 -- 172.21.15.60:0/1154915273 <== mon.1 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1292576454 0 0) 0x7f9c540035b0 con 0x7f9c6c0b4810 2023-07-12T02:21:45.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.960+0000 7f9c6a7fc700 1 -- 172.21.15.60:0/1154915273 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c6c148e60 msgr2=0x7f9c6c15a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:21:45.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.960+0000 7f9c6a7fc700 1 --2- 172.21.15.60:0/1154915273 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c6c148e60 0x7f9c6c15a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:45.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.960+0000 7f9c6a7fc700 1 -- 172.21.15.60:0/1154915273 >> v1:172.21.15.60:6789/0 conn(0x7f9c6c152040 legacy=0x7f9c6c148750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-12T02:21:45.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.960+0000 7f9c6a7fc700 1 -- 172.21.15.60:0/1154915273 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c6c0b90a0 con 0x7f9c6c0b4810 2023-07-12T02:21:45.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.960+0000 7f9c6a7fc700 1 -- 172.21.15.60:0/1154915273 <== mon.1 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1141905739 0 0) 0x7f9c64001a30 con 0x7f9c6c0b4810 2023-07-12T02:21:45.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.960+0000 7f9c6a7fc700 1 -- 172.21.15.60:0/1154915273 >> v1:172.21.15.79:6789/0 conn(0x7f9c6c0b4810 legacy=0x7f9c6c0b8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:21:45.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.960+0000 7f9c6a7fc700 1 --2- 172.21.15.60:0/1154915273 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c54003a00 0x7f9c54003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:21:45.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.960+0000 7f9c6a7fc700 1 --2- 172.21.15.60:0/1154915273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c540043c0 0x7f9c54004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:21:45.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.960+0000 7f9c6a7fc700 1 --2- 172.21.15.60:0/1154915273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c54005090 0x7f9c5400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:21:45.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.960+0000 7f9c6a7fc700 1 -- 172.21.15.60:0/1154915273 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c0b3fe0 con 0x7f9c540043c0 2023-07-12T02:21:45.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.960+0000 7f9c6a7fc700 1 -- 172.21.15.60:0/1154915273 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5400bfb0 con 0x7f9c54005090 2023-07-12T02:21:45.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.960+0000 7f9c6a7fc700 1 -- 172.21.15.60:0/1154915273 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5400c170 con 0x7f9c54003a00 2023-07-12T02:21:45.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.968+0000 7f9c6b7fe700 1 --2- 172.21.15.60:0/1154915273 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c54003a00 0x7f9c54003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:21:45.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.972+0000 7f9c6b7fe700 1 -- 172.21.15.60:0/1154915273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c54005090 msgr2=0x7f9c5400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-12T02:21:45.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.972+0000 7f9c6b7fe700 1 --2- 172.21.15.60:0/1154915273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c54005090 0x7f9c5400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:45.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.972+0000 7f9c6b7fe700 1 -- 172.21.15.60:0/1154915273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c540043c0 msgr2=0x7f9c54004890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-12T02:21:45.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.972+0000 7f9c6b7fe700 1 --2- 172.21.15.60:0/1154915273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c540043c0 0x7f9c54004890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:45.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.972+0000 7f9c6b7fe700 1 -- 172.21.15.60:0/1154915273 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c6c0b90a0 con 0x7f9c54003a00 2023-07-12T02:21:45.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.977+0000 7f9c6b7fe700 1 --2- 172.21.15.60:0/1154915273 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c54003a00 0x7f9c54003df0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9c6400a8c0 tx=0x7f9c54005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f3f392562861da3 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:21:45.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.981+0000 7f9c6a7fc700 1 -- 172.21.15.60:0/1154915273 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c64012600 con 0x7f9c54003a00 2023-07-12T02:21:45.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.982+0000 7f9c6a7fc700 1 -- 172.21.15.60:0/1154915273 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c64012760 con 0x7f9c54003a00 2023-07-12T02:21:45.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.982+0000 7f9c6a7fc700 1 -- 172.21.15.60:0/1154915273 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c64012b10 con 0x7f9c54003a00 2023-07-12T02:21:45.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.982+0000 7f9c71e0a700 1 -- 172.21.15.60:0/1154915273 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c54003a00 msgr2=0x7f9c54003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:21:45.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.982+0000 7f9c71e0a700 1 --2- 172.21.15.60:0/1154915273 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c54003a00 0x7f9c54003df0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9c6400a8c0 tx=0x7f9c54005880 comp rx=0 tx=0).stop 2023-07-12T02:21:45.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.982+0000 7f9c6bfff700 1 -- 172.21.15.60:0/1154915273 reap_dead start 2023-07-12T02:21:45.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.987+0000 7f9c71e0a700 1 -- 172.21.15.60:0/1154915273 shutdown_connections 2023-07-12T02:21:45.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.987+0000 7f9c71e0a700 1 -- 172.21.15.60:0/1154915273 >> 172.21.15.60:0/1154915273 conn(0x7f9c6c069f30 msgr2=0x7f9c6c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:21:45.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.990+0000 7f9c71e0a700 1 -- 172.21.15.60:0/1154915273 shutdown_connections 2023-07-12T02:21:45.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.990+0000 7f9c71e0a700 1 -- 172.21.15.60:0/1154915273 wait complete. 2023-07-12T02:21:45.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.991+0000 7f9c71e0a700 1 Processor -- start 2023-07-12T02:21:45.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.992+0000 7f9c71e0a700 1 -- start start 2023-07-12T02:21:45.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.992+0000 7f9c71e0a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c54003a00 0x7f9c6c08a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:21:45.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.993+0000 7f9c71e0a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c6c149550 0x7f9c6c150e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:21:45.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.993+0000 7f9c71e0a700 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c6c1513b0 0x7f9c6c071680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:21:45.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.993+0000 7f9c71e0a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c151a60 con 0x7f9c6c149550 2023-07-12T02:21:46.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.993+0000 7f9c71e0a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c0713c0 con 0x7f9c54003a00 2023-07-12T02:21:46.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.993+0000 7f9c71e0a700 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c14f320 con 0x7f9c6c1513b0 2023-07-12T02:21:46.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.996+0000 7f9c6affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c6c149550 0x7f9c6c150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:21:46.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.996+0000 7f9c6affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c6c149550 0x7f9c6c150e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35732/0 (socket says 172.21.15.60:35732) 2023-07-12T02:21:46.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.996+0000 7f9c6affd700 1 -- 172.21.15.60:0/3069823218 learned_addr learned my addr 172.21.15.60:0/3069823218 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-07-12T02:21:46.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.996+0000 7f9c6affd700 1 -- 172.21.15.60:0/3069823218 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c6c1513b0 msgr2=0x7f9c6c071680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:21:46.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.996+0000 7f9c6affd700 1 --2- 172.21.15.60:0/3069823218 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c6c1513b0 0x7f9c6c071680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:46.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.996+0000 7f9c6affd700 1 -- 172.21.15.60:0/3069823218 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c54003a00 msgr2=0x7f9c6c08a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:21:46.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.996+0000 7f9c6affd700 1 --2- 172.21.15.60:0/3069823218 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c54003a00 0x7f9c6c08a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:46.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.996+0000 7f9c6affd700 1 -- 172.21.15.60:0/3069823218 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c6c14f600 con 0x7f9c6c149550 2023-07-12T02:21:46.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:45.997+0000 7f9c6affd700 1 --2- 172.21.15.60:0/3069823218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c6c149550 0x7f9c6c150e70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f9c6000b390 tx=0x7f9c6000b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:21:46.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:46.002+0000 7f9c53fff700 1 -- 172.21.15.60:0/3069823218 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6000be50 con 0x7f9c6c149550 2023-07-12T02:21:46.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:46.002+0000 7f9c53fff700 1 -- 172.21.15.60:0/3069823218 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c60011630 con 0x7f9c6c149550 2023-07-12T02:21:46.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:46.002+0000 7f9c53fff700 1 -- 172.21.15.60:0/3069823218 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c600119e0 con 0x7f9c6c149550 2023-07-12T02:21:46.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:46.002+0000 7f9c71e0a700 1 -- 172.21.15.60:0/3069823218 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c6c08ac50 con 0x7f9c6c149550 2023-07-12T02:21:46.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:46.002+0000 7f9c71e0a700 1 -- 172.21.15.60:0/3069823218 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c6c149ba0 con 0x7f9c6c149550 2023-07-12T02:21:46.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:46.004+0000 7f9c71e0a700 1 -- 172.21.15.60:0/3069823218 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c4c0052f0 con 0x7f9c6c149550 2023-07-12T02:21:46.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:46.014+0000 7f9c53fff700 1 -- 172.21.15.60:0/3069823218 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9c60011b40 con 0x7f9c6c149550 2023-07-12T02:21:46.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:46.015+0000 7f9c53fff700 1 --2- 172.21.15.60:0/3069823218 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f9c5806adb0 0x7f9c5806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-12T02:21:46.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:46.015+0000 7f9c53fff700 1 -- 172.21.15.60:0/3069823218 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f9c60089010 con 0x7f9c6c149550 2023-07-12T02:21:46.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:46.015+0000 7f9c53fff700 1 -- 172.21.15.60:0/3069823218 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177008 (secure 0 0 0) 0x7f9c600bb380 con 0x7f9c6c149550 2023-07-12T02:21:46.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:46.017+0000 7f9c6b7fe700 1 --2- 172.21.15.60:0/3069823218 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f9c5806adb0 0x7f9c5806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-12T02:21:46.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:46.022+0000 7f9c6b7fe700 1 --2- 172.21.15.60:0/3069823218 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f9c5806adb0 0x7f9c5806d260 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9c64000f80 tx=0x7f9c64009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-12T02:21:46.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:46.556+0000 7f9c71e0a700 1 -- 172.21.15.60:0/3069823218 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9c4c005b20 con 0x7f9c6c149550 2023-07-12T02:21:46.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:46.558+0000 7f9c53fff700 1 -- 172.21.15.60:0/3069823218 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v34) v1 ==== 80+0+120 (secure 0 0 0) 0x7f9c60015080 con 0x7f9c6c149550 2023-07-12T02:21:46.568 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6834/646133464 2023-07-13T02:16:43.943891+0000 2023-07-12T02:21:46.568 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6832/646133464 2023-07-13T02:16:43.943891+0000 2023-07-12T02:21:46.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:46.566+0000 7f9c71e0a700 1 -- 172.21.15.60:0/3069823218 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f9c5806adb0 msgr2=0x7f9c5806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:21:46.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:46.566+0000 7f9c71e0a700 1 --2- 172.21.15.60:0/3069823218 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f9c5806adb0 0x7f9c5806d260 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9c64000f80 tx=0x7f9c64009030 comp rx=0 tx=0).stop 2023-07-12T02:21:46.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:46.566+0000 7f9c71e0a700 1 -- 172.21.15.60:0/3069823218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c6c149550 msgr2=0x7f9c6c150e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-12T02:21:46.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:46.566+0000 7f9c71e0a700 1 --2- 172.21.15.60:0/3069823218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c6c149550 0x7f9c6c150e70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f9c6000b390 tx=0x7f9c6000b6a0 comp rx=0 tx=0).stop 2023-07-12T02:21:46.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:46.588+0000 7f9c71e0a700 1 -- 172.21.15.60:0/3069823218 shutdown_connections 2023-07-12T02:21:46.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:46.588+0000 7f9c71e0a700 1 --2- 172.21.15.60:0/3069823218 >> [v2:172.21.15.79:6832/1173177519,v1:172.21.15.79:6833/1173177519] conn(0x7f9c5806adb0 0x7f9c5806d260 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:46.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:46.588+0000 7f9c71e0a700 1 --2- 172.21.15.60:0/3069823218 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c6c1513b0 0x7f9c6c071680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:46.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:46.588+0000 7f9c71e0a700 1 --2- 172.21.15.60:0/3069823218 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c54003a00 0x7f9c6c08a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:46.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:46.588+0000 7f9c71e0a700 1 --2- 172.21.15.60:0/3069823218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c6c149550 0x7f9c6c150e70 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-12T02:21:46.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:46.588+0000 7f9c71e0a700 1 -- 172.21.15.60:0/3069823218 >> 172.21.15.60:0/3069823218 conn(0x7f9c6c069f30 msgr2=0x7f9c6c0b7be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-12T02:21:46.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:46.589+0000 7f9c71e0a700 1 -- 172.21.15.60:0/3069823218 shutdown_connections 2023-07-12T02:21:46.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-07-12T02:21:46.589+0000 7f9c71e0a700 1 -- 172.21.15.60:0/3069823218 wait complete. 2023-07-12T02:21:46.613 INFO:teuthology.orchestra.run.smithi060.stderr:listed 2 entries 2023-07-12T02:21:46.622 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-12T02:21:46.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:21:46.622 DEBUG:teuthology.orchestra.run.smithi174:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-07-12T02:21:46.715 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi174.front.sepia.ceph.com 2023-07-12T02:21:46.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-12T02:21:46.715 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-12T02:21:48.270 INFO:tasks.ceph.osd.0:Sent signal 15 2023-07-12T02:21:48.271 INFO:tasks.ceph.osd.1:Sent signal 15 2023-07-12T02:21:48.271 INFO:tasks.ceph.osd.2:Sent signal 15 2023-07-12T02:21:48.271 INFO:tasks.ceph.osd.3:Sent signal 15 2023-07-12T02:21:48.272 INFO:tasks.ceph.osd.4:Sent signal 15 2023-07-12T02:21:48.272 INFO:tasks.ceph.osd.5:Sent signal 15 2023-07-12T02:21:48.272 INFO:tasks.ceph.osd.6:Sent signal 15 2023-07-12T02:21:48.273 INFO:tasks.ceph.osd.7:Sent signal 15 2023-07-12T02:21:48.273 INFO:tasks.ceph.mds.c:Sent signal 15 2023-07-12T02:21:48.273 INFO:tasks.ceph.mds.b:Sent signal 15 2023-07-12T02:21:48.273 INFO:tasks.ceph.mon.a:Sent signal 15 2023-07-12T02:21:48.274 INFO:tasks.ceph.mon.b:Sent signal 15 2023-07-12T02:21:48.274 INFO:tasks.ceph.mon.c:Sent signal 15 2023-07-12T02:21:48.274 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-07-12T02:21:48.274 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-07-12T02:21:48.275 INFO:tasks.ceph.mds.c.smithi060.stderr:2023-07-12T02:21:48.269+0000 7f9891307700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i c (PID: 157154) UID: 0 2023-07-12T02:21:48.275 INFO:tasks.ceph.mds.c.smithi060.stderr:2023-07-12T02:21:48.269+0000 7f9891307700 -1 mds.c *** got signal Terminated *** 2023-07-12T02:21:48.276 INFO:tasks.ceph.mon.a.smithi060.stderr:2023-07-12T02:21:48.272+0000 7fa5a1c4b700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-12T02:21:48.277 INFO:tasks.ceph.osd.1.smithi060.stderr:2023-07-12T02:21:48.272+0000 7f2244d2e700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 146429) UID: 0 2023-07-12T02:21:48.277 INFO:tasks.ceph.osd.1.smithi060.stderr:2023-07-12T02:21:48.272+0000 7f2244d2e700 -1 osd.1 34 *** Got signal Terminated *** 2023-07-12T02:21:48.277 INFO:tasks.ceph.osd.1.smithi060.stderr:2023-07-12T02:21:48.272+0000 7f2244d2e700 -1 osd.1 34 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-12T02:21:48.277 INFO:tasks.ceph.osd.2.smithi060.stderr:2023-07-12T02:21:48.271+0000 7f7d024e9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 146426) UID: 0 2023-07-12T02:21:48.277 INFO:tasks.ceph.osd.2.smithi060.stderr:2023-07-12T02:21:48.271+0000 7f7d024e9700 -1 osd.2 34 *** Got signal Terminated *** 2023-07-12T02:21:48.278 INFO:tasks.ceph.osd.2.smithi060.stderr:2023-07-12T02:21:48.271+0000 7f7d024e9700 -1 osd.2 34 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-12T02:21:48.278 INFO:tasks.ceph.osd.3.smithi060.stderr:2023-07-12T02:21:48.269+0000 7fad21a14700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 146435) UID: 0 2023-07-12T02:21:48.278 INFO:tasks.ceph.osd.3.smithi060.stderr:2023-07-12T02:21:48.269+0000 7fad21a14700 -1 osd.3 34 *** Got signal Terminated *** 2023-07-12T02:21:48.278 INFO:tasks.ceph.osd.3.smithi060.stderr:2023-07-12T02:21:48.269+0000 7fad21a14700 -1 osd.3 34 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-12T02:21:48.278 INFO:tasks.ceph.mon.a.smithi060.stderr:2023-07-12T02:21:48.273+0000 7fa5a7456700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 146052) UID: 0 2023-07-12T02:21:48.279 INFO:tasks.ceph.mon.a.smithi060.stderr:2023-07-12T02:21:48.273+0000 7fa5a7456700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-07-12T02:21:48.279 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-07-12T02:21:48.273+0000 7fe072e92700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mgr -f --cluster ceph -i x (PID: 116948) UID: 0 2023-07-12T02:21:48.279 INFO:tasks.ceph.mgr.x.smithi079.stderr:2023-07-12T02:21:48.273+0000 7fe072e92700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-07-12T02:21:48.279 INFO:tasks.ceph.mds.b.smithi079.stderr:2023-07-12T02:21:48.274+0000 7fbbe5f0e700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 123583) UID: 0 2023-07-12T02:21:48.280 INFO:tasks.ceph.mds.b.smithi079.stderr:2023-07-12T02:21:48.274+0000 7fbbe5f0e700 -1 mds.b *** got signal Terminated *** 2023-07-12T02:21:48.280 INFO:tasks.ceph.osd.0.smithi060.stderr:2023-07-12T02:21:48.272+0000 7ff1df87b700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 146416) UID: 0 2023-07-12T02:21:48.280 INFO:tasks.ceph.osd.0.smithi060.stderr:2023-07-12T02:21:48.272+0000 7ff1df87b700 -1 osd.0 34 *** Got signal Terminated *** 2023-07-12T02:21:48.280 INFO:tasks.ceph.osd.0.smithi060.stderr:2023-07-12T02:21:48.272+0000 7ff1df87b700 -1 osd.0 34 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-12T02:21:48.281 INFO:tasks.ceph.osd.6.smithi079.stderr:2023-07-12T02:21:48.275+0000 7f9aff4ab700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 117650) UID: 0 2023-07-12T02:21:48.281 INFO:tasks.ceph.osd.6.smithi079.stderr:2023-07-12T02:21:48.275+0000 7f9aff4ab700 -1 osd.6 34 *** Got signal Terminated *** 2023-07-12T02:21:48.281 INFO:tasks.ceph.osd.6.smithi079.stderr:2023-07-12T02:21:48.275+0000 7f9aff4ab700 -1 osd.6 34 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-12T02:21:48.291 INFO:tasks.ceph.mon.b.smithi079.stderr:2023-07-12T02:21:48.286+0000 7fd9d7f46700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 116943) UID: 0 2023-07-12T02:21:48.291 INFO:tasks.ceph.mon.b.smithi079.stderr:2023-07-12T02:21:48.286+0000 7fd9d7f46700 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-07-12T02:21:48.292 INFO:tasks.ceph.osd.4.smithi079.stderr:2023-07-12T02:21:48.274+0000 7faa0042b700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 117644) UID: 0 2023-07-12T02:21:48.292 INFO:tasks.ceph.osd.4.smithi079.stderr:2023-07-12T02:21:48.274+0000 7faa0042b700 -1 osd.4 34 *** Got signal Terminated *** 2023-07-12T02:21:48.292 INFO:tasks.ceph.osd.4.smithi079.stderr:2023-07-12T02:21:48.274+0000 7faa0042b700 -1 osd.4 34 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-12T02:21:48.292 INFO:tasks.ceph.osd.7.smithi079.stderr:2023-07-12T02:21:48.275+0000 7fc91cd78700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 117651) UID: 0 2023-07-12T02:21:48.293 INFO:tasks.ceph.osd.7.smithi079.stderr:2023-07-12T02:21:48.275+0000 7fc91cd78700 -1 osd.7 34 *** Got signal Terminated *** 2023-07-12T02:21:48.293 INFO:tasks.ceph.osd.7.smithi079.stderr:2023-07-12T02:21:48.275+0000 7fc91cd78700 -1 osd.7 34 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-12T02:21:48.293 INFO:tasks.ceph.mon.c.smithi079.stderr:2023-07-12T02:21:48.274+0000 7f14e3d25700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 116945) UID: 0 2023-07-12T02:21:48.293 INFO:tasks.ceph.mon.c.smithi079.stderr:2023-07-12T02:21:48.274+0000 7f14e3d25700 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-07-12T02:21:48.294 INFO:tasks.ceph.osd.5.smithi079.stderr:2023-07-12T02:21:48.275+0000 7f7c53c18700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 117647) UID: 0 2023-07-12T02:21:48.294 INFO:tasks.ceph.osd.5.smithi079.stderr:2023-07-12T02:21:48.275+0000 7f7c53c18700 -1 osd.5 34 *** Got signal Terminated *** 2023-07-12T02:21:48.294 INFO:tasks.ceph.osd.5.smithi079.stderr:2023-07-12T02:21:48.275+0000 7f7c53c18700 -1 osd.5 34 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-12T02:21:48.496 INFO:tasks.ceph.mgr.y.smithi060.stderr:daemon-helper: command crashed with signal 15 2023-07-12T02:21:59.033 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:21:59.035 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:21:59.038 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:22:29.154 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:22:29.157 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:22:29.159 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:22:59.438 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:22:59.440 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:22:59.442 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:23:29.539 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:23:29.543 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:23:29.546 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:23:59.678 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:23:59.681 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:23:59.683 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:24:29.887 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:24:29.890 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:24:29.892 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:24:59.988 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:24:59.991 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:24:59.993 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:25:30.101 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:25:30.105 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:25:30.109 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:26:00.491 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:26:00.493 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:26:00.496 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:26:30.595 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:26:30.597 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:26:30.599 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:27:00.792 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:27:00.794 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:27:00.796 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:27:30.906 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:27:30.909 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:27:30.911 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:28:01.027 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:28:01.030 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:28:01.032 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:28:31.191 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:28:31.194 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:28:31.197 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:29:01.379 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:29:01.382 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:29:01.384 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:29:31.586 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:29:31.589 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:29:31.591 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:30:01.706 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:30:01.709 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:30:01.711 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:30:31.804 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:30:31.807 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:30:31.809 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:31:02.019 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:31:02.022 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:31:02.024 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:31:32.130 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:31:32.133 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:31:32.135 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:32:02.236 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:32:02.238 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:32:02.240 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:32:32.349 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:32:32.352 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:32:32.354 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:33:02.504 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:33:02.507 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:33:02.509 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:33:32.610 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:33:32.612 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:33:32.615 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:34:02.723 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:34:02.725 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:34:02.728 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:34:33.028 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:34:33.030 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:34:33.032 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:35:03.308 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:35:03.311 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:35:03.313 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:35:33.414 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:35:33.416 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:35:33.418 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:36:03.519 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:36:03.522 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:36:03.524 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:36:33.641 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:36:33.643 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:36:33.646 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:37:03.771 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:37:03.774 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:37:03.776 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:37:33.960 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:37:33.962 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:37:33.965 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:38:04.114 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:38:04.117 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:38:04.119 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:38:34.228 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:38:34.231 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:38:34.233 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:39:04.408 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:39:04.410 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:39:04.413 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:39:34.572 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:39:34.575 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:39:34.578 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:40:04.694 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:40:04.696 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:40:04.699 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:40:34.816 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:40:34.818 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:40:34.821 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:41:04.920 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:41:04.923 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:41:04.926 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:41:35.028 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:41:35.031 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:41:35.033 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:42:05.147 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:42:05.149 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:42:05.151 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:42:35.285 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:42:35.288 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:42:35.290 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:43:05.398 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:43:05.401 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:43:05.403 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:43:35.520 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:43:35.523 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:43:35.525 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:44:05.625 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:44:05.628 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:44:05.630 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:44:35.739 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:44:35.741 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:44:35.743 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:45:05.902 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:45:05.904 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:45:05.906 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:45:36.090 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:45:36.093 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:45:36.095 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:46:06.286 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:46:06.289 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:46:06.291 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:46:36.476 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:46:36.478 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:46:36.480 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:47:06.614 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:47:06.616 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:47:06.619 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:47:36.786 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:47:36.788 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:47:36.791 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:48:06.973 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:48:06.976 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:48:06.978 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:48:37.104 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:48:37.106 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:48:37.109 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:49:07.209 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:49:07.211 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:49:07.214 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:49:37.322 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:49:37.325 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:49:37.327 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:50:07.435 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:50:07.438 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:50:07.441 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:50:37.550 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:50:37.552 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:50:37.555 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:51:07.671 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:51:07.675 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:51:07.677 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:51:37.785 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:51:37.788 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:51:37.791 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:52:08.082 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:52:08.085 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:52:08.087 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:52:38.195 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:52:38.198 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:52:38.200 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:53:08.300 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:53:08.303 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:53:08.305 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:53:38.405 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:53:38.407 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:53:38.409 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:54:08.536 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:54:08.539 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:54:08.541 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:54:38.774 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:54:38.777 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:54:38.780 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:55:08.905 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:55:08.908 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:55:08.910 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:55:39.247 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:55:39.250 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:55:39.252 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:56:09.431 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:56:09.434 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:56:09.436 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:56:39.569 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:56:39.572 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:56:39.575 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:57:09.683 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:57:09.685 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:57:09.688 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:57:39.796 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:57:39.799 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:57:39.801 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:58:09.944 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:58:09.947 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:58:09.949 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:58:40.099 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:58:40.101 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:58:40.104 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:59:10.212 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:59:10.215 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:59:10.217 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:59:40.601 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:59:40.603 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T02:59:40.606 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:00:10.739 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:00:10.741 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:00:10.743 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:00:40.860 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:00:40.863 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:00:40.865 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:01:10.982 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:01:10.985 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:01:10.988 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:01:41.088 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:01:41.090 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:01:41.093 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:02:11.218 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:02:11.220 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:02:11.223 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:02:41.323 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:02:41.326 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:02:41.328 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:03:11.436 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:03:11.439 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:03:11.441 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:03:41.541 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:03:41.545 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:03:41.547 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:04:11.655 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:04:11.658 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:04:11.660 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:04:41.760 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:04:41.763 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:04:41.765 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:05:11.948 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:05:11.951 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:05:11.953 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:05:42.061 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:05:42.063 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:05:42.066 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:06:12.175 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:06:12.177 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:06:12.180 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:06:42.288 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:06:42.291 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:06:42.293 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:07:12.401 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:07:12.404 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:07:12.406 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:07:42.498 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:07:42.500 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:07:42.503 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:08:12.612 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:08:12.614 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:08:12.617 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:08:42.725 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:08:42.728 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:08:42.730 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:09:12.846 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:09:12.849 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:09:12.851 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:09:42.999 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:09:43.002 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:09:43.005 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:10:13.134 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:10:13.137 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:10:13.139 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:10:43.304 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:10:43.307 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:10:43.309 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:11:13.453 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:11:13.456 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:11:13.458 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:11:43.614 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:11:43.617 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:11:43.619 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:12:13.769 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:12:13.771 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:12:13.773 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:12:43.950 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:12:43.953 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:12:43.955 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:13:14.138 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:13:14.141 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:13:14.143 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:13:44.335 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:13:44.339 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:13:44.341 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:14:14.565 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:14:14.568 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:14:14.570 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:14:44.704 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:14:44.707 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:14:44.710 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:15:14.832 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:15:14.835 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:15:14.837 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:15:44.941 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:15:44.944 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:15:44.946 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:16:15.070 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:16:15.073 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:16:15.075 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:16:45.213 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:16:45.216 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:16:45.218 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:17:15.590 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:17:15.593 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:17:15.596 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:17:45.704 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:17:45.706 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:17:45.708 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:18:15.892 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:18:15.895 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:18:15.897 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:18:46.089 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:18:46.092 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:18:46.094 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:19:16.224 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:19:16.227 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:19:16.229 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:19:46.418 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:19:46.421 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:19:46.423 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:20:16.604 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:20:16.607 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:20:16.609 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:20:46.740 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:20:46.743 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:20:46.745 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:21:16.883 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:21:16.886 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:21:16.889 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:21:47.054 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:21:47.056 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:21:47.059 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:22:17.197 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:22:17.201 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:22:17.204 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:22:47.333 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:22:47.336 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:22:47.338 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:23:17.468 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:23:17.471 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:23:17.473 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:23:47.603 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:23:47.606 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:23:47.608 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:24:17.731 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:24:17.734 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:24:17.736 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:24:47.843 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:24:47.846 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:24:47.848 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:25:17.969 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:25:17.971 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:25:17.973 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:25:48.162 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:25:48.165 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:25:48.167 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:26:18.298 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:26:18.301 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:26:18.303 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:26:48.434 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:26:48.436 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:26:48.438 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:27:18.544 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:27:18.547 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:27:18.549 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:27:48.680 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:27:48.683 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:27:48.685 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:28:18.813 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:28:18.816 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:28:18.818 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:28:48.985 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:28:48.987 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:28:48.990 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:29:19.182 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:29:19.185 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:29:19.187 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:29:49.371 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:29:49.374 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:29:49.376 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:30:19.492 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:30:19.495 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:30:19.497 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:30:49.635 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:30:49.638 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:30:49.640 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:31:19.796 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:31:19.799 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:31:19.802 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:31:49.948 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:31:49.951 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:31:49.954 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:32:20.089 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:32:20.092 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:32:20.094 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:32:50.211 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:32:50.214 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:32:50.216 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:33:20.341 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:33:20.344 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:33:20.346 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:33:50.465 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:33:50.468 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:33:50.470 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:34:20.676 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:34:20.679 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:34:20.681 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:34:50.820 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:34:50.822 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:34:50.825 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:35:20.954 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:35:20.957 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:35:20.959 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:35:51.107 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:35:51.109 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:35:51.112 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:36:21.244 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:36:21.246 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:36:21.248 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:36:51.379 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:36:51.382 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:36:51.385 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:37:21.550 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:37:21.552 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:37:21.555 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:37:51.683 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:37:51.686 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:37:51.689 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:38:21.860 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:38:21.863 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:38:21.866 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:38:52.041 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:38:52.044 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:38:52.047 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:39:22.225 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:39:22.229 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:39:22.232 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:39:52.368 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:39:52.371 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:39:52.373 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:40:22.511 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:40:22.516 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:40:22.520 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:40:52.663 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:40:52.667 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:40:52.671 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:41:22.816 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:41:22.821 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:41:22.823 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:41:52.959 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:41:52.962 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:41:52.965 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:42:23.286 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:42:23.289 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:42:23.291 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:42:53.422 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:42:53.425 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:42:53.428 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:43:23.630 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:43:23.634 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:43:23.636 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:43:53.835 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:43:53.839 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:43:53.842 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:44:23.954 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:44:23.958 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:44:23.961 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:44:54.110 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:44:54.113 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:44:54.115 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:45:24.249 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:45:24.252 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:45:24.254 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:45:54.385 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:45:54.388 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:45:54.390 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:46:24.521 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:46:24.524 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:46:24.527 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:46:54.648 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:46:54.651 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:46:54.653 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:47:24.861 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:47:24.864 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:47:24.866 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:47:54.992 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:47:54.995 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:47:54.998 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:48:25.146 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:48:25.149 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:48:25.151 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:48:55.290 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:48:55.293 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:48:55.295 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:49:25.426 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:49:25.430 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:49:25.433 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:49:55.814 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:49:55.817 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:49:55.819 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:50:25.993 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:50:25.997 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:50:26.000 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:50:56.132 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:50:56.135 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:50:56.137 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:51:26.260 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:51:26.263 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:51:26.266 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:51:56.442 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:51:56.444 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:51:56.447 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:52:26.622 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:52:26.625 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:52:26.628 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:52:56.801 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:52:56.804 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:52:56.806 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:53:26.998 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:53:27.001 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:53:27.004 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:53:57.187 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:53:57.190 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:53:57.193 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:54:27.332 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:54:27.336 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:54:27.339 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:54:57.547 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:54:57.550 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:54:57.554 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:55:27.687 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:55:27.689 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:55:27.691 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:55:57.813 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:55:57.816 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:55:57.819 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:56:27.936 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:56:27.939 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:56:27.942 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:56:58.085 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:56:58.089 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:56:58.093 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:57:28.418 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:57:28.421 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:57:28.423 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:57:58.588 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:57:58.591 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:57:58.593 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:58:28.717 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:58:28.721 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:58:28.724 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:58:58.853 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:58:58.856 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:58:58.859 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:59:29.037 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:59:29.039 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:59:29.042 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:59:59.190 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:59:59.194 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T03:59:59.196 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:00:29.342 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:00:29.345 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:00:29.348 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:00:59.486 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:00:59.490 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:00:59.492 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:01:29.639 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:01:29.642 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:01:29.645 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:01:59.840 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:01:59.843 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:01:59.846 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:02:29.976 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:02:29.979 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:02:29.982 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:03:00.103 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:03:00.106 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:03:00.108 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:03:30.239 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:03:30.242 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:03:30.245 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:04:00.367 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:04:00.370 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:04:00.372 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:04:30.520 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:04:30.523 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:04:30.525 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:05:00.644 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:05:00.646 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:05:00.649 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:05:30.783 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:05:30.786 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:05:30.788 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:06:00.925 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:06:00.928 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:06:00.930 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:06:31.127 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:06:31.129 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:06:31.132 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:07:01.307 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:07:01.310 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:07:01.313 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:07:31.448 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:07:31.450 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:07:31.453 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:08:01.642 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:08:01.645 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:08:01.647 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:08:31.794 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:08:31.797 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:08:31.799 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:09:01.922 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:09:01.925 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:09:01.928 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:09:32.083 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:09:32.086 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:09:32.088 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:10:02.235 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:10:02.237 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:10:02.240 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:10:32.370 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:10:32.374 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:10:32.376 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:11:02.528 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:11:02.531 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:11:02.533 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:11:32.642 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:11:32.645 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:11:32.647 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:12:02.752 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:12:02.755 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:12:02.758 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:12:32.891 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:12:32.894 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:12:32.896 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:13:03.031 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:13:03.035 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:13:03.037 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:13:33.150 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:13:33.153 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:13:33.156 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:14:03.481 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:14:03.484 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:14:03.486 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:14:33.596 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:14:33.599 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:14:33.601 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:15:03.740 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:15:03.743 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:15:03.745 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:15:33.939 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:15:33.942 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:15:33.944 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:16:04.118 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:16:04.121 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:16:04.124 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:16:34.290 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:16:34.293 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:16:34.295 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:17:04.538 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:17:04.541 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:17:04.544 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:17:34.693 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:17:34.696 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:17:34.699 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:18:04.873 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:18:04.876 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:18:04.879 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:18:35.029 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:18:35.032 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:18:35.035 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:19:05.183 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:19:05.185 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:19:05.187 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:19:35.327 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:19:35.330 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:19:35.332 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:20:05.444 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:20:05.447 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:20:05.449 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:20:35.573 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:20:35.575 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:20:35.578 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:21:05.695 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:21:05.698 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:21:05.701 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:21:35.844 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:21:35.847 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:21:35.849 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:22:05.988 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:22:05.991 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:22:05.993 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:22:36.132 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:22:36.134 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:22:36.136 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:23:06.309 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:23:06.312 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:23:06.314 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:23:36.590 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:23:36.593 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:23:36.595 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:24:06.770 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:24:06.773 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:24:06.775 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:24:36.907 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:24:36.910 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:24:36.912 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:25:07.106 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:25:07.109 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:25:07.111 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:25:37.228 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:25:37.231 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:25:37.234 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:26:07.408 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:26:07.410 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:26:07.413 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:26:37.539 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:26:37.541 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:26:37.543 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:27:07.677 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:27:07.679 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:27:07.681 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:27:37.812 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:27:37.815 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:27:37.817 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:28:07.948 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:28:07.951 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:28:07.953 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:28:38.083 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:28:38.086 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:28:38.088 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:29:08.219 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:29:08.222 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:29:08.224 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:29:38.372 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:29:38.374 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:29:38.376 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:30:08.617 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:30:08.619 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:30:08.622 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:30:38.775 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:30:38.778 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:30:38.782 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:31:08.911 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:31:08.914 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:31:08.917 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:31:39.099 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:31:39.102 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:31:39.104 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:32:09.270 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:32:09.273 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:32:09.275 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:32:39.467 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:32:39.470 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:32:39.472 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:33:09.664 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:33:09.666 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:33:09.669 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:33:39.790 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:33:39.793 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:33:39.795 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:34:09.975 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:34:09.978 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:34:09.980 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:34:40.178 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:34:40.181 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:34:40.183 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:35:10.305 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:35:10.308 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:35:10.311 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:35:40.450 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:35:40.452 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:35:40.455 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:36:10.593 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:36:10.596 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:36:10.599 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:36:40.729 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:36:40.732 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:36:40.734 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:37:10.881 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:37:10.884 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:37:10.886 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:37:41.036 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:37:41.039 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:37:41.042 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:38:11.169 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:38:11.172 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:38:11.174 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:38:41.313 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:38:41.316 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:38:41.319 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:39:11.504 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:39:11.507 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:39:11.509 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:39:41.901 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:39:41.904 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:39:41.906 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:40:12.073 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:40:12.076 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:40:12.078 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:40:42.213 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:40:42.216 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:40:42.219 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:41:12.425 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:41:12.427 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:41:12.430 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:41:42.594 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:41:42.596 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:41:42.599 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:42:12.737 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:42:12.741 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:42:12.744 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:42:42.864 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:42:42.867 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:42:42.869 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:43:13.000 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:43:13.003 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:43:13.008 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:43:43.134 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:43:43.136 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:43:43.139 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:44:13.256 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:44:13.259 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:44:13.262 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:44:43.377 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:44:43.380 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:44:43.383 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:45:13.491 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:45:13.493 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:45:13.496 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:45:43.596 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:45:43.598 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:45:43.601 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:46:13.709 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:46:13.712 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:46:13.715 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:46:43.906 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:46:43.909 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:46:43.911 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:47:14.020 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:47:14.023 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:47:14.025 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:47:44.384 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:47:44.387 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:47:44.389 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:48:14.539 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:48:14.542 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:48:14.544 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:48:44.685 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:48:44.688 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:48:44.690 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:49:14.852 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:49:14.854 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:49:14.857 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:49:44.995 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:49:44.998 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:49:45.000 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:50:15.139 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:50:15.142 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:50:15.144 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:50:45.334 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:50:45.336 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:50:45.339 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:51:15.485 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:51:15.488 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:51:15.490 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:51:45.600 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:51:45.603 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:51:45.606 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:52:15.732 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:52:15.735 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:52:15.737 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:52:45.859 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:52:45.862 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:52:45.864 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:53:16.003 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:53:16.005 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:53:16.008 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:53:46.138 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:53:46.141 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:53:46.143 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:54:16.394 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:54:16.397 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:54:16.399 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:54:46.608 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:54:46.611 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:54:46.613 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:55:16.745 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:55:16.748 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:55:16.750 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:55:46.993 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:55:46.996 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:55:46.998 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:56:17.131 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:56:17.134 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:56:17.136 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:56:47.302 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:56:47.305 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:56:47.307 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:57:17.484 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:57:17.487 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:57:17.489 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:57:47.614 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:57:47.617 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:57:47.619 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:58:17.795 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:58:17.798 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:58:17.801 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:58:47.993 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:58:47.995 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:58:47.998 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:59:18.130 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:59:18.132 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:59:18.135 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:59:48.248 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:59:48.251 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T04:59:48.253 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:00:18.375 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:00:18.378 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:00:18.381 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:00:48.503 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:00:48.506 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:00:48.508 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:01:18.638 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:01:18.642 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:01:18.644 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:01:48.774 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:01:48.777 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:01:48.779 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:02:18.953 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:02:18.956 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:02:18.958 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:02:49.133 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:02:49.137 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:02:49.140 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:03:19.330 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:03:19.332 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:03:19.335 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:03:49.475 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:03:49.478 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:03:49.480 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:04:19.585 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:04:19.587 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:04:19.590 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:04:49.761 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:04:49.764 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:04:49.766 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:05:19.958 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:05:19.961 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:05:19.963 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:05:50.155 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:05:50.158 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:05:50.160 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:06:20.336 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:06:20.339 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:06:20.341 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:06:50.455 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:06:50.457 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:06:50.460 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:07:20.607 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:07:20.610 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:07:20.612 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:07:33.891 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2023-07-12T05:07:50.750 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:07:50.753 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:07:50.755 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:08:20.894 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:08:20.897 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:08:20.899 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:08:51.062 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:08:51.064 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:08:51.067 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:09:21.183 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:09:21.186 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:09:21.189 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:09:51.326 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:09:51.329 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:09:51.331 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:10:21.453 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:10:21.456 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:10:21.458 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:10:51.583 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:10:51.585 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:10:51.588 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:11:21.888 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:11:21.890 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:11:21.893 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:11:52.078 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:11:52.080 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:11:52.083 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:12:22.265 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:12:22.268 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:12:22.270 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:12:52.389 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:12:52.392 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:12:52.394 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:13:22.525 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:13:22.528 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:13:22.530 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:13:52.646 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:13:52.649 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:13:52.652 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:14:22.780 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:14:22.782 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:14:22.785 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:14:52.941 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:14:52.943 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:14:52.946 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:15:23.129 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:15:23.132 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:15:23.134 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:15:53.278 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:15:53.282 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:15:53.284 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:16:23.414 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:16:23.416 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:16:23.418 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:16:53.549 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:16:53.551 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:16:53.554 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:17:23.702 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:17:23.704 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:17:23.707 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:17:53.861 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:17:53.864 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:17:53.866 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:18:23.989 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:18:23.992 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:18:23.994 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:18:54.124 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:18:54.127 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:18:54.129 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:19:24.269 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:19:24.271 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:19:24.274 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:19:54.438 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:19:54.441 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:19:54.443 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:20:24.606 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:20:24.609 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:20:24.612 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:20:54.804 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:20:54.806 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:20:54.809 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:21:21.217 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2023-07-12T05:21:24.919 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:21:24.922 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:21:24.924 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:21:55.063 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:21:55.066 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:21:55.068 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:22:25.216 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:22:25.219 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:22:25.221 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:22:55.365 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:22:55.368 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:22:55.371 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:23:25.562 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:23:25.565 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:23:25.567 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:23:55.793 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:23:55.795 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:23:55.798 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:24:25.915 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:24:25.918 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:24:25.920 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:24:56.068 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:24:56.071 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:24:56.073 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:25:26.212 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:25:26.215 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:25:26.217 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:25:56.356 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:25:56.358 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:25:56.361 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:26:26.477 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:26:26.479 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:26:26.482 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:26:56.848 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:26:56.851 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:26:56.853 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:27:26.970 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:27:26.973 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:27:26.975 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:27:57.159 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:27:57.162 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:27:57.164 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:28:27.272 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:28:27.275 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:28:27.277 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:28:57.443 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:28:57.446 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:28:57.448 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:29:27.623 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:29:27.626 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:29:27.628 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:29:57.737 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:29:57.739 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:29:57.741 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:30:27.843 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:30:27.845 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:30:27.848 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:30:57.981 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:30:57.983 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:30:57.986 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:31:28.094 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:31:28.096 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:31:28.098 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:31:58.299 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:31:58.302 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:31:58.304 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:32:28.421 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:32:28.424 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:32:28.426 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:32:58.517 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:32:58.520 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:32:58.522 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:33:28.623 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:33:28.625 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:33:28.628 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:33:58.744 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:33:58.747 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:33:58.749 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:34:28.867 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:34:28.870 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:34:28.872 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:34:58.988 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:34:58.991 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:34:58.993 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:35:29.335 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:35:29.338 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:35:29.341 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:35:59.499 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:35:59.502 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:35:59.504 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:36:29.629 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:36:29.631 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:36:29.634 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:36:59.759 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:36:59.762 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:36:59.764 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:37:29.881 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:37:29.884 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:37:29.886 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:38:00.044 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:38:00.047 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:38:00.049 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:38:30.158 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:38:30.161 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:38:30.163 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:39:00.272 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:39:00.274 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:39:00.276 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:39:30.477 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:39:30.480 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:39:30.482 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:40:00.657 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:40:00.659 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:40:00.662 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:40:30.871 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:40:30.874 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:40:30.876 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:41:00.983 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:41:00.986 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:41:00.989 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:41:31.098 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:41:31.100 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:41:31.102 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:42:01.210 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:42:01.213 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:42:01.215 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:42:31.341 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:42:31.344 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:42:31.345 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:43:01.455 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:43:01.458 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:43:01.460 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:43:31.560 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:43:31.563 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:43:31.565 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:44:01.924 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:44:01.926 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:44:01.928 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:44:32.095 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:44:32.098 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:44:32.100 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:45:02.224 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:45:02.227 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:45:02.229 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:45:32.368 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:45:32.371 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:45:32.373 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:46:02.503 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:46:02.506 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:46:02.508 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:46:32.884 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:46:32.887 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:46:32.889 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:47:03.000 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:47:03.002 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:47:03.004 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:47:33.119 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:47:33.122 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:47:33.124 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:48:03.299 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:48:03.302 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:48:03.304 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:48:33.491 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:48:33.494 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:48:33.496 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:49:03.593 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:49:03.596 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:49:03.598 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:49:33.723 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:49:33.726 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:49:33.728 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:50:03.836 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:50:03.839 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:50:03.841 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:50:33.950 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:50:33.953 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:50:33.955 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:51:04.063 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:51:04.066 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:51:04.068 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:51:34.302 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:51:34.305 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:51:34.307 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:52:04.456 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:52:04.459 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:52:04.462 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:52:34.628 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:52:34.631 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:52:34.633 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:53:04.817 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:53:04.819 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:53:04.822 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:53:34.931 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:53:34.933 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:53:34.936 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:54:05.119 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:54:05.122 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:54:05.124 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:54:35.266 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:54:35.269 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:54:35.271 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:55:05.379 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:55:05.382 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:55:05.384 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:55:35.495 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:55:35.498 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:55:35.500 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:56:05.681 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:56:05.684 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:56:05.686 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:56:35.788 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:56:35.791 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:56:35.794 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:57:05.893 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:57:05.896 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:57:05.898 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:57:35.989 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:57:35.992 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:57:35.994 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:58:06.112 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:58:06.114 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:58:06.116 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:58:36.236 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:58:36.239 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:58:36.241 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:59:06.356 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:59:06.359 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:59:06.361 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:59:36.477 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:59:36.480 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T05:59:36.482 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:00:06.592 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:00:06.594 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:00:06.597 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:00:36.805 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:00:36.807 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:00:36.809 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:01:06.943 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:01:06.945 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:01:06.947 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:01:37.072 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:01:37.076 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:01:37.078 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:02:07.448 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:02:07.451 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:02:07.453 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:02:37.553 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:02:37.556 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:02:37.558 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:03:07.679 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:03:07.681 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:03:07.684 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:03:37.871 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:03:37.874 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:03:37.876 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:04:08.017 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:04:08.019 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:04:08.021 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:04:38.198 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:04:38.200 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:04:38.202 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:05:08.378 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:05:08.381 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:05:08.383 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:05:38.552 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:05:38.554 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:05:38.557 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:06:08.693 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:06:08.695 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:06:08.698 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:06:38.853 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:06:38.856 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:06:38.858 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:07:08.974 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:07:08.977 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:07:08.979 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:07:39.107 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:07:39.110 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:07:39.112 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:08:09.251 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:08:09.254 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:08:09.256 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:08:39.370 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:08:39.373 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:08:39.375 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:09:09.514 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:09:09.517 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:09:09.520 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:09:39.658 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:09:39.661 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:09:39.663 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:10:09.785 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:10:09.788 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:10:09.790 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:10:39.913 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:10:39.916 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:10:39.918 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:11:10.048 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:11:10.051 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:11:10.053 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:11:40.217 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:11:40.220 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:11:40.222 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:12:10.417 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:12:10.419 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:12:10.422 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:12:40.555 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:12:40.558 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:12:40.560 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:13:10.702 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:13:10.705 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:13:10.707 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:13:40.832 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:13:40.835 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:13:40.837 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:14:10.970 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:14:10.973 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:14:10.975 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:14:41.105 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:14:41.108 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:14:41.110 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:15:11.249 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:15:11.252 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:15:11.255 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:15:41.394 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:15:41.396 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:15:41.398 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:16:11.708 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:16:11.711 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:16:11.713 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:16:41.838 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:16:41.841 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:16:41.844 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:17:12.027 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:17:12.030 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:17:12.032 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:17:42.156 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:17:42.159 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:17:42.161 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:18:12.336 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:18:12.339 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:18:12.342 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:18:42.517 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:18:42.519 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:18:42.522 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:19:12.713 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:19:12.716 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:19:12.718 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:19:42.893 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:19:42.899 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:19:42.901 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:20:13.081 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:20:13.084 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:20:13.087 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:20:43.195 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:20:43.198 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:20:43.200 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:21:13.359 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:21:13.362 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:21:13.365 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:21:43.478 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:21:43.481 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:21:43.484 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:22:13.640 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:22:13.643 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:22:13.645 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:22:43.766 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:22:43.769 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:22:43.771 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:23:13.902 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:23:13.905 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:23:13.907 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:23:44.160 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:23:44.163 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:23:44.165 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:24:14.315 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:24:14.318 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:24:14.320 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:24:44.512 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:24:44.514 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:24:44.517 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:25:14.636 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:25:14.638 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:25:14.640 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:25:44.779 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:25:44.782 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:25:44.784 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:26:14.916 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:26:14.918 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:26:14.920 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:26:45.059 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:26:45.062 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:26:45.065 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:27:15.187 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:27:15.189 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:27:15.192 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:27:45.322 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:27:45.325 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:27:45.327 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:28:15.523 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:28:15.526 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:28:15.528 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:28:45.729 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:28:45.732 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:28:45.734 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:29:15.863 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:29:15.866 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:29:15.869 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:29:46.022 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:29:46.025 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:29:46.027 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:30:16.150 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:30:16.152 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:30:16.154 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:30:46.278 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:30:46.280 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:30:46.283 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:31:16.446 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:31:16.449 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:31:16.452 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:31:46.606 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:31:46.610 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:31:46.612 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:32:16.849 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:32:16.851 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:32:16.853 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:32:47.045 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:32:47.048 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:32:47.050 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:33:17.216 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:33:17.219 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:33:17.222 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:33:47.348 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:33:47.351 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:33:47.353 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:34:17.476 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:34:17.479 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:34:17.482 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:34:47.611 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:34:47.614 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:34:47.616 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:35:17.971 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:35:17.974 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:35:17.976 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:35:48.159 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:35:48.162 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:35:48.164 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:36:18.340 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:36:18.342 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:36:18.345 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:36:48.495 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:36:48.498 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:36:48.500 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:37:18.623 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:37:18.626 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:37:18.629 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:37:48.766 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:37:48.769 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:37:48.771 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:38:18.902 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:38:18.905 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:38:18.907 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:38:49.053 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:38:49.057 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:38:49.059 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:39:19.421 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:39:19.423 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:39:19.426 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:39:49.574 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:39:49.577 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:39:49.580 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:40:19.702 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:40:19.705 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:40:19.707 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:40:49.894 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:40:49.897 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:40:49.899 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:41:20.016 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:41:20.019 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:41:20.021 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:41:50.197 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:41:50.200 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:41:50.202 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:42:20.386 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:42:20.388 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:42:20.391 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:42:50.765 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:42:50.768 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:42:50.770 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:43:20.907 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:43:20.910 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:43:20.912 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:43:51.059 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:43:51.062 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:43:51.064 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:44:21.178 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:44:21.181 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:44:21.183 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:44:51.297 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:44:51.300 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:44:51.302 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:45:21.441 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:45:21.444 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:45:21.446 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:45:51.585 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:45:51.587 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:45:51.590 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:46:21.937 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:46:21.940 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:46:21.942 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:46:52.107 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:46:52.109 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:46:52.112 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:47:22.295 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:47:22.298 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:47:22.300 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:47:52.435 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:47:52.438 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:47:52.440 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:48:22.605 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:48:22.608 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:48:22.610 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:48:52.769 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:48:52.772 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:48:52.774 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:49:22.949 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:49:22.952 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:49:22.954 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:49:53.130 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:49:53.133 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:49:53.135 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:50:23.272 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:50:23.274 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:50:23.277 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:50:53.440 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:50:53.443 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:50:53.445 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:51:23.584 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:51:23.587 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:51:23.589 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:51:53.728 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:51:53.731 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:51:53.733 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:52:23.881 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:52:23.884 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:52:23.886 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:52:54.041 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:52:54.044 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:52:54.046 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:53:24.177 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:53:24.179 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:53:24.182 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:53:54.320 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:53:54.323 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:53:54.325 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:54:24.527 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:54:24.530 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:54:24.532 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:54:54.675 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:54:54.678 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:54:54.680 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:55:24.802 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:55:24.804 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:55:24.807 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:55:54.984 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:55:54.987 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:55:54.990 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:56:25.172 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:56:25.175 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:56:25.177 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:56:55.360 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:56:55.362 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:56:55.365 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:57:25.494 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:57:25.497 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:57:25.499 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:57:55.613 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:57:55.615 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:57:55.617 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:58:25.749 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:58:25.751 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:58:25.754 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:58:55.884 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:58:55.887 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:58:55.889 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:59:26.103 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:59:26.106 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:59:26.108 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:59:56.239 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:59:56.241 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T06:59:56.244 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:00:26.382 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:00:26.385 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:00:26.387 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:00:56.518 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:00:56.522 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:00:56.524 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:01:26.662 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:01:26.665 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:01:26.667 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:01:56.797 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:01:56.800 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:01:56.803 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:02:26.942 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:02:26.945 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:02:26.947 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:02:57.122 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:02:57.125 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:02:57.127 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:03:27.254 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:03:27.257 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:03:27.259 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:03:57.398 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:03:57.400 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:03:57.403 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:04:27.541 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:04:27.544 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:04:27.546 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:04:57.678 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:04:57.680 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:04:57.682 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:05:27.813 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:05:27.816 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:05:27.818 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:05:57.957 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:05:57.960 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:05:57.962 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:06:28.148 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:06:28.151 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:06:28.153 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:06:58.278 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:06:58.281 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:06:58.283 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:07:28.433 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:07:28.436 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:07:28.439 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:07:58.574 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:07:58.577 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:07:58.580 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:08:28.718 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:08:28.721 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:08:28.724 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:08:58.870 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:08:58.873 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:08:58.875 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:09:29.005 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:09:29.008 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:09:29.010 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:09:59.149 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:09:59.152 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:09:59.154 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:10:29.439 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:10:29.442 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:10:29.444 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:10:59.619 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:10:59.621 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:10:59.624 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:11:29.748 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:11:29.751 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:11:29.753 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:11:59.892 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:11:59.896 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:11:59.899 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:12:30.035 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:12:30.045 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:12:30.048 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:13:00.188 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:13:00.191 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:13:00.194 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:13:30.349 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:13:30.351 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:13:30.355 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:14:00.542 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:14:00.547 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:14:00.550 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:14:30.687 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:14:30.691 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:14:30.694 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:15:00.873 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:15:00.880 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:15:00.884 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:15:31.048 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:15:31.053 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:15:31.055 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:16:01.209 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:16:01.216 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:16:01.220 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:16:31.373 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:16:31.377 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:16:31.380 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:17:01.512 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:17:01.515 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:17:01.521 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:17:31.644 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:17:31.655 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:17:31.658 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:18:02.065 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:18:02.072 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:18:02.076 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:18:32.232 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:18:32.237 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:18:32.240 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:19:02.396 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:19:02.403 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:19:02.413 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:19:32.540 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:19:32.559 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:19:32.576 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:20:02.707 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:20:02.721 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:20:02.737 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:20:32.869 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:20:32.875 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:20:32.880 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:21:03.024 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:21:03.029 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:21:03.035 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:21:33.202 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:21:33.205 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:21:33.208 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:22:03.340 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:22:03.350 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:22:03.356 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:22:33.555 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:22:33.558 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:22:33.561 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:23:03.717 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:23:03.725 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:23:03.731 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:23:33.885 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:23:33.889 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:23:33.892 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:24:04.028 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:24:04.031 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:24:04.033 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:24:34.155 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:24:34.159 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:24:34.161 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:25:04.291 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:25:04.294 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:25:04.296 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:25:34.554 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:25:34.561 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:25:34.564 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:26:04.850 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:26:04.854 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:26:04.859 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:26:35.015 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:26:35.018 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:26:35.021 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:27:05.169 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:27:05.172 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:27:05.174 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:27:35.307 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:27:35.310 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:27:35.312 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:28:05.704 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:28:05.707 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:28:05.710 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:28:35.857 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:28:35.859 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:28:35.862 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:29:06.022 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:29:06.025 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:29:06.027 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:29:36.248 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:29:36.251 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:29:36.254 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:30:06.379 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:30:06.382 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:30:06.384 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:30:36.523 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:30:36.526 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:30:36.528 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:31:06.660 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:31:06.663 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:31:06.665 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:31:36.812 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:31:36.815 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:31:36.817 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:32:06.955 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:32:06.958 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:32:06.960 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:32:37.150 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:32:37.153 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:32:37.155 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:33:07.322 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:33:07.324 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:33:07.327 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:33:37.510 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:33:37.513 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:33:37.515 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:34:07.673 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:34:07.676 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:34:07.678 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:34:37.792 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:34:37.795 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:34:37.797 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:35:07.976 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:35:07.979 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:35:07.982 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:35:38.105 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:35:38.108 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:35:38.110 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:36:08.293 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:36:08.296 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:36:08.298 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:36:38.475 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:36:38.478 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:36:38.481 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:37:08.619 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:37:08.622 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:37:08.624 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:37:38.819 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:37:38.823 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:37:38.825 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:38:08.948 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:38:08.952 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:38:08.954 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:38:39.101 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:38:39.104 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:38:39.106 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:39:09.245 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:39:09.247 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:39:09.250 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:39:39.389 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:39:39.392 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:39:39.395 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:40:09.541 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:40:09.544 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:40:09.546 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:40:39.677 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:40:39.680 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:40:39.682 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:41:09.813 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:41:09.815 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:41:09.818 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:41:39.939 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:41:39.942 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:41:39.944 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:42:10.059 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:42:10.062 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:42:10.064 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:42:40.194 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:42:40.197 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:42:40.199 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:43:10.376 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:43:10.380 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:43:10.382 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:43:40.564 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:43:40.567 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:43:40.569 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:44:10.978 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:44:10.981 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:44:10.984 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:44:41.158 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:44:41.162 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:44:41.165 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:45:11.280 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:45:11.284 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:45:11.286 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:45:41.442 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:45:41.446 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:45:41.448 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:46:11.564 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:46:11.567 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:46:11.569 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:46:41.703 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:46:41.707 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:46:41.710 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:47:11.855 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:47:11.858 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:47:11.861 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:47:41.963 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:47:41.967 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:47:41.969 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:48:12.161 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:48:12.163 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:48:12.166 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:48:42.323 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:48:42.327 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:48:42.329 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:49:12.429 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:49:12.432 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:49:12.434 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:49:42.608 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:49:42.611 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:49:42.614 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:50:12.755 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:50:12.758 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:50:12.761 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:50:42.868 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:50:42.871 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:50:42.874 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:51:13.056 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:51:13.060 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:51:13.062 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:51:43.246 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:51:43.250 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:51:43.253 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:52:13.350 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:52:13.353 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:52:13.355 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:52:43.504 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:52:43.508 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:52:43.510 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:53:13.618 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:53:13.622 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:53:13.625 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:53:43.798 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:53:43.801 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:53:43.804 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:54:13.911 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:54:13.914 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:54:13.916 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:54:44.017 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:54:44.022 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:54:44.024 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:55:14.171 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:55:14.174 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:55:14.176 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:55:44.285 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:55:44.288 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:55:44.290 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:56:14.389 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:56:14.393 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:56:14.397 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:56:44.503 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:56:44.506 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:56:44.508 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:57:14.607 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:57:14.611 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:57:14.613 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:57:44.930 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:57:44.933 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:57:44.936 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:58:15.026 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:58:15.029 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:58:15.032 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:58:45.199 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:58:45.201 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:58:45.204 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:59:15.385 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:59:15.388 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:59:15.391 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:59:45.582 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:59:45.586 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T07:59:45.588 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:00:15.688 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:00:15.691 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:00:15.694 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:00:45.792 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:00:45.796 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:00:45.799 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:01:15.898 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:01:15.901 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:01:15.904 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:01:46.011 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:01:46.014 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:01:46.017 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:02:16.134 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:02:16.136 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:02:16.139 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:02:46.278 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:02:46.281 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:02:46.283 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:03:16.452 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:03:16.455 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:03:16.457 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:03:46.595 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:03:46.598 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:03:46.600 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:04:16.787 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:04:16.789 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:04:16.792 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:04:46.984 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:04:46.986 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:04:46.989 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:05:17.118 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:05:17.121 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:05:17.124 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:05:47.443 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:05:47.446 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:05:47.449 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:06:17.581 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:06:17.584 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:06:17.587 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:06:47.746 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:06:47.749 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:06:47.752 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:07:17.886 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:07:17.889 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:07:17.892 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:07:48.011 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:07:48.014 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:07:48.017 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:08:18.169 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:08:18.172 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:08:18.175 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:08:48.302 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:08:48.305 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:08:48.307 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:09:18.437 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:09:18.440 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:09:18.443 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:09:48.581 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:09:48.585 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:09:48.587 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:10:18.789 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:10:18.793 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:10:18.797 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:10:48.995 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:10:48.998 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:10:49.002 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:11:19.191 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:11:19.194 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:11:19.197 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:11:49.414 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:11:49.418 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:11:49.421 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:12:19.551 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:12:19.554 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:12:19.557 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:12:49.677 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:12:49.681 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:12:49.684 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:13:19.830 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:13:19.833 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:13:19.836 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:13:49.957 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:13:49.960 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:13:49.963 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:14:20.092 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:14:20.095 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:14:20.098 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:14:50.219 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:14:50.222 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:14:50.228 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:15:20.364 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:15:20.366 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:15:20.369 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:15:50.490 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:15:50.493 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:15:50.495 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:16:20.592 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:16:20.596 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:16:20.599 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:16:50.772 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:16:50.775 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:16:50.777 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:17:20.922 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:17:20.925 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:17:20.928 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:17:51.049 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:17:51.052 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:17:51.054 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:18:21.246 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:18:21.249 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:18:21.251 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:18:51.418 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:18:51.421 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:18:51.424 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:19:21.558 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:19:21.561 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:19:21.564 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:19:51.761 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:19:51.764 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:19:51.767 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:20:21.932 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:20:21.935 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:20:21.937 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:20:52.121 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:20:52.126 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:20:52.129 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:21:22.250 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:21:22.253 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:21:22.256 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:21:52.403 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:21:52.405 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:21:52.407 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:22:22.546 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:22:22.548 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:22:22.551 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:22:52.665 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:22:52.668 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:22:52.670 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:23:22.847 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:23:22.850 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:23:22.852 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:23:53.068 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:23:53.071 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:23:53.074 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:24:23.205 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:24:23.208 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:24:23.211 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:24:53.349 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:24:53.352 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:24:53.354 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:25:23.484 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:25:23.487 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:25:23.489 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:25:53.620 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:25:53.623 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:25:53.625 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:26:23.748 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:26:23.750 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:26:23.753 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:26:53.883 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:26:53.886 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:26:53.888 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:27:24.010 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:27:24.013 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:27:24.016 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:27:54.145 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:27:54.148 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:27:54.151 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:28:24.313 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:28:24.315 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:28:24.318 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:28:54.485 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:28:54.487 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:28:54.490 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:29:24.619 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:29:24.622 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:29:24.624 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:29:54.786 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:29:54.789 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:29:54.791 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:30:24.941 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:30:24.944 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:30:24.946 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:30:55.112 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:30:55.115 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:30:55.118 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:31:25.480 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:31:25.484 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:31:25.487 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:31:55.656 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:31:55.659 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:31:55.661 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:32:25.774 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:32:25.776 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:32:25.778 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:32:55.918 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:32:55.920 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:32:55.923 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:33:26.280 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:33:26.283 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:33:26.287 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:33:56.676 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:33:56.678 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:33:56.681 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:34:26.781 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:34:26.784 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:34:26.786 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:34:56.886 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:34:56.889 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:34:56.892 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:35:27.017 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:35:27.020 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:35:27.023 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:35:57.188 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:35:57.191 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:35:57.193 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:36:27.619 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:36:27.622 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:36:27.624 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:36:57.798 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:36:57.801 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:36:57.804 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:37:27.962 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:37:27.965 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:37:27.968 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:37:58.066 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:37:58.069 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:37:58.071 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:38:28.238 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:38:28.241 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:38:28.244 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:38:58.535 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:38:58.537 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:38:58.540 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:39:28.731 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:39:28.734 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:39:28.738 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:39:58.902 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:39:58.905 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:39:58.908 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:40:29.025 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:40:29.027 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:40:29.030 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:40:59.195 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:40:59.198 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:40:59.200 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:41:29.301 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:41:29.304 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:41:29.307 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:41:59.423 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:41:59.426 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:41:59.428 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:42:29.553 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:42:29.556 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:42:29.559 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:42:59.725 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:42:59.728 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:42:59.730 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:43:29.896 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:43:29.899 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:43:29.901 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:44:00.084 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:44:00.088 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:44:00.090 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:44:30.273 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:44:30.277 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:44:30.280 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:45:00.477 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:45:00.481 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:45:00.484 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:45:30.665 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:45:30.668 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:45:30.670 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:46:00.846 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:46:00.849 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:46:00.851 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:46:30.976 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:46:30.979 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:46:30.981 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:47:01.097 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:47:01.100 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:47:01.102 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:47:31.318 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:47:31.322 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:47:31.325 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:48:01.509 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:48:01.512 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:48:01.515 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:48:31.688 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:48:31.691 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:48:31.693 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:49:02.034 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:49:02.037 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:49:02.039 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:49:32.174 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:49:32.177 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:49:32.179 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:50:02.336 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:50:02.339 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:50:02.341 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:50:32.515 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:50:32.518 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:50:32.520 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:51:02.712 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:51:02.715 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:51:02.717 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:51:32.866 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:51:32.868 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:51:32.871 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:52:02.985 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:52:02.988 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:52:02.990 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:52:33.177 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:52:33.180 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:52:33.182 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:53:03.373 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:53:03.376 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:53:03.378 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:53:33.561 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:53:33.564 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:53:33.566 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:54:03.752 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:54:03.755 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:54:03.758 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:54:33.896 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:54:33.899 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:54:33.902 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:55:04.095 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:55:04.098 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:55:04.101 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:55:34.267 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:55:34.270 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:55:34.272 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:56:04.438 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:56:04.441 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:56:04.444 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:56:34.619 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:56:34.621 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:56:34.624 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:57:04.740 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:57:04.743 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:57:04.746 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:57:34.868 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:57:34.871 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:57:34.873 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:58:05.037 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:58:05.039 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:58:05.042 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:58:35.222 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:58:35.225 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:58:35.228 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:59:05.349 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:59:05.352 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:59:05.355 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:59:35.494 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:59:35.498 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T08:59:35.500 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:00:05.620 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:00:05.623 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:00:05.626 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:00:35.766 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:00:35.769 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:00:35.771 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:01:05.901 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:01:05.904 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:01:05.906 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:01:36.062 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:01:36.065 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:01:36.067 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:02:06.213 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:02:06.217 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:02:06.220 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:02:36.365 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:02:36.368 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:02:36.371 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:03:06.560 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:03:06.563 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:03:06.565 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:03:36.824 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:03:36.827 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:03:36.830 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:04:07.011 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:04:07.013 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:04:07.016 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:04:37.199 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:04:37.203 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:04:37.205 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:05:07.371 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:05:07.374 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:05:07.377 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:05:37.559 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:05:37.562 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:05:37.564 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:06:07.722 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:06:07.726 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:06:07.728 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:06:37.886 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:06:37.889 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:06:37.892 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:07:08.058 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:07:08.061 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:07:08.064 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:07:38.189 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:07:38.192 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:07:38.194 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:08:08.384 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:08:08.387 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:08:08.389 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:08:38.573 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:08:38.576 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:08:38.579 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:09:08.761 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:09:08.764 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:09:08.766 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:09:38.988 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:09:38.992 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:09:38.995 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:10:09.197 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:10:09.200 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:10:09.202 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:10:39.385 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:10:39.388 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:10:39.390 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:11:09.591 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:11:09.595 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:11:09.597 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:11:39.739 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:11:39.743 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:11:39.750 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:12:09.925 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:12:09.928 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:12:09.930 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:12:40.044 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:12:40.047 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:12:40.050 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:13:10.242 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:13:10.245 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:13:10.247 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:13:40.440 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:13:40.443 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:13:40.446 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:14:10.636 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:14:10.639 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:14:10.643 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:14:40.833 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:14:40.835 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:14:40.838 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:15:11.012 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:15:11.015 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:15:11.018 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:15:41.209 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:15:41.212 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:15:41.214 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:16:11.342 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:16:11.345 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:16:11.348 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:16:41.611 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:16:41.614 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:16:41.617 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:17:11.783 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:17:11.786 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:17:11.788 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:17:41.895 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:17:41.899 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:17:41.901 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:18:12.027 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:18:12.031 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:18:12.034 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:18:42.179 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:18:42.183 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:18:42.186 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:19:12.347 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:19:12.351 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:19:12.354 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:19:42.466 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:19:42.469 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:19:42.471 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:20:12.655 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:20:12.658 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:20:12.661 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:20:42.827 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:20:42.830 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:20:42.832 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:21:13.015 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:21:13.018 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:21:13.020 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:21:43.186 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:21:43.189 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:21:43.193 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:22:13.359 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:22:13.362 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:22:13.365 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:22:43.621 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:22:43.624 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:22:43.626 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:23:13.794 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:23:13.797 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:23:13.800 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:23:43.917 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:23:43.921 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:23:43.923 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:24:14.120 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:24:14.124 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:24:14.126 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:24:44.255 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:24:44.259 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:24:44.261 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:25:14.438 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:25:14.441 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:25:14.443 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:25:44.609 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:25:44.612 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:25:44.614 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:26:14.756 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:26:14.759 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:26:14.761 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:26:44.945 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:26:44.948 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:26:44.951 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:27:15.058 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:27:15.061 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:27:15.063 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:27:45.179 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:27:45.182 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:27:45.185 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:28:15.285 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:28:15.288 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:28:15.290 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:28:45.539 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:28:45.542 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:28:45.545 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:29:15.744 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:29:15.747 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:29:15.749 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:29:45.908 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:29:45.911 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:29:45.914 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:30:16.022 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:30:16.025 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:30:16.027 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:30:46.219 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:30:46.223 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:30:46.226 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:31:16.398 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:31:16.401 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:31:16.404 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:31:46.558 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:31:46.561 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:31:46.564 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:32:16.775 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:32:16.778 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:32:16.780 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:32:46.908 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:32:46.911 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:32:46.914 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:33:17.102 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:33:17.105 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:33:17.108 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:33:47.281 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:33:47.283 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:33:47.286 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:34:17.415 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:34:17.419 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:34:17.422 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:34:47.585 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:34:47.587 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:34:47.590 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:35:17.713 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:35:17.717 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:35:17.720 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:35:47.910 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:35:47.914 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:35:47.917 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:36:18.073 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:36:18.076 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:36:18.078 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:36:48.271 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:36:48.275 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:36:48.278 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:37:18.449 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:37:18.452 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:37:18.454 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:37:48.596 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:37:48.599 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:37:48.601 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:38:18.724 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:38:18.727 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:38:18.730 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:38:48.859 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:38:48.862 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:38:48.864 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:39:18.995 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:39:18.997 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:39:19.000 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:39:49.122 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:39:49.126 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:39:49.128 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:40:19.265 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:40:19.268 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:40:19.270 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:40:49.375 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:40:49.378 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:40:49.380 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:41:19.547 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:41:19.550 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:41:19.552 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:41:49.727 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:41:49.730 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:41:49.732 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:42:19.933 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:42:19.937 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:42:19.940 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:42:50.094 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:42:50.097 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:42:50.099 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:43:20.202 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:43:20.206 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:43:20.208 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:43:50.406 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:43:50.409 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:43:50.412 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:44:20.519 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:44:20.522 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:44:20.525 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:44:50.675 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:44:50.678 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:44:50.681 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:45:20.855 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:45:20.859 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:45:20.863 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:45:50.976 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:45:50.979 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:45:50.982 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:46:21.381 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:46:21.384 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:46:21.387 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:46:51.494 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:46:51.497 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:46:51.499 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:47:21.668 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:47:21.671 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:47:21.674 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:47:51.879 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:47:51.883 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:47:51.886 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:48:22.061 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:48:22.065 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:48:22.068 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:48:52.239 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:48:52.293 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:48:52.295 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:49:22.428 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:49:22.432 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:49:22.434 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:49:52.600 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:49:52.603 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:49:52.605 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:50:22.787 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:50:22.790 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:50:22.793 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:50:52.918 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:50:52.921 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:50:52.923 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:51:23.022 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:51:23.027 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:51:23.030 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:51:53.196 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:51:53.199 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:51:53.202 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:52:23.374 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:52:23.377 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:52:23.380 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:52:53.570 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:52:53.573 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:52:53.576 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:53:23.768 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:53:23.771 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:53:23.773 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:53:53.973 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:53:53.976 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:53:53.978 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:54:24.095 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:54:24.098 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:54:24.101 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:54:54.282 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:54:54.284 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:54:54.287 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:55:24.457 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:55:24.460 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:55:24.463 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:55:54.692 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:55:54.695 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:55:54.697 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:56:24.856 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:56:24.859 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:56:24.861 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:56:54.998 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:56:55.002 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:56:55.004 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:57:25.175 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:57:25.178 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:57:25.181 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:57:55.346 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:57:55.349 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:57:55.352 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:58:25.536 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:58:25.539 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:58:25.541 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:58:55.715 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:58:55.718 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:58:55.720 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:59:25.854 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:59:25.858 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:59:25.860 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:59:56.041 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:59:56.045 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T09:59:56.047 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:00:26.222 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:00:26.225 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:00:26.228 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:00:56.375 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:00:56.378 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:00:56.381 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:01:26.548 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:01:26.551 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:01:26.553 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:01:56.720 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:01:56.725 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:01:56.729 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:02:26.902 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:02:26.905 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:02:26.907 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:02:57.095 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:02:57.099 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:02:57.109 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:03:27.210 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:03:27.214 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:03:27.222 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:03:57.339 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:03:57.342 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:03:57.345 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:04:27.462 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:04:27.468 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:04:27.482 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:04:57.583 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:04:57.593 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:04:57.597 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:05:27.706 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:05:27.716 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:05:27.731 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:05:57.828 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:05:57.832 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:05:57.835 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:06:27.958 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:06:27.962 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:06:27.967 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:06:58.061 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:06:58.064 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:06:58.067 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:07:28.166 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:07:28.170 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:07:28.172 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:07:58.272 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:07:58.274 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:07:58.277 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:08:28.384 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:08:28.387 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:08:28.390 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:08:58.489 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:08:58.492 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:08:58.495 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:09:28.619 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:09:28.622 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:09:28.625 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:09:58.741 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:09:58.744 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:09:58.747 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:10:28.845 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:10:28.848 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:10:28.851 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:10:58.951 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:10:58.954 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:10:58.957 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:11:29.058 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:11:29.062 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:11:29.065 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:11:59.170 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:11:59.174 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:11:59.176 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:12:29.291 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:12:29.294 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:12:29.296 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:12:59.480 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:12:59.484 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:12:59.489 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:13:29.592 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:13:29.595 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:13:29.598 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:13:59.764 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:13:59.767 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:13:59.769 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:14:29.969 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:14:29.971 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:14:29.974 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:15:00.073 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:15:00.076 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:15:00.079 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:15:30.179 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:15:30.182 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:15:30.184 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:16:00.584 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:16:00.587 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:16:00.590 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:16:30.687 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:16:30.690 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:16:30.692 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:17:00.851 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:17:00.854 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:17:00.857 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:17:30.965 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:17:30.968 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:17:30.970 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:18:01.077 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:18:01.081 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:18:01.083 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:18:31.217 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:18:31.220 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:18:31.222 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:19:01.346 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:19:01.349 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:19:01.353 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:19:31.534 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:19:31.536 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:19:31.539 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:20:01.648 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:20:01.651 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:20:01.653 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:20:31.845 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:20:31.848 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:20:31.850 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:21:02.041 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:21:02.044 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:21:02.047 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:21:32.187 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:21:32.191 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:21:32.193 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:22:02.334 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:22:02.337 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:22:02.339 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:22:32.447 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:22:32.450 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:22:32.453 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:23:02.553 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:23:02.557 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:23:02.559 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:23:32.733 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:23:32.737 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:23:32.741 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:24:02.854 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:24:02.857 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:24:02.861 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:24:33.017 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:24:33.020 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:24:33.022 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:25:03.230 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:25:03.233 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:25:03.236 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:25:33.503 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:25:33.507 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:25:33.510 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:26:03.624 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:26:03.628 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:26:03.635 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:26:33.763 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:26:33.766 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:26:33.769 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:27:03.941 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:27:03.944 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:27:03.946 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:27:34.113 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:27:34.116 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:27:34.118 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:28:04.244 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:28:04.246 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:28:04.251 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:28:34.354 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:28:34.357 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:28:34.360 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:29:04.474 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:29:04.478 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:29:04.480 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:29:34.609 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:29:34.612 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:29:34.615 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:30:04.762 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:30:04.764 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:30:04.767 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:30:34.889 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:30:34.892 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:30:34.895 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:31:05.016 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:31:05.018 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:31:05.021 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:31:35.161 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:31:35.163 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:31:35.166 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:32:05.270 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:32:05.273 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:32:05.275 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:32:35.423 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:32:35.426 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:32:35.428 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:33:05.558 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:33:05.561 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:33:05.563 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:33:35.711 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:33:35.715 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:33:35.719 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:34:05.846 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:34:05.849 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:34:05.851 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:34:35.965 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:34:35.968 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:34:35.971 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:35:06.117 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:35:06.120 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:35:06.123 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:35:36.228 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:35:36.232 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:35:36.235 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:36:06.363 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:36:06.366 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:36:06.369 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:36:36.507 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:36:36.509 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:36:36.511 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:37:06.660 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:37:06.664 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:37:06.667 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:37:36.819 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:37:36.823 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:37:36.826 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:38:07.003 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:38:07.006 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:38:07.008 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:38:37.363 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:38:37.366 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:38:37.368 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:39:07.510 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:39:07.513 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:39:07.516 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:39:37.645 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:39:37.648 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:39:37.651 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:40:07.822 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:40:07.825 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:40:07.828 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:40:38.136 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:40:38.140 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:40:38.143 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:41:08.341 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:41:08.345 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:41:08.347 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:41:38.487 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:41:38.497 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:41:38.504 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:42:08.640 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:42:08.643 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:42:08.645 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:42:38.808 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:42:38.811 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:42:38.813 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:43:08.918 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:43:08.922 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:43:08.924 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:43:39.122 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:43:39.125 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:43:39.127 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:44:09.294 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:44:09.297 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:44:09.300 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:44:39.400 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:44:39.402 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:44:39.404 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:45:09.588 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:45:09.591 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:45:09.593 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:45:39.702 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:45:39.705 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:45:39.707 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:46:09.897 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:46:09.900 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:46:09.902 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:46:40.094 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:46:40.098 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:46:40.100 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:47:10.290 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:47:10.294 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:47:10.297 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:47:40.397 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:47:40.400 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:47:40.403 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:48:10.549 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:48:10.552 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:48:10.554 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:48:40.677 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:48:40.680 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:48:40.682 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:49:10.824 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:49:10.827 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:49:10.830 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:49:40.947 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:49:40.950 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:49:40.952 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:50:11.117 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:50:11.119 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:50:11.124 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:50:41.309 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:50:41.312 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:50:41.314 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:51:11.497 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:51:11.501 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:51:11.503 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:51:41.686 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:51:41.689 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:51:41.691 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:52:11.857 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:52:11.860 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:52:11.863 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:52:42.045 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:52:42.048 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:52:42.054 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:53:12.188 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:53:12.191 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:53:12.194 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:53:42.372 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:53:42.375 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:53:42.377 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:54:12.560 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:54:12.564 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:54:12.566 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:54:42.724 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:54:42.727 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:54:42.730 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:55:12.872 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:55:12.875 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:55:12.878 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:55:43.016 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:55:43.020 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:55:43.023 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:56:13.135 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:56:13.138 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:56:13.141 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:56:43.311 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:56:43.313 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:56:43.316 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:57:13.582 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:57:13.584 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:57:13.587 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:57:43.770 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:57:43.773 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:57:43.775 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:58:13.933 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:58:13.938 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:58:13.941 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:58:44.081 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:58:44.085 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:58:44.088 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:59:14.285 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:59:14.288 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:59:14.290 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:59:44.416 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:59:44.419 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T10:59:44.422 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:00:14.552 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:00:14.555 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:00:14.557 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:00:44.687 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:00:44.690 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:00:44.692 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:01:14.864 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:01:14.868 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:01:14.871 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:01:45.027 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:01:45.031 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:01:45.034 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:02:15.208 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:02:15.210 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:02:15.213 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:02:45.347 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:02:45.350 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:02:45.352 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:03:15.490 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:03:15.493 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:03:15.496 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:03:45.643 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:03:45.647 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:03:45.649 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:04:15.770 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:04:15.773 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:04:15.776 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:04:45.958 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:04:45.961 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:04:45.963 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:05:16.162 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:05:16.165 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:05:16.168 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:05:46.301 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:05:46.304 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:05:46.307 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:06:16.420 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:06:16.423 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:06:16.426 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:06:46.564 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:06:46.566 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:06:46.569 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:07:16.741 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:07:16.760 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:07:16.762 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:07:46.955 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:07:46.957 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:07:46.960 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:08:17.134 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:08:17.140 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:08:17.143 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:08:47.482 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:08:47.485 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:08:47.488 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:09:17.633 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:09:17.636 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:09:17.639 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:09:47.751 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:09:47.754 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:09:47.757 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:10:17.938 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:10:17.941 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:10:17.943 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:10:48.073 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:10:48.076 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:10:48.078 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:11:18.331 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:11:18.335 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:11:18.338 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:11:48.545 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:11:48.548 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:11:48.551 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:12:18.725 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:12:18.727 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:12:18.729 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:12:48.922 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:12:48.924 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:12:48.927 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:13:19.094 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:13:19.096 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:13:19.098 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:13:49.290 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:13:49.293 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:13:49.295 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:14:19.403 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:14:19.406 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:14:19.408 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:14:49.500 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:14:49.504 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:14:49.506 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:15:19.705 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:15:19.708 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:15:19.710 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:15:49.884 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:15:49.887 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:15:49.890 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:16:20.065 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:16:20.068 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:16:20.071 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:16:50.254 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:16:50.259 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:16:50.262 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:17:20.441 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:17:20.445 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:17:20.447 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:17:50.564 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:17:50.566 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:17:50.569 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:18:20.661 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:18:20.663 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:18:20.666 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:18:50.765 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:18:50.768 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:18:50.770 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:19:20.929 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:19:20.932 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:19:20.934 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:19:51.035 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:19:51.037 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:19:51.039 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:20:21.206 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:20:21.209 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:20:21.213 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:20:51.403 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:20:51.406 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:20:51.409 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:21:21.574 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:21:21.578 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:21:21.581 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:21:51.792 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:21:51.797 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:21:51.801 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:22:21.985 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:22:21.990 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:22:21.993 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:22:52.173 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:22:52.177 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:22:52.180 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:23:22.311 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:23:22.314 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:23:22.316 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:23:52.508 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:23:52.511 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:23:52.513 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:24:22.615 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:24:22.618 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:24:22.620 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:24:52.777 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:24:52.780 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:24:52.782 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:25:22.928 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:25:22.931 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:25:22.933 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:25:53.080 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:25:53.082 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:25:53.085 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:26:23.258 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:26:23.261 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:26:23.264 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:26:53.672 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:26:53.674 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:26:53.677 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:27:23.836 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:27:23.839 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:27:23.842 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:27:53.972 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:27:53.974 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:27:53.977 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:28:24.153 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:28:24.156 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:28:24.158 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:28:54.333 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:28:54.336 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:28:54.338 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:29:24.505 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:29:24.508 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:29:24.510 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:29:54.685 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:29:54.688 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:29:54.691 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:30:24.957 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:30:24.960 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:30:24.962 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:30:55.163 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:30:55.166 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:30:55.168 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:31:25.367 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:31:25.370 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:31:25.372 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:31:55.546 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:31:55.550 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:31:55.552 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:32:25.701 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:32:25.703 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:32:25.706 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:32:55.835 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:32:55.838 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:32:55.840 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:33:25.988 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:33:25.991 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:33:25.993 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:33:56.184 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:33:56.187 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:33:56.189 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:34:26.364 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:34:26.367 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:34:26.370 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:34:56.503 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:34:56.506 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:34:56.508 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:35:26.613 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:35:26.616 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:35:26.619 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:35:56.788 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:35:56.791 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:35:56.794 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:36:26.968 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:36:26.971 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:36:26.974 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:36:57.323 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:36:57.326 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:36:57.329 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:37:27.480 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:37:27.483 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:37:27.486 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:37:57.590 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:37:57.593 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:37:57.595 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:38:27.771 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:38:27.774 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:38:27.776 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:38:57.902 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:38:57.905 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:38:57.908 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:39:28.031 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:39:28.033 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:39:28.036 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:39:58.182 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:39:58.185 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:39:58.188 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:40:28.327 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:40:28.330 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:40:28.332 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:40:58.471 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:40:58.474 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:40:58.476 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:41:28.859 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:41:28.862 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:41:28.865 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:41:58.982 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:41:58.985 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:41:58.988 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:42:29.118 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:42:29.121 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:42:29.123 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:42:59.254 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:42:59.257 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:42:59.259 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:43:29.413 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:43:29.416 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:43:29.418 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:43:59.585 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:43:59.589 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:43:59.592 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:44:29.726 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:44:29.729 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:44:29.731 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:44:59.846 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:44:59.849 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:44:59.852 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:45:29.973 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:45:29.976 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:45:29.979 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:46:00.092 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:46:00.095 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:46:00.097 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:46:30.236 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:46:30.239 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:46:30.241 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:47:00.363 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:47:00.366 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:47:00.369 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:47:30.498 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:47:30.501 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:47:30.504 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:48:00.625 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:48:00.628 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:48:00.630 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:48:30.744 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:48:30.748 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:48:30.750 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:49:00.888 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:49:00.892 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:49:00.894 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:49:31.015 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:49:31.017 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:49:31.020 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:50:01.142 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:50:01.145 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:50:01.148 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:50:31.290 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:50:31.293 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:50:31.295 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:51:01.413 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:51:01.416 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:51:01.419 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:51:31.585 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:51:31.588 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:51:31.591 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:52:01.734 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:52:01.737 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:52:01.739 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:52:31.861 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:52:31.864 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:52:31.866 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:53:01.997 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:53:02.000 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:53:02.002 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:53:32.157 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:53:32.160 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:53:32.162 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:54:02.294 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:54:02.297 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:54:02.299 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:54:32.421 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:54:32.424 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:54:32.427 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:55:02.565 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:55:02.568 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:55:02.571 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:55:32.675 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:55:32.679 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:55:32.681 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:56:02.788 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:56:02.791 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:56:02.794 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:56:32.960 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:56:32.963 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:56:32.965 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:57:03.123 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:57:03.127 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:57:03.129 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:57:33.242 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:57:33.244 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:57:33.247 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:58:03.425 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:58:03.428 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:58:03.431 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:58:33.571 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:58:33.575 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:58:33.579 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:59:03.753 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:59:03.757 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:59:03.759 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:59:33.892 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:59:33.895 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T11:59:33.898 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:00:04.045 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:00:04.048 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:00:04.051 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:00:34.243 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:00:34.247 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:00:34.249 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:01:04.432 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:01:04.435 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:01:04.438 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:01:34.584 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:01:34.587 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:01:34.590 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:02:04.750 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:02:04.753 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:02:04.755 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:02:34.880 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:02:34.883 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:02:34.886 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:03:05.052 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:03:05.055 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:03:05.057 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:03:35.193 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:03:35.196 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:03:35.198 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:04:05.345 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:04:05.347 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:04:05.350 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:04:35.472 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:04:35.475 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:04:35.478 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:05:05.672 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:05:05.675 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:05:05.678 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:05:36.026 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:05:36.029 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:05:36.032 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:06:06.146 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:06:06.148 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:06:06.151 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:06:36.320 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:06:36.323 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:06:36.326 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:07:06.450 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:07:06.453 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:07:06.456 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:07:36.698 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:07:36.701 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:07:36.703 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:08:06.827 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:08:06.829 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:08:06.832 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:08:36.956 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:08:36.960 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:08:36.963 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:09:07.154 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:09:07.157 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:09:07.160 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:09:37.259 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:09:37.262 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:09:37.264 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:10:07.388 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:10:07.392 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:10:07.395 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:10:37.527 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:10:37.530 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:10:37.533 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:11:07.660 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:11:07.663 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:11:07.666 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:11:37.845 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:11:37.849 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:11:37.851 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:12:08.034 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:12:08.036 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:12:08.039 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:12:38.214 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:12:38.217 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:12:38.219 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:13:08.386 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:13:08.389 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:13:08.393 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:13:38.528 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:13:38.533 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:13:38.537 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:14:08.720 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:14:08.723 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:14:08.725 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:14:38.909 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:14:38.912 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:14:38.915 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:15:09.035 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:15:09.038 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:15:09.041 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:15:39.302 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:15:39.305 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:15:39.307 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:16:09.590 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:16:09.593 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:16:09.595 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:16:39.732 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:16:39.735 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:16:39.738 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:17:09.921 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:17:09.924 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:17:09.927 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:17:40.030 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:17:40.033 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:17:40.036 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:18:10.165 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:18:10.168 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:18:10.171 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:18:40.300 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:18:40.303 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:18:40.305 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:19:10.447 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:19:10.450 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:19:10.452 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:19:40.624 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:19:40.627 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:19:40.630 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:20:10.814 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:20:10.817 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:20:10.820 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:20:40.995 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:20:40.998 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:20:41.001 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:21:11.138 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:21:11.141 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:21:11.144 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:21:41.338 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:21:41.342 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:21:41.344 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:22:11.509 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:22:11.513 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:22:11.518 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:22:41.652 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:22:41.656 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:22:41.659 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:23:11.798 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:23:11.801 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:23:11.803 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:23:41.908 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:23:41.911 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:23:41.913 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:24:12.060 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:24:12.065 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:24:12.067 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:24:42.204 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:24:42.207 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:24:42.210 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:25:12.339 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:25:12.344 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:25:12.347 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:25:42.491 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:25:42.494 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:25:42.496 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:26:12.626 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:26:12.630 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:26:12.634 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:26:42.754 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:26:42.757 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:26:42.760 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:27:12.951 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:27:12.955 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:27:12.958 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:27:43.099 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:27:43.103 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:27:43.105 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:28:13.269 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:28:13.273 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:28:13.276 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:28:43.413 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:28:43.417 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:28:43.420 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:29:13.540 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:29:13.543 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:29:13.545 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:29:43.692 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:29:43.694 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:29:43.697 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:30:13.880 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:30:13.883 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:30:13.886 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:30:44.069 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:30:44.073 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:30:44.076 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:31:14.232 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:31:14.235 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:31:14.238 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:31:44.395 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:31:44.398 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:31:44.401 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:32:14.593 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:32:14.596 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:32:14.599 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:32:44.698 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:32:44.701 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:32:44.703 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:33:14.857 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:33:14.859 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:33:14.862 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:33:45.001 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:33:45.003 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:33:45.006 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:34:15.179 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:34:15.181 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:34:15.184 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:34:45.376 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:34:45.378 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:34:45.381 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:35:15.589 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:35:15.592 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:35:15.594 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:35:45.768 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:35:45.771 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:35:45.773 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:36:15.882 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:36:15.886 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:36:15.889 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:36:46.047 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:36:46.050 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:36:46.053 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:37:16.191 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:37:16.194 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:37:16.197 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:37:46.318 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:37:46.321 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:37:46.323 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:38:16.485 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:38:16.488 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:38:16.491 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:38:46.691 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:38:46.694 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:38:46.697 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:39:16.879 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:39:16.882 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:39:16.884 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:39:47.016 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:39:47.019 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:39:47.021 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:40:17.146 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:40:17.149 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:40:17.152 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:40:47.477 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:40:47.479 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:40:47.482 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:41:17.633 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:41:17.636 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:41:17.638 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:41:47.819 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:41:47.822 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:41:47.824 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:42:17.999 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:42:18.002 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:42:18.004 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:42:48.131 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:42:48.134 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:42:48.136 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:43:18.292 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:43:18.296 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:43:18.299 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:43:48.411 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:43:48.413 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:43:48.416 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:44:18.586 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:44:18.588 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:44:18.591 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:44:48.708 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:44:48.711 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:44:48.714 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:45:18.842 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:45:18.846 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:45:18.848 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:45:48.970 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:45:48.974 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:45:48.978 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:46:19.097 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:46:19.101 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:46:19.104 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:46:49.240 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:46:49.243 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:46:49.245 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:47:19.376 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:47:19.378 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:47:19.381 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:47:49.504 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:47:49.507 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:47:49.509 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:48:19.638 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:48:19.641 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:48:19.644 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:48:49.774 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:48:49.776 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:48:49.779 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:49:19.926 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:49:19.929 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:49:19.932 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:49:50.119 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:49:50.122 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:49:50.130 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:50:20.304 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:50:20.308 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:50:20.310 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:50:50.509 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:50:50.515 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:50:50.518 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:51:20.706 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:51:20.711 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:51:20.713 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:51:50.863 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:51:50.866 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:51:50.869 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:52:20.990 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:52:20.993 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:52:20.996 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:52:51.117 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:52:51.119 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:52:51.126 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:53:21.253 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:53:21.257 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:53:21.259 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:53:51.389 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:53:51.392 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:53:51.394 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:54:21.579 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:54:21.582 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:54:21.584 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:54:51.898 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:54:51.900 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:54:51.903 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:55:22.087 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:55:22.090 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:55:22.093 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:55:52.230 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:55:52.266 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:55:52.269 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:56:22.407 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:56:22.410 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:56:22.412 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:56:52.551 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:56:52.555 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:56:52.557 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:57:22.740 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:57:22.743 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:57:22.746 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:57:52.920 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:57:52.923 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:57:52.926 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:58:23.066 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:58:23.069 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:58:23.071 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:58:53.201 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:58:53.203 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:58:53.206 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:59:23.367 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:59:23.370 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:59:23.374 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:59:53.490 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:59:53.492 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T12:59:53.495 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:00:23.744 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:00:23.747 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:00:23.749 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:00:53.925 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:00:53.927 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:00:53.930 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:01:24.121 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:01:24.125 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:01:24.128 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:01:54.301 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:01:54.304 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:01:54.306 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:02:24.481 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:02:24.483 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:02:24.486 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:02:54.653 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:02:54.657 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:02:54.662 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:03:24.783 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:03:24.786 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:03:24.788 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:03:54.938 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:03:54.941 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:03:54.943 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:04:25.101 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:04:25.104 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:04:25.106 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:04:55.219 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:04:55.222 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:04:55.224 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:05:25.378 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:05:25.381 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:05:25.384 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:05:55.575 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:05:55.578 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:05:55.580 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:06:25.855 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:06:25.858 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:06:25.860 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:06:56.026 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:06:56.029 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:06:56.031 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:07:26.166 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:07:26.168 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:07:26.171 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:07:56.353 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:07:56.356 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:07:56.358 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:08:26.558 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:08:26.561 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:08:26.564 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:08:56.746 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:08:56.750 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:08:56.752 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:09:26.942 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:09:26.945 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:09:26.947 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:09:57.138 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:09:57.141 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:09:57.143 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:10:27.318 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:10:27.321 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:10:27.324 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:10:57.454 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:10:57.457 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:10:57.460 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:11:27.637 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:11:27.640 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:11:27.643 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:11:57.809 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:11:57.812 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:11:57.814 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:12:27.997 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:12:28.000 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:12:28.002 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:12:58.160 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:12:58.163 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:12:58.165 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:13:28.357 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:13:28.360 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:13:28.362 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:13:58.484 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:13:58.487 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:13:58.490 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:14:28.688 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:14:28.690 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:14:28.693 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:14:58.831 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:14:58.834 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:14:58.837 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:15:29.010 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:15:29.013 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:15:29.015 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:15:59.215 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:15:59.218 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:15:59.220 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:16:29.353 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:16:29.356 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:16:29.359 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:16:59.524 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:16:59.528 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:16:59.530 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:17:29.667 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:17:29.671 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:17:29.673 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:17:59.811 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:17:59.813 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:17:59.816 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:18:29.938 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:18:29.941 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:18:29.943 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:19:00.081 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:19:00.084 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:19:00.087 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:19:30.242 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:19:30.245 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:19:30.248 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:20:00.402 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:20:00.405 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:20:00.407 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:20:30.538 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:20:30.540 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:20:30.543 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:21:00.648 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:21:00.650 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:21:00.653 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:21:30.812 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:21:30.815 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:21:30.817 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:22:00.928 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:22:00.932 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:22:00.935 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:22:31.098 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:22:31.101 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:22:31.104 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:23:01.278 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:23:01.281 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:23:01.284 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:23:31.442 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:23:31.445 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:23:31.447 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:24:01.621 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:24:01.625 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:24:01.627 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:24:31.809 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:24:31.812 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:24:31.814 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:25:01.988 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:25:01.991 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:25:01.993 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:25:32.177 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:25:32.180 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:25:32.182 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:26:02.340 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:26:02.343 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:26:02.345 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:26:32.473 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:26:32.476 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:26:32.479 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:27:02.600 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:27:02.604 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:27:02.607 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:27:32.752 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:27:32.755 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:27:32.758 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:28:03.044 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:28:03.047 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:28:03.049 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:28:33.189 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:28:33.193 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:28:33.195 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:29:03.342 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:29:03.345 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:29:03.348 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:29:33.453 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:29:33.457 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:29:33.459 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:30:03.596 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:30:03.599 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:30:03.602 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:30:33.752 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:30:33.755 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:30:33.758 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:31:03.892 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:31:03.896 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:31:03.899 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:31:34.037 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:31:34.040 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:31:34.042 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:32:04.156 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:32:04.159 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:32:04.161 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:32:34.292 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:32:34.295 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:32:34.297 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:33:04.477 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:33:04.480 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:33:04.482 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:33:34.657 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:33:34.660 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:33:34.662 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:34:04.820 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:34:04.823 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:34:04.826 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:34:35.117 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:34:35.120 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:34:35.122 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:35:05.235 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:35:05.238 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:35:05.240 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-12T13:35:10.346 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-07-12T13:35:10.391 DEBUG:teuthology.task.console_log:Killing console logger for smithi060 2023-07-12T13:35:10.392 DEBUG:teuthology.task.console_log:Killing console logger for smithi079 2023-07-12T13:35:10.392 DEBUG:teuthology.task.console_log:Killing console logger for smithi174 2023-07-12T13:35:10.393 DEBUG:teuthology.exit:Finished running handlers